2026-02-22T20:48:29.309 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T20:48:29.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:48:29.406 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598 branch: wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{v2/{compr$/{yes$/{snappy}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} email: null first_in_suite: false flavor: default job_id: '64598' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client ping interval: 4 mon client ping timeout: 12 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd_mclock_skip_benchmark: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: distro-suffix: rockylinux-10 install: ceph: flavor: default sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e owner: scheduled_nmordech@soko04.front.sepia.ceph.com priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 966 sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a5c3084f688b1f6eff223b8d259a8316f9844c8e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e targets: trial007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVv+s27R3iHxRiNvI0MxAehzo1NQ3JlIj1VWctzL+4UHDNzKNPt8G1ORO3tuMeO05/h3XRu24GiPAF/tcx/3Pg= trial061.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNS3Li6fb7vMqKZ4kKd9hGB/OoGjqBn/GLR4nHUsCl4O678aCZV6Evxsr5sMj1fYyGP8nTwCw1DWsja1bXuZZnQ= tasks: - install: null - ceph: null - mon_thrash: freeze_mon_duration: 20 freeze_mon_probability: 10 revive_delay: 20 thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:44:01 tube: trial user: nmordech verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T20:48:29.406 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a5c3084f688b1f6eff223b8d259a8316f9844c8e/qa; will attempt to use it 2026-02-22T20:48:29.407 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a5c3084f688b1f6eff223b8d259a8316f9844c8e/qa/tasks 2026-02-22T20:48:29.407 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T20:48:29.409 INFO:teuthology.task.internal:Checking packages... 2026-02-22T20:48:29.409 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a5c3084f688b1f6eff223b8d259a8316f9844c8e' 2026-02-22T20:48:29.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T20:48:29.409 INFO:teuthology.packaging:ref: None 2026-02-22T20:48:29.409 INFO:teuthology.packaging:tag: None 2026-02-22T20:48:29.409 INFO:teuthology.packaging:branch: wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle 2026-02-22T20:48:29.409 INFO:teuthology.packaging:sha1: a5c3084f688b1f6eff223b8d259a8316f9844c8e 2026-02-22T20:48:29.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle 2026-02-22T20:48:29.531 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:48:29.532 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T20:48:29.543 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T20:48:29.544 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T20:48:29.558 INFO:teuthology.task.internal:Saving configuration 2026-02-22T20:48:29.571 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T20:48:29.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T20:48:29.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial007.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 20:44:57.018580', 'locked_by': 'scheduled_nmordech@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPdtNN2R2S41rX9f5X3kG0brSoa91xbv9WyyjLWJuqD7'} 2026-02-22T20:48:29.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial061.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 20:44:57.019173', 'locked_by': 'scheduled_nmordech@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAING4Ym5pMX5yVTp2kiGTg9rz8yJzA27+FK7c3rYBQ5Ln'} 2026-02-22T20:48:29.695 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T20:48:29.706 INFO:teuthology.task.internal:roles: ubuntu@trial007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-22T20:48:29.706 INFO:teuthology.task.internal:roles: ubuntu@trial061.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-22T20:48:29.707 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T20:48:29.842 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffbcaff7f60>, signals=[15]) 2026-02-22T20:48:29.842 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T20:48:29.853 INFO:teuthology.task.internal:Opening connections... 2026-02-22T20:48:29.853 DEBUG:teuthology.task.internal:connecting to ubuntu@trial007.front.sepia.ceph.com 2026-02-22T20:48:29.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:48:29.915 DEBUG:teuthology.task.internal:connecting to ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:48:29.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:48:29.979 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T20:48:29.990 DEBUG:teuthology.orchestra.run.trial007:> uname -m 2026-02-22T20:48:29.994 INFO:teuthology.orchestra.run.trial007.stdout:x86_64 2026-02-22T20:48:29.994 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:NAME="Ubuntu" 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="22.04" 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_CODENAME=jammy 2026-02-22T20:48:30.037 INFO:teuthology.orchestra.run.trial007.stdout:ID=ubuntu 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE=debian 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T20:48:30.038 INFO:teuthology.orchestra.run.trial007.stdout:UBUNTU_CODENAME=jammy 2026-02-22T20:48:30.038 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server 2026-02-22T20:48:30.101 DEBUG:teuthology.orchestra.run.trial061:> uname -m 2026-02-22T20:48:30.105 INFO:teuthology.orchestra.run.trial061.stdout:x86_64 2026-02-22T20:48:30.105 DEBUG:teuthology.orchestra.run.trial061:> cat /etc/os-release 2026-02-22T20:48:30.148 INFO:teuthology.orchestra.run.trial061.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:NAME="Ubuntu" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_ID="22.04" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_CODENAME=jammy 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:ID=ubuntu 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:ID_LIKE=debian 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T20:48:30.149 INFO:teuthology.orchestra.run.trial061.stdout:UBUNTU_CODENAME=jammy 2026-02-22T20:48:30.149 INFO:teuthology.lock.ops:Updating trial061.front.sepia.ceph.com on lock server 2026-02-22T20:48:30.217 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T20:48:30.229 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T20:48:30.242 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T20:48:30.242 DEBUG:teuthology.orchestra.run.trial007:> test '!' -e /home/ubuntu/cephtest 2026-02-22T20:48:30.243 DEBUG:teuthology.orchestra.run.trial061:> test '!' -e /home/ubuntu/cephtest 2026-02-22T20:48:30.246 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T20:48:30.257 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T20:48:30.257 DEBUG:teuthology.orchestra.run.trial007:> test -z $(ls -A /var/lib/ceph) 2026-02-22T20:48:30.288 DEBUG:teuthology.orchestra.run.trial061:> test -z $(ls -A /var/lib/ceph) 2026-02-22T20:48:30.290 INFO:teuthology.orchestra.run.trial007.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T20:48:30.298 INFO:teuthology.orchestra.run.trial061.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T20:48:30.298 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T20:48:30.451 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T20:48:30.470 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-22T20:48:30.471 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-22T20:48:30.471 DEBUG:teuthology.orchestra.run.trial007:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T20:48:30.471 DEBUG:teuthology.orchestra.run.trial061:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T20:48:30.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:48:30.474 DEBUG:teuthology.orchestra.run.trial007:> uname -r 2026-02-22T20:48:30.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:48:30.474 DEBUG:teuthology.orchestra.run.trial061:> uname -r 2026-02-22T20:48:30.518 INFO:teuthology.orchestra.run.trial007.stdout:5.15.0-170-generic 2026-02-22T20:48:30.518 INFO:teuthology.task.kernel:Running kernel on trial007: 5.15.0-170-generic 2026-02-22T20:48:30.518 DEBUG:teuthology.orchestra.run.trial007:> sudo apt-get clean 2026-02-22T20:48:30.520 INFO:teuthology.orchestra.run.trial061.stdout:5.15.0-170-generic 2026-02-22T20:48:30.520 INFO:teuthology.task.kernel:Running kernel on trial061: 5.15.0-170-generic 2026-02-22T20:48:30.520 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get clean 2026-02-22T20:48:30.576 DEBUG:teuthology.orchestra.run.trial007:> sudo apt-get update 2026-02-22T20:48:30.579 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get update 2026-02-22T20:48:31.029 INFO:teuthology.orchestra.run.trial061.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T20:48:31.030 INFO:teuthology.orchestra.run.trial007.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T20:48:31.102 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T20:48:31.103 INFO:teuthology.orchestra.run.trial007.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T20:48:31.379 INFO:teuthology.orchestra.run.trial061.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T20:48:31.381 INFO:teuthology.orchestra.run.trial007.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T20:48:31.500 INFO:teuthology.orchestra.run.trial061.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T20:48:31.503 INFO:teuthology.orchestra.run.trial007.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T20:48:31.614 INFO:teuthology.orchestra.run.trial061.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T20:48:31.617 INFO:teuthology.orchestra.run.trial007.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T20:48:31.941 INFO:teuthology.orchestra.run.trial061.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T20:48:31.946 INFO:teuthology.orchestra.run.trial007.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T20:48:31.950 INFO:teuthology.orchestra.run.trial061.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T20:48:31.951 INFO:teuthology.orchestra.run.trial061.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T20:48:31.955 INFO:teuthology.orchestra.run.trial007.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T20:48:31.956 INFO:teuthology.orchestra.run.trial007.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T20:48:31.980 INFO:teuthology.orchestra.run.trial061.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T20:48:31.984 INFO:teuthology.orchestra.run.trial007.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T20:48:31.985 INFO:teuthology.orchestra.run.trial061.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T20:48:31.986 INFO:teuthology.orchestra.run.trial061.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T20:48:31.990 INFO:teuthology.orchestra.run.trial007.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T20:48:31.991 INFO:teuthology.orchestra.run.trial007.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T20:48:32.113 INFO:teuthology.orchestra.run.trial061.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T20:48:32.119 INFO:teuthology.orchestra.run.trial007.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T20:48:32.133 INFO:teuthology.orchestra.run.trial061.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T20:48:32.138 INFO:teuthology.orchestra.run.trial007.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T20:48:32.204 INFO:teuthology.orchestra.run.trial061.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T20:48:32.210 INFO:teuthology.orchestra.run.trial061.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T20:48:32.210 INFO:teuthology.orchestra.run.trial007.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T20:48:32.211 INFO:teuthology.orchestra.run.trial061.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T20:48:32.216 INFO:teuthology.orchestra.run.trial007.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T20:48:32.216 INFO:teuthology.orchestra.run.trial007.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T20:48:32.238 INFO:teuthology.orchestra.run.trial061.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T20:48:32.238 INFO:teuthology.orchestra.run.trial061.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T20:48:32.244 INFO:teuthology.orchestra.run.trial007.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T20:48:32.244 INFO:teuthology.orchestra.run.trial007.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T20:48:32.354 INFO:teuthology.orchestra.run.trial061.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T20:48:32.368 INFO:teuthology.orchestra.run.trial007.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T20:48:35.889 INFO:teuthology.orchestra.run.trial007.stdout:Fetched 22.6 MB in 3s (8512 kB/s) 2026-02-22T20:48:35.943 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 22.6 MB in 3s (8459 kB/s) 2026-02-22T20:48:36.418 INFO:teuthology.orchestra.run.trial007.stdout:Reading package lists... 2026-02-22T20:48:36.432 DEBUG:teuthology.orchestra.run.trial007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T20:48:36.464 INFO:teuthology.orchestra.run.trial007.stdout:Reading package lists... 2026-02-22T20:48:36.478 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T20:48:36.491 DEBUG:teuthology.orchestra.run.trial061:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T20:48:36.523 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T20:48:36.571 INFO:teuthology.orchestra.run.trial007.stdout:Building dependency tree... 2026-02-22T20:48:36.572 INFO:teuthology.orchestra.run.trial007.stdout:Reading state information... 2026-02-22T20:48:36.630 INFO:teuthology.orchestra.run.trial061.stdout:Building dependency tree... 2026-02-22T20:48:36.631 INFO:teuthology.orchestra.run.trial061.stdout:Reading state information... 2026-02-22T20:48:36.656 INFO:teuthology.orchestra.run.trial007.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T20:48:36.656 INFO:teuthology.orchestra.run.trial007.stdout:linux-image-generic set to manually installed. 2026-02-22T20:48:36.657 INFO:teuthology.orchestra.run.trial007.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T20:48:36.657 INFO:teuthology.orchestra.run.trial007.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T20:48:36.657 INFO:teuthology.orchestra.run.trial007.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T20:48:36.657 INFO:teuthology.orchestra.run.trial007.stdout: sg3-utils-udev 2026-02-22T20:48:36.657 INFO:teuthology.orchestra.run.trial007.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T20:48:36.675 INFO:teuthology.orchestra.run.trial007.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T20:48:36.677 DEBUG:teuthology.orchestra.run.trial007:> dpkg -s linux-image-generic 2026-02-22T20:48:36.715 INFO:teuthology.orchestra.run.trial061.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T20:48:36.715 INFO:teuthology.orchestra.run.trial061.stdout:linux-image-generic set to manually installed. 2026-02-22T20:48:36.716 INFO:teuthology.orchestra.run.trial061.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T20:48:36.716 INFO:teuthology.orchestra.run.trial061.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T20:48:36.716 INFO:teuthology.orchestra.run.trial061.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T20:48:36.716 INFO:teuthology.orchestra.run.trial061.stdout: sg3-utils-udev 2026-02-22T20:48:36.716 INFO:teuthology.orchestra.run.trial061.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Package: linux-image-generic 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Status: install ok installed 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Priority: optional 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Section: kernel 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Installed-Size: 21 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Architecture: amd64 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Source: linux-meta 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Version: 5.15.0.170.159 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T20:48:36.727 INFO:teuthology.orchestra.run.trial007.stdout:Recommends: thermald 2026-02-22T20:48:36.728 INFO:teuthology.orchestra.run.trial007.stdout:Description: Generic Linux kernel image 2026-02-22T20:48:36.728 INFO:teuthology.orchestra.run.trial007.stdout: This package will always depend on the latest generic kernel image 2026-02-22T20:48:36.728 INFO:teuthology.orchestra.run.trial007.stdout: available. 2026-02-22T20:48:36.728 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T20:48:36.728 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T20:48:36.728 DEBUG:teuthology.orchestra.run.trial007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T20:48:36.734 INFO:teuthology.orchestra.run.trial061.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T20:48:36.736 DEBUG:teuthology.orchestra.run.trial061:> dpkg -s linux-image-generic 2026-02-22T20:48:36.779 INFO:teuthology.orchestra.run.trial007.stdout:ttyS1 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Package: linux-image-generic 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Status: install ok installed 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Priority: optional 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Section: kernel 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Installed-Size: 21 2026-02-22T20:48:36.787 INFO:teuthology.orchestra.run.trial061.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Architecture: amd64 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Source: linux-meta 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Version: 5.15.0.170.159 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Recommends: thermald 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout:Description: Generic Linux kernel image 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout: This package will always depend on the latest generic kernel image 2026-02-22T20:48:36.788 INFO:teuthology.orchestra.run.trial061.stdout: available. 2026-02-22T20:48:36.789 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T20:48:36.789 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-22T20:48:36.789 DEBUG:teuthology.orchestra.run.trial061:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T20:48:36.804 DEBUG:teuthology.parallel:result is None 2026-02-22T20:48:36.841 INFO:teuthology.orchestra.run.trial061.stdout:ttyS1 2026-02-22T20:48:36.867 DEBUG:teuthology.parallel:result is None 2026-02-22T20:48:36.867 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T20:48:36.879 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T20:48:36.880 DEBUG:teuthology.orchestra.run.trial007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T20:48:36.882 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T20:48:36.913 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T20:48:36.926 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T20:48:36.942 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T20:48:36.942 DEBUG:teuthology.orchestra.run.trial007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T20:48:36.943 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T20:48:36.964 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T20:48:36.975 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T20:48:36.976 DEBUG:teuthology.orchestra.run.trial007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T20:48:36.988 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T20:48:36.995 INFO:teuthology.orchestra.run.trial007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T20:48:37.001 INFO:teuthology.orchestra.run.trial007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T20:48:37.014 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T20:48:37.020 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T20:48:37.022 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T20:48:37.033 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T20:48:37.033 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T20:48:37.052 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T20:48:37.074 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T20:48:37.090 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T20:48:37.090 DEBUG:teuthology.orchestra.run.trial007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T20:48:37.099 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T20:48:37.124 DEBUG:teuthology.orchestra.run.trial007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T20:48:37.146 DEBUG:teuthology.orchestra.run.trial007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T20:48:37.190 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:48:37.190 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T20:48:37.243 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T20:48:37.247 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T20:48:37.293 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:48:37.294 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T20:48:37.347 DEBUG:teuthology.orchestra.run.trial007:> sudo service rsyslog restart 2026-02-22T20:48:37.349 DEBUG:teuthology.orchestra.run.trial061:> sudo service rsyslog restart 2026-02-22T20:48:37.410 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T20:48:37.423 INFO:teuthology.task.internal:Starting timer... 2026-02-22T20:48:37.424 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T20:48:37.438 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T20:48:37.450 DEBUG:teuthology.task.selinux:Excluding trial007: OS 'ubuntu' does not support SELinux 2026-02-22T20:48:37.450 DEBUG:teuthology.task.selinux:Excluding trial061: OS 'ubuntu' does not support SELinux 2026-02-22T20:48:37.450 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T20:48:37.450 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-22T20:48:37.450 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T20:48:37.450 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T20:48:37.463 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T20:48:37.476 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T20:48:37.477 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial007.front.sepia.ceph.com,trial061.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T20:51:06.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial007.front.sepia.ceph.com'), Remote(name='ubuntu@trial061.front.sepia.ceph.com')] 2026-02-22T20:51:06.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial007.front.sepia.ceph.com' 2026-02-22T20:51:06.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:51:06.750 DEBUG:teuthology.orchestra.run.trial007:> true 2026-02-22T20:51:07.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial007.front.sepia.ceph.com' 2026-02-22T20:51:07.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-22T20:51:07.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:51:07.112 DEBUG:teuthology.orchestra.run.trial061:> true 2026-02-22T20:51:07.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-22T20:51:07.358 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T20:51:07.380 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T20:51:07.380 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T20:51:07.381 DEBUG:teuthology.orchestra.run.trial007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T20:51:07.383 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T20:51:07.384 DEBUG:teuthology.orchestra.run.trial061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Command line: ntpd -gq 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: ---------------------------------------------------- 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: corporation. Support and training for ntp-4 are 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: available at https://www.nwtime.org/support 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: ---------------------------------------------------- 2026-02-22T20:51:07.401 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: proto: precision = 0.030 usec (-25) 2026-02-22T20:51:07.402 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: basedate set to 2022-02-04 2026-02-22T20:51:07.402 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: gps base set to 2022-02-06 (week 2196) 2026-02-22T20:51:07.402 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T20:51:07.402 INFO:teuthology.orchestra.run.trial007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T20:51:07.402 INFO:teuthology.orchestra.run.trial007.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T20:51:07.403 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T20:51:07.403 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T20:51:07.403 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T20:51:07.404 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T20:51:07.404 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen normally on 3 enp1s0f0 10.20.193.7:123 2026-02-22T20:51:07.404 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen normally on 4 lo [::1]:123 2026-02-22T20:51:07.404 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5e8a%2]:123 2026-02-22T20:51:07.404 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:07 ntpd[9328]: Listening on routing socket on fd #22 for interface updates 2026-02-22T20:51:07.424 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T20:51:07.424 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Command line: ntpd -gq 2026-02-22T20:51:07.424 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: ---------------------------------------------------- 2026-02-22T20:51:07.424 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T20:51:07.424 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: corporation. Support and training for ntp-4 are 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: available at https://www.nwtime.org/support 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: ---------------------------------------------------- 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: proto: precision = 0.020 usec (-25) 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: basedate set to 2022-02-04 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: gps base set to 2022-02-06 (week 2196) 2026-02-22T20:51:07.425 INFO:teuthology.orchestra.run.trial061.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T20:51:07.426 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T20:51:07.426 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T20:51:07.426 INFO:teuthology.orchestra.run.trial061.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T20:51:07.427 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T20:51:07.427 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T20:51:07.427 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T20:51:07.427 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen normally on 3 enp1s0f0 10.20.193.61:123 2026-02-22T20:51:07.428 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen normally on 4 lo [::1]:123 2026-02-22T20:51:07.428 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6268%2]:123 2026-02-22T20:51:07.428 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:07 ntpd[9422]: Listening on routing socket on fd #22 for interface updates 2026-02-22T20:51:08.424 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:08.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:08.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:08.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:08.465 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:08.465 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:08.466 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:08.466 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:08.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:08.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:08.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:08.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:08 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:10.424 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:10.424 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:10.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:10.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:10.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:10.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:10.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:10.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:10.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:10.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:10.495 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:10.495 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:10.495 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:10.495 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:10 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:11.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:11.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:11.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:11.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:11.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:11.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:11.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:11.431 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:11.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:11.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:11.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:11.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:11 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:12.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.424 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:12.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:12 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:12.446 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.447 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.447 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:12.447 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:12.466 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.466 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.466 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:12.467 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:12.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:12.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:12.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:12.498 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:12 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:13.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:13.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:13.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:13.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:13.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:13.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:13.431 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:13.431 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:13.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:13.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:13.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:13.441 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:13 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:14.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.424 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.425 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:14.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:14 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:14.446 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.446 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.446 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:14.446 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:14.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:14.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:14.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:14.462 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:14.463 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 20:51:14 ntpd[9422]: ntpd: time set -0.380530 s 2026-02-22T20:51:14.463 INFO:teuthology.orchestra.run.trial061.stdout:ntpd: time set -0.380530s 2026-02-22T20:51:14.463 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T20:51:14.464 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 20:51:14 ntpd[9422]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout:============================================================================== 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout: 173.249.203.227 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout: 108.61.215.221 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:14.838 INFO:teuthology.orchestra.run.trial061.stdout: 99-28-14-242.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:15.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:15.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:15.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:15.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:15.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:15.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:15.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:15.431 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:15.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:15.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:15.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:15.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:15 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:16.400 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:16.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:16.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:16.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:16.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:16.442 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:16 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:17.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:17.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:17.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:17.401 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:17.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T20:51:17.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T20:51:17.430 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T20:51:17.431 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T20:51:17.431 INFO:teuthology.orchestra.run.trial007.stdout:22 Feb 20:51:17 ntpd[9328]: ntpd: time set -0.099755 s 2026-02-22T20:51:17.431 INFO:teuthology.orchestra.run.trial007.stdout:ntpd: time set -0.099755s 2026-02-22T20:51:17.432 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T20:51:17.432 INFO:teuthology.orchestra.run.trial007.stderr:22 Feb 20:51:17 ntpd[9328]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T20:51:19.221 INFO:teuthology.orchestra.run.trial007.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T20:51:19.221 INFO:teuthology.orchestra.run.trial007.stdout:============================================================================== 2026-02-22T20:51:19.221 INFO:teuthology.orchestra.run.trial007.stdout: baron.cgee.net .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:19.221 INFO:teuthology.orchestra.run.trial007.stdout: 23.186.168.133 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:19.222 INFO:teuthology.orchestra.run.trial007.stdout: as393746.mci.tr .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:19.222 INFO:teuthology.orchestra.run.trial007.stdout: tock.srs1.ntfo. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T20:51:19.222 INFO:teuthology.run_tasks:Running task install... 2026-02-22T20:51:19.233 DEBUG:teuthology.task.install:project ceph 2026-02-22T20:51:19.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e'}} 2026-02-22T20:51:19.233 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e'} 2026-02-22T20:51:19.233 INFO:teuthology.task.install:Using flavor: default 2026-02-22T20:51:19.235 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T20:51:19.235 INFO:teuthology.task.install:extra packages: [] 2026-02-22T20:51:19.236 DEBUG:teuthology.orchestra.run.trial007:> sudo apt-key list | grep Ceph 2026-02-22T20:51:19.236 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-key list | grep Ceph 2026-02-22T20:51:19.291 INFO:teuthology.orchestra.run.trial061.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T20:51:19.305 INFO:teuthology.orchestra.run.trial007.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T20:51:19.321 INFO:teuthology.orchestra.run.trial061.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T20:51:19.321 INFO:teuthology.orchestra.run.trial061.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T20:51:19.321 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T20:51:19.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a5c3084f688b1f6eff223b8d259a8316f9844c8e 2026-02-22T20:51:19.335 INFO:teuthology.orchestra.run.trial007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T20:51:19.335 INFO:teuthology.orchestra.run.trial007.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T20:51:19.336 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T20:51:19.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a5c3084f688b1f6eff223b8d259a8316f9844c8e 2026-02-22T20:51:19.476 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default/ 2026-02-22T20:51:19.476 INFO:teuthology.task.install.deb:Package version is 20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:19.491 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default/ 2026-02-22T20:51:19.491 INFO:teuthology.task.install.deb:Package version is 20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:19.626 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:19.626 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T20:51:19.635 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:19.635 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T20:51:19.636 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get update 2026-02-22T20:51:19.646 DEBUG:teuthology.orchestra.run.trial007:> sudo apt-get update 2026-02-22T20:51:19.790 INFO:teuthology.orchestra.run.trial007.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T20:51:19.791 INFO:teuthology.orchestra.run.trial061.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T20:51:19.802 INFO:teuthology.orchestra.run.trial007.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-22T20:51:19.803 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-22T20:51:19.813 INFO:teuthology.orchestra.run.trial007.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T20:51:19.815 INFO:teuthology.orchestra.run.trial061.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T20:51:19.821 INFO:teuthology.orchestra.run.trial061.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T20:51:19.825 INFO:teuthology.orchestra.run.trial007.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.9 kB] 2026-02-22T20:51:19.826 INFO:teuthology.orchestra.run.trial061.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T20:51:19.827 INFO:teuthology.orchestra.run.trial061.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.9 kB] 2026-02-22T20:51:19.835 INFO:teuthology.orchestra.run.trial061.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T20:51:19.845 INFO:teuthology.orchestra.run.trial061.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T20:51:20.143 INFO:teuthology.orchestra.run.trial007.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T20:51:20.158 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 26.5 kB in 0s (73.5 kB/s) 2026-02-22T20:51:20.226 INFO:teuthology.orchestra.run.trial007.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T20:51:20.314 INFO:teuthology.orchestra.run.trial007.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T20:51:20.402 INFO:teuthology.orchestra.run.trial007.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T20:51:20.545 INFO:teuthology.orchestra.run.trial007.stdout:Fetched 26.5 kB in 1s (35.9 kB/s) 2026-02-22T20:51:20.684 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T20:51:20.698 DEBUG:teuthology.orchestra.run.trial061:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-794-ga5c3084f-1jammy cephadm=20.2.0-794-ga5c3084f-1jammy ceph-mds=20.2.0-794-ga5c3084f-1jammy ceph-mgr=20.2.0-794-ga5c3084f-1jammy ceph-common=20.2.0-794-ga5c3084f-1jammy ceph-fuse=20.2.0-794-ga5c3084f-1jammy ceph-test=20.2.0-794-ga5c3084f-1jammy ceph-volume=20.2.0-794-ga5c3084f-1jammy radosgw=20.2.0-794-ga5c3084f-1jammy python3-rados=20.2.0-794-ga5c3084f-1jammy python3-rgw=20.2.0-794-ga5c3084f-1jammy python3-cephfs=20.2.0-794-ga5c3084f-1jammy python3-rbd=20.2.0-794-ga5c3084f-1jammy libcephfs2=20.2.0-794-ga5c3084f-1jammy libcephfs-dev=20.2.0-794-ga5c3084f-1jammy librados2=20.2.0-794-ga5c3084f-1jammy librbd1=20.2.0-794-ga5c3084f-1jammy rbd-fuse=20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:20.732 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T20:51:20.843 INFO:teuthology.orchestra.run.trial061.stdout:Building dependency tree... 2026-02-22T20:51:20.844 INFO:teuthology.orchestra.run.trial061.stdout:Reading state information... 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: sg3-utils-udev 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout:The following additional packages will be installed: 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T20:51:20.936 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-22T20:51:20.937 INFO:teuthology.orchestra.run.trial061.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout: socat xmlstarlet 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout:Suggested packages: 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout:Recommended packages: 2026-02-22T20:51:20.938 INFO:teuthology.orchestra.run.trial061.stdout: btrfs-tools 2026-02-22T20:51:20.969 INFO:teuthology.orchestra.run.trial061.stdout:The following NEW packages will be installed: 2026-02-22T20:51:20.969 INFO:teuthology.orchestra.run.trial061.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T20:51:20.969 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T20:51:20.969 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T20:51:20.969 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-22T20:51:20.970 INFO:teuthology.orchestra.run.trial061.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-22T20:51:20.970 INFO:teuthology.orchestra.run.trial061.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-22T20:51:20.970 INFO:teuthology.orchestra.run.trial061.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-22T20:51:20.971 INFO:teuthology.orchestra.run.trial061.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-22T20:51:20.972 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-22T20:51:20.972 INFO:teuthology.orchestra.run.trial061.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-22T20:51:20.972 INFO:teuthology.orchestra.run.trial061.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-22T20:51:20.972 INFO:teuthology.orchestra.run.trial061.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-22T20:51:20.972 INFO:teuthology.orchestra.run.trial061.stdout: socat xmlstarlet 2026-02-22T20:51:21.050 INFO:teuthology.orchestra.run.trial061.stdout:0 upgraded, 86 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T20:51:21.050 INFO:teuthology.orchestra.run.trial061.stdout:Need to get 280 MB of archives. 2026-02-22T20:51:21.050 INFO:teuthology.orchestra.run.trial061.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-22T20:51:21.050 INFO:teuthology.orchestra.run.trial061.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-794-ga5c3084f-1jammy [3569 kB] 2026-02-22T20:51:21.062 INFO:teuthology.orchestra.run.trial007.stdout:Reading package lists... 2026-02-22T20:51:21.076 DEBUG:teuthology.orchestra.run.trial007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-794-ga5c3084f-1jammy cephadm=20.2.0-794-ga5c3084f-1jammy ceph-mds=20.2.0-794-ga5c3084f-1jammy ceph-mgr=20.2.0-794-ga5c3084f-1jammy ceph-common=20.2.0-794-ga5c3084f-1jammy ceph-fuse=20.2.0-794-ga5c3084f-1jammy ceph-test=20.2.0-794-ga5c3084f-1jammy ceph-volume=20.2.0-794-ga5c3084f-1jammy radosgw=20.2.0-794-ga5c3084f-1jammy python3-rados=20.2.0-794-ga5c3084f-1jammy python3-rgw=20.2.0-794-ga5c3084f-1jammy python3-cephfs=20.2.0-794-ga5c3084f-1jammy python3-rbd=20.2.0-794-ga5c3084f-1jammy libcephfs2=20.2.0-794-ga5c3084f-1jammy libcephfs-dev=20.2.0-794-ga5c3084f-1jammy librados2=20.2.0-794-ga5c3084f-1jammy librbd1=20.2.0-794-ga5c3084f-1jammy rbd-fuse=20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:21.109 INFO:teuthology.orchestra.run.trial007.stdout:Reading package lists... 2026-02-22T20:51:21.154 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-794-ga5c3084f-1jammy [2867 kB] 2026-02-22T20:51:21.193 INFO:teuthology.orchestra.run.trial061.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-794-ga5c3084f-1jammy [833 kB] 2026-02-22T20:51:21.206 INFO:teuthology.orchestra.run.trial061.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-794-ga5c3084f-1jammy [364 kB] 2026-02-22T20:51:21.212 INFO:teuthology.orchestra.run.trial061.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-794-ga5c3084f-1jammy [32.8 kB] 2026-02-22T20:51:21.213 INFO:teuthology.orchestra.run.trial061.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-794-ga5c3084f-1jammy [184 kB] 2026-02-22T20:51:21.216 INFO:teuthology.orchestra.run.trial061.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-794-ga5c3084f-1jammy [87.0 kB] 2026-02-22T20:51:21.217 INFO:teuthology.orchestra.run.trial061.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-794-ga5c3084f-1jammy [341 kB] 2026-02-22T20:51:21.218 INFO:teuthology.orchestra.run.trial007.stdout:Building dependency tree... 2026-02-22T20:51:21.218 INFO:teuthology.orchestra.run.trial007.stdout:Reading state information... 2026-02-22T20:51:21.222 INFO:teuthology.orchestra.run.trial061.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-794-ga5c3084f-1jammy [8698 kB] 2026-02-22T20:51:21.306 INFO:teuthology.orchestra.run.trial007.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T20:51:21.306 INFO:teuthology.orchestra.run.trial007.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T20:51:21.306 INFO:teuthology.orchestra.run.trial007.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T20:51:21.306 INFO:teuthology.orchestra.run.trial007.stdout: sg3-utils-udev 2026-02-22T20:51:21.306 INFO:teuthology.orchestra.run.trial007.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout:The following additional packages will be installed: 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-22T20:51:21.307 INFO:teuthology.orchestra.run.trial007.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: socat xmlstarlet 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout:Suggested packages: 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-22T20:51:21.308 INFO:teuthology.orchestra.run.trial007.stdout:Recommended packages: 2026-02-22T20:51:21.309 INFO:teuthology.orchestra.run.trial007.stdout: btrfs-tools 2026-02-22T20:51:21.324 INFO:teuthology.orchestra.run.trial061.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T20:51:21.341 INFO:teuthology.orchestra.run.trial007.stdout:The following NEW packages will be installed: 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T20:51:21.342 INFO:teuthology.orchestra.run.trial007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-22T20:51:21.343 INFO:teuthology.orchestra.run.trial007.stdout: socat xmlstarlet 2026-02-22T20:51:21.366 INFO:teuthology.orchestra.run.trial061.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-794-ga5c3084f-1jammy [112 kB] 2026-02-22T20:51:21.366 INFO:teuthology.orchestra.run.trial061.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-794-ga5c3084f-1jammy [261 kB] 2026-02-22T20:51:21.371 INFO:teuthology.orchestra.run.trial061.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-794-ga5c3084f-1jammy [29.3 MB] 2026-02-22T20:51:21.616 INFO:teuthology.orchestra.run.trial007.stdout:0 upgraded, 86 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T20:51:21.616 INFO:teuthology.orchestra.run.trial007.stdout:Need to get 280 MB of archives. 2026-02-22T20:51:21.616 INFO:teuthology.orchestra.run.trial007.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-22T20:51:21.616 INFO:teuthology.orchestra.run.trial007.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-794-ga5c3084f-1jammy [3569 kB] 2026-02-22T20:51:21.660 INFO:teuthology.orchestra.run.trial061.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T20:51:21.671 INFO:teuthology.orchestra.run.trial061.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T20:51:21.693 INFO:teuthology.orchestra.run.trial007.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T20:51:21.741 INFO:teuthology.orchestra.run.trial061.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T20:51:21.870 INFO:teuthology.orchestra.run.trial061.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-794-ga5c3084f-1jammy [5416 kB] 2026-02-22T20:51:21.942 INFO:teuthology.orchestra.run.trial061.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T20:51:21.951 INFO:teuthology.orchestra.run.trial061.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T20:51:21.978 INFO:teuthology.orchestra.run.trial061.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T20:51:21.985 INFO:teuthology.orchestra.run.trial061.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-794-ga5c3084f-1jammy [250 kB] 2026-02-22T20:51:21.986 INFO:teuthology.orchestra.run.trial061.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T20:51:21.989 INFO:teuthology.orchestra.run.trial061.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T20:51:21.989 INFO:teuthology.orchestra.run.trial061.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-794-ga5c3084f-1jammy [124 kB] 2026-02-22T20:51:21.989 INFO:teuthology.orchestra.run.trial061.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T20:51:21.990 INFO:teuthology.orchestra.run.trial061.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T20:51:21.991 INFO:teuthology.orchestra.run.trial061.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-794-ga5c3084f-1jammy [910 kB] 2026-02-22T20:51:22.007 INFO:teuthology.orchestra.run.trial061.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T20:51:22.008 INFO:teuthology.orchestra.run.trial061.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T20:51:22.013 INFO:teuthology.orchestra.run.trial061.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T20:51:22.019 INFO:teuthology.orchestra.run.trial061.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-794-ga5c3084f-1jammy [6401 kB] 2026-02-22T20:51:22.029 INFO:teuthology.orchestra.run.trial007.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T20:51:22.041 INFO:teuthology.orchestra.run.trial007.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T20:51:22.068 INFO:teuthology.orchestra.run.trial007.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-794-ga5c3084f-1jammy [2867 kB] 2026-02-22T20:51:22.080 INFO:teuthology.orchestra.run.trial061.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T20:51:22.080 INFO:teuthology.orchestra.run.trial061.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T20:51:22.081 INFO:teuthology.orchestra.run.trial061.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T20:51:22.081 INFO:teuthology.orchestra.run.trial061.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T20:51:22.081 INFO:teuthology.orchestra.run.trial061.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T20:51:22.081 INFO:teuthology.orchestra.run.trial061.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T20:51:22.082 INFO:teuthology.orchestra.run.trial061.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T20:51:22.085 INFO:teuthology.orchestra.run.trial061.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T20:51:22.086 INFO:teuthology.orchestra.run.trial061.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T20:51:22.110 INFO:teuthology.orchestra.run.trial007.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T20:51:22.155 INFO:teuthology.orchestra.run.trial061.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T20:51:22.157 INFO:teuthology.orchestra.run.trial061.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T20:51:22.157 INFO:teuthology.orchestra.run.trial061.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T20:51:22.158 INFO:teuthology.orchestra.run.trial061.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T20:51:22.161 INFO:teuthology.orchestra.run.trial061.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-794-ga5c3084f-1jammy [21.7 MB] 2026-02-22T20:51:22.183 INFO:teuthology.orchestra.run.trial061.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T20:51:22.185 INFO:teuthology.orchestra.run.trial061.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T20:51:22.185 INFO:teuthology.orchestra.run.trial061.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T20:51:22.213 INFO:teuthology.orchestra.run.trial007.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-794-ga5c3084f-1jammy [833 kB] 2026-02-22T20:51:22.243 INFO:teuthology.orchestra.run.trial061.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T20:51:22.243 INFO:teuthology.orchestra.run.trial061.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T20:51:22.243 INFO:teuthology.orchestra.run.trial061.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T20:51:22.244 INFO:teuthology.orchestra.run.trial061.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T20:51:22.244 INFO:teuthology.orchestra.run.trial061.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T20:51:22.275 INFO:teuthology.orchestra.run.trial007.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-794-ga5c3084f-1jammy [364 kB] 2026-02-22T20:51:22.281 INFO:teuthology.orchestra.run.trial007.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-794-ga5c3084f-1jammy [32.8 kB] 2026-02-22T20:51:22.281 INFO:teuthology.orchestra.run.trial007.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-794-ga5c3084f-1jammy [184 kB] 2026-02-22T20:51:22.284 INFO:teuthology.orchestra.run.trial007.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-794-ga5c3084f-1jammy [87.0 kB] 2026-02-22T20:51:22.286 INFO:teuthology.orchestra.run.trial007.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-794-ga5c3084f-1jammy [341 kB] 2026-02-22T20:51:22.302 INFO:teuthology.orchestra.run.trial007.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-794-ga5c3084f-1jammy [8698 kB] 2026-02-22T20:51:22.302 INFO:teuthology.orchestra.run.trial061.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T20:51:22.305 INFO:teuthology.orchestra.run.trial061.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T20:51:22.306 INFO:teuthology.orchestra.run.trial061.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T20:51:22.307 INFO:teuthology.orchestra.run.trial061.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T20:51:22.312 INFO:teuthology.orchestra.run.trial007.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T20:51:22.322 INFO:teuthology.orchestra.run.trial007.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T20:51:22.349 INFO:teuthology.orchestra.run.trial007.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T20:51:22.357 INFO:teuthology.orchestra.run.trial007.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T20:51:22.359 INFO:teuthology.orchestra.run.trial007.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T20:51:22.360 INFO:teuthology.orchestra.run.trial007.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T20:51:22.361 INFO:teuthology.orchestra.run.trial007.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T20:51:22.373 INFO:teuthology.orchestra.run.trial061.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T20:51:22.376 INFO:teuthology.orchestra.run.trial061.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T20:51:22.377 INFO:teuthology.orchestra.run.trial007.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T20:51:22.378 INFO:teuthology.orchestra.run.trial007.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T20:51:22.379 INFO:teuthology.orchestra.run.trial061.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T20:51:22.382 INFO:teuthology.orchestra.run.trial061.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T20:51:22.385 INFO:teuthology.orchestra.run.trial061.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T20:51:22.385 INFO:teuthology.orchestra.run.trial007.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T20:51:22.385 INFO:teuthology.orchestra.run.trial061.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T20:51:22.446 INFO:teuthology.orchestra.run.trial061.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T20:51:22.447 INFO:teuthology.orchestra.run.trial061.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T20:51:22.447 INFO:teuthology.orchestra.run.trial061.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T20:51:22.451 INFO:teuthology.orchestra.run.trial007.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T20:51:22.451 INFO:teuthology.orchestra.run.trial007.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T20:51:22.452 INFO:teuthology.orchestra.run.trial007.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T20:51:22.452 INFO:teuthology.orchestra.run.trial007.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T20:51:22.452 INFO:teuthology.orchestra.run.trial007.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T20:51:22.453 INFO:teuthology.orchestra.run.trial007.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T20:51:22.453 INFO:teuthology.orchestra.run.trial007.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T20:51:22.453 INFO:teuthology.orchestra.run.trial061.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T20:51:22.457 INFO:teuthology.orchestra.run.trial007.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T20:51:22.457 INFO:teuthology.orchestra.run.trial007.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T20:51:22.517 INFO:teuthology.orchestra.run.trial061.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T20:51:22.519 INFO:teuthology.orchestra.run.trial061.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T20:51:22.519 INFO:teuthology.orchestra.run.trial061.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T20:51:22.520 INFO:teuthology.orchestra.run.trial061.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T20:51:22.527 INFO:teuthology.orchestra.run.trial007.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T20:51:22.529 INFO:teuthology.orchestra.run.trial007.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T20:51:22.530 INFO:teuthology.orchestra.run.trial007.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T20:51:22.530 INFO:teuthology.orchestra.run.trial007.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T20:51:22.555 INFO:teuthology.orchestra.run.trial007.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T20:51:22.558 INFO:teuthology.orchestra.run.trial007.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T20:51:22.558 INFO:teuthology.orchestra.run.trial007.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T20:51:22.615 INFO:teuthology.orchestra.run.trial007.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T20:51:22.616 INFO:teuthology.orchestra.run.trial007.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T20:51:22.616 INFO:teuthology.orchestra.run.trial007.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T20:51:22.617 INFO:teuthology.orchestra.run.trial007.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T20:51:22.617 INFO:teuthology.orchestra.run.trial007.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T20:51:22.617 INFO:teuthology.orchestra.run.trial007.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T20:51:22.625 INFO:teuthology.orchestra.run.trial007.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-794-ga5c3084f-1jammy [112 kB] 2026-02-22T20:51:22.625 INFO:teuthology.orchestra.run.trial007.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-794-ga5c3084f-1jammy [261 kB] 2026-02-22T20:51:22.653 INFO:teuthology.orchestra.run.trial007.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-794-ga5c3084f-1jammy [29.3 MB] 2026-02-22T20:51:22.675 INFO:teuthology.orchestra.run.trial007.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T20:51:22.676 INFO:teuthology.orchestra.run.trial007.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T20:51:22.677 INFO:teuthology.orchestra.run.trial007.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T20:51:22.746 INFO:teuthology.orchestra.run.trial061.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-794-ga5c3084f-1jammy [14.1 kB] 2026-02-22T20:51:22.746 INFO:teuthology.orchestra.run.trial061.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-794-ga5c3084f-1jammy [957 kB] 2026-02-22T20:51:22.747 INFO:teuthology.orchestra.run.trial007.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T20:51:22.750 INFO:teuthology.orchestra.run.trial007.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T20:51:22.752 INFO:teuthology.orchestra.run.trial007.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T20:51:22.756 INFO:teuthology.orchestra.run.trial007.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T20:51:22.759 INFO:teuthology.orchestra.run.trial007.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T20:51:22.759 INFO:teuthology.orchestra.run.trial007.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T20:51:22.759 INFO:teuthology.orchestra.run.trial007.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T20:51:22.780 INFO:teuthology.orchestra.run.trial061.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-794-ga5c3084f-1jammy [2344 kB] 2026-02-22T20:51:22.820 INFO:teuthology.orchestra.run.trial007.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T20:51:22.820 INFO:teuthology.orchestra.run.trial007.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T20:51:22.826 INFO:teuthology.orchestra.run.trial007.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T20:51:22.892 INFO:teuthology.orchestra.run.trial007.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T20:51:22.894 INFO:teuthology.orchestra.run.trial007.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T20:51:22.894 INFO:teuthology.orchestra.run.trial007.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T20:51:22.895 INFO:teuthology.orchestra.run.trial007.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T20:51:22.921 INFO:teuthology.orchestra.run.trial061.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-794-ga5c3084f-1jammy [1057 kB] 2026-02-22T20:51:22.935 INFO:teuthology.orchestra.run.trial061.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-794-ga5c3084f-1jammy [185 kB] 2026-02-22T20:51:22.936 INFO:teuthology.orchestra.run.trial061.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-794-ga5c3084f-1jammy [45.5 MB] 2026-02-22T20:51:23.686 INFO:teuthology.orchestra.run.trial007.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-794-ga5c3084f-1jammy [5416 kB] 2026-02-22T20:51:23.887 INFO:teuthology.orchestra.run.trial007.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-794-ga5c3084f-1jammy [250 kB] 2026-02-22T20:51:23.890 INFO:teuthology.orchestra.run.trial007.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-794-ga5c3084f-1jammy [124 kB] 2026-02-22T20:51:23.892 INFO:teuthology.orchestra.run.trial007.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-794-ga5c3084f-1jammy [910 kB] 2026-02-22T20:51:23.907 INFO:teuthology.orchestra.run.trial007.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-794-ga5c3084f-1jammy [6401 kB] 2026-02-22T20:51:24.130 INFO:teuthology.orchestra.run.trial007.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-794-ga5c3084f-1jammy [21.7 MB] 2026-02-22T20:51:24.298 INFO:teuthology.orchestra.run.trial061.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-794-ga5c3084f-1jammy [8626 kB] 2026-02-22T20:51:24.550 INFO:teuthology.orchestra.run.trial061.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-794-ga5c3084f-1jammy [14.2 kB] 2026-02-22T20:51:24.550 INFO:teuthology.orchestra.run.trial061.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-794-ga5c3084f-1jammy [99.5 MB] 2026-02-22T20:51:24.903 INFO:teuthology.orchestra.run.trial007.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-794-ga5c3084f-1jammy [14.1 kB] 2026-02-22T20:51:24.903 INFO:teuthology.orchestra.run.trial007.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-794-ga5c3084f-1jammy [957 kB] 2026-02-22T20:51:24.922 INFO:teuthology.orchestra.run.trial007.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-794-ga5c3084f-1jammy [2344 kB] 2026-02-22T20:51:24.991 INFO:teuthology.orchestra.run.trial007.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-794-ga5c3084f-1jammy [1057 kB] 2026-02-22T20:51:25.039 INFO:teuthology.orchestra.run.trial007.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-794-ga5c3084f-1jammy [185 kB] 2026-02-22T20:51:25.042 INFO:teuthology.orchestra.run.trial007.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-794-ga5c3084f-1jammy [45.5 MB] 2026-02-22T20:51:26.583 INFO:teuthology.orchestra.run.trial007.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-794-ga5c3084f-1jammy [8626 kB] 2026-02-22T20:51:26.880 INFO:teuthology.orchestra.run.trial007.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-794-ga5c3084f-1jammy [14.2 kB] 2026-02-22T20:51:26.881 INFO:teuthology.orchestra.run.trial007.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-794-ga5c3084f-1jammy [99.5 MB] 2026-02-22T20:51:27.724 INFO:teuthology.orchestra.run.trial061.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-794-ga5c3084f-1jammy [136 kB] 2026-02-22T20:51:27.737 INFO:teuthology.orchestra.run.trial061.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-794-ga5c3084f-1jammy [43.3 kB] 2026-02-22T20:51:27.739 INFO:teuthology.orchestra.run.trial061.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-794-ga5c3084f-1jammy [30.7 kB] 2026-02-22T20:51:27.740 INFO:teuthology.orchestra.run.trial061.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-794-ga5c3084f-1jammy [41.5 kB] 2026-02-22T20:51:27.741 INFO:teuthology.orchestra.run.trial061.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-794-ga5c3084f-1jammy [25.1 MB] 2026-02-22T20:51:28.545 INFO:teuthology.orchestra.run.trial061.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-794-ga5c3084f-1jammy [97.5 kB] 2026-02-22T20:51:28.823 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 280 MB in 8s (37.0 MB/s) 2026-02-22T20:51:28.840 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T20:51:29.000 INFO:teuthology.orchestra.run.trial061.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T20:51:29.001 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T20:51:29.003 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T20:51:29.025 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T20:51:29.037 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T20:51:29.038 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T20:51:29.056 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T20:51:29.063 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T20:51:29.064 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T20:51:29.082 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T20:51:29.091 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:29.096 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:29.128 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T20:51:29.135 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:29.136 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:29.153 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T20:51:29.161 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:29.161 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:29.181 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T20:51:29.189 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T20:51:29.190 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T20:51:29.207 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librados2. 2026-02-22T20:51:29.215 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../07-librados2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.215 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librados2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.256 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libnbd0. 2026-02-22T20:51:29.264 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T20:51:29.265 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T20:51:29.280 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librbd1. 2026-02-22T20:51:29.288 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../09-librbd1_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.289 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librbd1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.327 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T20:51:29.335 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.335 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.355 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rados. 2026-02-22T20:51:29.363 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../11-python3-rados_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.363 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rados (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.381 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T20:51:29.390 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:29.390 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-ceph-argparse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.391 INFO:teuthology.orchestra.run.trial007.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-794-ga5c3084f-1jammy [136 kB] 2026-02-22T20:51:29.391 INFO:teuthology.orchestra.run.trial007.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-794-ga5c3084f-1jammy [43.3 kB] 2026-02-22T20:51:29.392 INFO:teuthology.orchestra.run.trial007.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-794-ga5c3084f-1jammy [30.7 kB] 2026-02-22T20:51:29.392 INFO:teuthology.orchestra.run.trial007.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-794-ga5c3084f-1jammy [41.5 kB] 2026-02-22T20:51:29.393 INFO:teuthology.orchestra.run.trial007.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-794-ga5c3084f-1jammy [25.1 MB] 2026-02-22T20:51:29.404 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T20:51:29.412 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.413 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cephfs (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.429 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T20:51:29.437 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:29.437 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.455 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T20:51:29.462 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T20:51:29.463 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T20:51:29.479 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T20:51:29.487 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T20:51:29.488 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T20:51:29.503 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T20:51:29.511 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.512 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rbd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.529 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T20:51:29.538 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T20:51:29.538 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T20:51:29.555 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librgw2. 2026-02-22T20:51:29.563 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../19-librgw2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.563 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librgw2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.660 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T20:51:29.668 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.669 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.683 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T20:51:29.691 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T20:51:29.691 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T20:51:29.706 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T20:51:29.714 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.714 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libradosstriper1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.731 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-common. 2026-02-22T20:51:29.739 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../23-ceph-common_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:29.739 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:29.768 INFO:teuthology.orchestra.run.trial007.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle/a5c3084f688b1f6eff223b8d259a8316f9844c8e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-794-ga5c3084f-1jammy [97.5 kB] 2026-02-22T20:51:30.049 INFO:teuthology.orchestra.run.trial007.stdout:Fetched 280 MB in 8s (33.2 MB/s) 2026-02-22T20:51:30.054 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-base. 2026-02-22T20:51:30.063 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../24-ceph-base_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.068 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-base (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.070 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T20:51:30.132 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T20:51:30.140 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T20:51:30.140 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T20:51:30.155 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T20:51:30.164 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T20:51:30.164 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T20:51:30.181 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T20:51:30.189 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T20:51:30.189 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T20:51:30.204 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T20:51:30.213 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T20:51:30.213 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T20:51:30.228 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T20:51:30.232 INFO:teuthology.orchestra.run.trial007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T20:51:30.234 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T20:51:30.235 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T20:51:30.236 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T20:51:30.236 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T20:51:30.251 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T20:51:30.256 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T20:51:30.259 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T20:51:30.260 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T20:51:30.268 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T20:51:30.269 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T20:51:30.275 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-portend. 2026-02-22T20:51:30.283 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-22T20:51:30.283 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T20:51:30.288 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T20:51:30.298 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T20:51:30.299 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T20:51:30.299 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T20:51:30.306 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T20:51:30.306 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T20:51:30.320 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T20:51:30.320 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T20:51:30.328 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:30.328 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T20:51:30.329 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T20:51:30.333 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:30.352 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T20:51:30.361 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T20:51:30.361 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T20:51:30.365 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T20:51:30.373 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:30.374 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:30.377 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T20:51:30.385 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:30.385 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-modules-core (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.391 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T20:51:30.399 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T20:51:30.399 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:30.414 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T20:51:30.419 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T20:51:30.422 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.422 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.427 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T20:51:30.428 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T20:51:30.438 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T20:51:30.444 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package librados2. 2026-02-22T20:51:30.446 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.447 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.452 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../07-librados2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.452 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking librados2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.468 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T20:51:30.476 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.477 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.492 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libnbd0. 2026-02-22T20:51:30.500 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T20:51:30.500 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T20:51:30.516 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package librbd1. 2026-02-22T20:51:30.524 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../09-librbd1_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.524 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking librbd1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.534 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T20:51:30.543 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T20:51:30.543 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T20:51:30.560 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T20:51:30.564 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T20:51:30.568 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.568 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-osd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.571 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.572 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libcephfs2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.592 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-rados. 2026-02-22T20:51:30.600 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../11-python3-rados_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.600 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-rados (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.618 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T20:51:30.626 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:30.626 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-ceph-argparse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.640 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T20:51:30.648 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.649 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-cephfs (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.665 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T20:51:30.673 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:30.673 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.692 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T20:51:30.700 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T20:51:30.700 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T20:51:30.712 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph. 2026-02-22T20:51:30.716 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T20:51:30.721 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../41-ceph_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.721 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.724 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T20:51:30.725 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T20:51:30.736 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T20:51:30.740 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T20:51:30.744 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.745 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.747 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.748 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-rbd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.766 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T20:51:30.767 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T20:51:30.774 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T20:51:30.774 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T20:51:30.775 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.775 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mds (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.792 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package librgw2. 2026-02-22T20:51:30.801 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../19-librgw2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.801 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking librgw2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.814 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package cephadm. 2026-02-22T20:51:30.822 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../44-cephadm_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.822 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.839 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T20:51:30.848 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T20:51:30.848 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:30.869 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T20:51:30.877 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:30.878 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.897 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T20:51:30.899 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T20:51:30.905 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.905 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-rgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.907 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T20:51:30.908 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T20:51:30.921 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T20:51:30.922 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-routes. 2026-02-22T20:51:30.929 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T20:51:30.930 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T20:51:30.930 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T20:51:30.931 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T20:51:30.944 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T20:51:30.951 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T20:51:30.953 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.953 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libradosstriper1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.959 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:30.959 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-dashboard (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:30.970 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-common. 2026-02-22T20:51:30.978 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../23-ceph-common_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:30.978 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.230 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-base. 2026-02-22T20:51:31.238 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../24-ceph-base_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.243 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-base (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.308 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T20:51:31.316 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T20:51:31.316 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T20:51:31.332 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T20:51:31.340 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T20:51:31.340 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T20:51:31.357 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T20:51:31.365 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T20:51:31.366 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T20:51:31.378 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T20:51:31.380 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T20:51:31.387 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T20:51:31.387 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T20:51:31.388 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T20:51:31.389 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T20:51:31.404 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T20:51:31.412 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T20:51:31.412 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T20:51:31.426 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T20:51:31.427 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T20:51:31.434 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T20:51:31.435 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T20:51:31.435 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T20:51:31.435 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T20:51:31.450 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-portend. 2026-02-22T20:51:31.458 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-22T20:51:31.458 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T20:51:31.464 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T20:51:31.472 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T20:51:31.473 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T20:51:31.473 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T20:51:31.481 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T20:51:31.481 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T20:51:31.488 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T20:51:31.496 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T20:51:31.496 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T20:51:31.497 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T20:51:31.504 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T20:51:31.504 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T20:51:31.528 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T20:51:31.536 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T20:51:31.536 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T20:51:31.552 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T20:51:31.560 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:31.561 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr-modules-core (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.586 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T20:51:31.589 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T20:51:31.595 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:31.595 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.598 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.598 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.614 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T20:51:31.622 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.623 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.644 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T20:51:31.652 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.653 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.711 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T20:51:31.719 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T20:51:31.720 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T20:51:31.736 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T20:51:31.744 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.744 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-osd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.751 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T20:51:31.759 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T20:51:31.760 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T20:51:31.774 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T20:51:31.783 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-22T20:51:31.783 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T20:51:31.801 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T20:51:31.810 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T20:51:31.810 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T20:51:31.827 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T20:51:31.836 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T20:51:31.836 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T20:51:31.852 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T20:51:31.861 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T20:51:31.861 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T20:51:31.879 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T20:51:31.888 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T20:51:31.888 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T20:51:31.888 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph. 2026-02-22T20:51:31.895 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../41-ceph_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.896 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.910 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T20:51:31.917 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.918 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.940 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T20:51:31.948 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.949 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mds (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.980 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T20:51:31.981 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package cephadm. 2026-02-22T20:51:31.988 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:31.989 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:31.989 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../44-cephadm_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:31.989 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:32.003 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T20:51:32.005 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T20:51:32.012 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T20:51:32.012 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T20:51:32.013 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T20:51:32.013 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:32.028 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T20:51:32.034 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T20:51:32.037 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T20:51:32.037 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:32.042 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:32.043 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr-cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:32.052 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package jq. 2026-02-22T20:51:32.060 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T20:51:32.061 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:32.064 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T20:51:32.072 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T20:51:32.072 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T20:51:32.076 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package socat. 2026-02-22T20:51:32.084 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T20:51:32.085 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T20:51:32.088 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-routes. 2026-02-22T20:51:32.096 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T20:51:32.096 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T20:51:32.105 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T20:51:32.113 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T20:51:32.113 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T20:51:32.117 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T20:51:32.125 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:32.125 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr-dashboard (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:32.149 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-test. 2026-02-22T20:51:32.157 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../67-ceph-test_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:32.158 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-test (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:32.550 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T20:51:32.559 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T20:51:32.560 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T20:51:32.598 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T20:51:32.606 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T20:51:32.606 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T20:51:32.634 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T20:51:32.643 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T20:51:32.643 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T20:51:32.659 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T20:51:32.667 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T20:51:32.667 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T20:51:32.751 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T20:51:32.760 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:32.760 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:32.919 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T20:51:32.927 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T20:51:32.928 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T20:51:32.942 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T20:51:32.951 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-22T20:51:32.951 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T20:51:32.969 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T20:51:32.978 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T20:51:32.978 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T20:51:32.996 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T20:51:33.005 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T20:51:33.005 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T20:51:33.021 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T20:51:33.029 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T20:51:33.029 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T20:51:33.045 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T20:51:33.046 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T20:51:33.054 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:33.054 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-volume (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.055 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T20:51:33.055 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T20:51:33.078 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-22T20:51:33.087 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.087 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs-daemon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.102 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-22T20:51:33.111 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.111 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs-proxy2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.126 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T20:51:33.134 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.135 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs-dev (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.148 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T20:51:33.151 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T20:51:33.157 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:33.157 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.160 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T20:51:33.160 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T20:51:33.172 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T20:51:33.180 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T20:51:33.181 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T20:51:33.191 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T20:51:33.197 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T20:51:33.199 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T20:51:33.199 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:33.205 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T20:51:33.206 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:33.222 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package jq. 2026-02-22T20:51:33.229 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T20:51:33.230 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T20:51:33.230 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:33.238 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T20:51:33.238 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T20:51:33.245 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package socat. 2026-02-22T20:51:33.253 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T20:51:33.253 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T20:51:33.254 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T20:51:33.261 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T20:51:33.261 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T20:51:33.273 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T20:51:33.278 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T20:51:33.282 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T20:51:33.282 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T20:51:33.286 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T20:51:33.286 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T20:51:33.306 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-py. 2026-02-22T20:51:33.314 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-22T20:51:33.314 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T20:51:33.319 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-test. 2026-02-22T20:51:33.328 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../67-ceph-test_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.328 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-test (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.334 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T20:51:33.343 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T20:51:33.343 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T20:51:33.385 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-toml. 2026-02-22T20:51:33.393 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-22T20:51:33.394 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T20:51:33.409 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T20:51:33.417 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T20:51:33.417 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T20:51:33.439 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T20:51:33.447 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T20:51:33.448 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T20:51:33.466 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-webob. 2026-02-22T20:51:33.474 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T20:51:33.475 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T20:51:33.499 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T20:51:33.507 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T20:51:33.508 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T20:51:33.575 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package radosgw. 2026-02-22T20:51:33.583 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../84-radosgw_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.584 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking radosgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.794 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T20:51:33.803 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:33.803 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking rbd-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:33.829 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T20:51:33.905 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T20:51:33.906 INFO:teuthology.orchestra.run.trial061.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T20:51:33.977 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T20:51:34.206 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T20:51:34.215 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-794-ga5c3084f-1jammy_all.deb ... 2026-02-22T20:51:34.215 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking ceph-volume (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.238 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-22T20:51:34.238 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T20:51:34.246 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:34.247 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libcephfs-daemon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.262 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-22T20:51:34.271 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:34.271 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libcephfs-proxy2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.285 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T20:51:34.293 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:34.294 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking libcephfs-dev (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.310 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T20:51:34.319 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T20:51:34.319 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T20:51:34.349 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T20:51:34.358 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T20:51:34.358 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:34.389 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T20:51:34.398 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T20:51:34.398 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T20:51:34.413 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T20:51:34.422 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T20:51:34.422 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T20:51:34.438 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T20:51:34.447 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T20:51:34.447 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T20:51:34.466 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-py. 2026-02-22T20:51:34.474 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-22T20:51:34.475 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T20:51:34.495 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T20:51:34.503 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T20:51:34.504 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T20:51:34.546 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-toml. 2026-02-22T20:51:34.555 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-22T20:51:34.555 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T20:51:34.570 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T20:51:34.578 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T20:51:34.578 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T20:51:34.584 INFO:teuthology.orchestra.run.trial061.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T20:51:34.596 INFO:teuthology.orchestra.run.trial061.stdout:Setting up cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.600 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T20:51:34.609 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T20:51:34.609 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T20:51:34.627 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package python3-webob. 2026-02-22T20:51:34.635 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T20:51:34.635 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T20:51:34.640 INFO:teuthology.orchestra.run.trial061.stdout:Adding system user cephadm....done 2026-02-22T20:51:34.651 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T20:51:34.657 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T20:51:34.665 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T20:51:34.665 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T20:51:34.724 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:34.725 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T20:51:34.732 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package radosgw. 2026-02-22T20:51:34.741 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../84-radosgw_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:34.742 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking radosgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.796 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T20:51:34.871 INFO:teuthology.orchestra.run.trial061.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T20:51:34.872 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T20:51:34.952 INFO:teuthology.orchestra.run.trial007.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T20:51:34.961 INFO:teuthology.orchestra.run.trial007.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-794-ga5c3084f-1jammy_amd64.deb ... 2026-02-22T20:51:34.961 INFO:teuthology.orchestra.run.trial007.stdout:Unpacking rbd-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:34.969 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T20:51:34.988 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T20:51:35.055 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T20:51:35.056 INFO:teuthology.orchestra.run.trial007.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T20:51:35.092 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T20:51:35.114 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T20:51:35.167 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T20:51:35.242 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-ceph-argparse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:35.311 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T20:51:35.312 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T20:51:35.313 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T20:51:35.313 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T20:51:35.314 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T20:51:35.418 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T20:51:35.439 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T20:51:35.518 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs-proxy2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:35.519 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T20:51:35.598 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T20:51:35.688 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T20:51:35.801 INFO:teuthology.orchestra.run.trial007.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T20:51:35.811 INFO:teuthology.orchestra.run.trial007.stdout:Setting up cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:35.854 INFO:teuthology.orchestra.run.trial007.stdout:Adding system user cephadm....done 2026-02-22T20:51:35.866 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T20:51:35.932 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:35.933 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T20:51:35.941 INFO:teuthology.orchestra.run.trial061.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T20:51:35.942 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T20:51:35.995 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T20:51:36.040 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:36.071 INFO:teuthology.orchestra.run.trial007.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T20:51:36.071 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T20:51:36.157 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T20:51:36.166 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T20:51:36.249 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T20:51:36.270 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T20:51:36.321 INFO:teuthology.orchestra.run.trial061.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T20:51:36.322 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:36.334 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T20:51:36.409 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-ceph-argparse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:36.411 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T20:51:36.474 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T20:51:36.475 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T20:51:36.476 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T20:51:36.477 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T20:51:36.478 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T20:51:36.589 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T20:51:36.665 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libcephfs-proxy2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:36.666 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T20:51:36.745 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T20:51:36.836 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T20:51:36.924 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:36.929 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T20:51:37.005 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T20:51:37.006 INFO:teuthology.orchestra.run.trial061.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T20:51:37.007 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T20:51:37.083 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T20:51:37.087 INFO:teuthology.orchestra.run.trial007.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T20:51:37.088 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T20:51:37.156 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:37.157 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T20:51:37.186 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T20:51:37.234 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T20:51:37.310 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T20:51:37.313 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T20:51:37.390 INFO:teuthology.orchestra.run.trial061.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T20:51:37.391 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T20:51:37.392 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T20:51:37.464 INFO:teuthology.orchestra.run.trial007.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T20:51:37.465 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:37.475 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T20:51:37.476 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T20:51:37.554 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T20:51:37.555 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T20:51:37.641 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T20:51:37.713 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:37.714 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T20:51:37.851 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T20:51:37.925 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:37.926 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T20:51:38.012 INFO:teuthology.orchestra.run.trial061.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:38.013 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T20:51:38.054 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:38.058 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T20:51:38.132 INFO:teuthology.orchestra.run.trial007.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T20:51:38.133 INFO:teuthology.orchestra.run.trial007.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T20:51:38.134 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T20:51:38.151 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T20:51:38.152 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librados2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.153 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librgw2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.154 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libsqlite3-mod-ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.155 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T20:51:38.201 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T20:51:38.272 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:38.273 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T20:51:38.341 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T20:51:38.414 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T20:51:38.482 INFO:teuthology.orchestra.run.trial007.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T20:51:38.483 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T20:51:38.558 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T20:51:38.559 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T20:51:38.626 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T20:51:38.684 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.685 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libradosstriper1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.686 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librbd1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.687 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-modules-core (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.688 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:38.710 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T20:51:38.760 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T20:51:38.761 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T20:51:38.776 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:38.777 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T20:51:38.905 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T20:51:38.968 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T20:51:38.968 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T20:51:39.044 INFO:teuthology.orchestra.run.trial007.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T20:51:39.044 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T20:51:39.133 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs-dev (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.133 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rados (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.134 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs-daemon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.135 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rbd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.136 INFO:teuthology.orchestra.run.trial061.stdout:Setting up rbd-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.137 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.138 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cephfs (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.138 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.168 INFO:teuthology.orchestra.run.trial061.stdout:Adding group ceph....done 2026-02-22T20:51:39.169 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T20:51:39.170 INFO:teuthology.orchestra.run.trial007.stdout:Setting up librados2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.171 INFO:teuthology.orchestra.run.trial007.stdout:Setting up librgw2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.172 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libsqlite3-mod-ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.173 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T20:51:39.204 INFO:teuthology.orchestra.run.trial061.stdout:Adding system user ceph....done 2026-02-22T20:51:39.213 INFO:teuthology.orchestra.run.trial061.stdout:Setting system user ceph properties....done 2026-02-22T20:51:39.220 INFO:teuthology.orchestra.run.trial061.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T20:51:39.310 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T20:51:39.591 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T20:51:39.681 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libcephfs2 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.682 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libradosstriper1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.683 INFO:teuthology.orchestra.run.trial007.stdout:Setting up librbd1 (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.684 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr-modules-core (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.685 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.739 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T20:51:39.739 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T20:51:39.952 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-test (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:39.952 INFO:teuthology.orchestra.run.trial061.stdout:Setting up radosgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.153 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libcephfs-dev (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.154 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-rados (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.155 INFO:teuthology.orchestra.run.trial007.stdout:Setting up libcephfs-daemon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.156 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-rbd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.157 INFO:teuthology.orchestra.run.trial007.stdout:Setting up rbd-fuse (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.157 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-rgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.158 INFO:teuthology.orchestra.run.trial007.stdout:Setting up python3-cephfs (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.159 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-common (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.187 INFO:teuthology.orchestra.run.trial007.stdout:Adding group ceph....done 2026-02-22T20:51:40.223 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T20:51:40.223 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T20:51:40.224 INFO:teuthology.orchestra.run.trial007.stdout:Adding system user ceph....done 2026-02-22T20:51:40.233 INFO:teuthology.orchestra.run.trial007.stdout:Setting system user ceph properties....done 2026-02-22T20:51:40.240 INFO:teuthology.orchestra.run.trial007.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T20:51:40.328 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T20:51:40.573 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-base (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:40.602 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T20:51:40.683 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T20:51:41.000 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-test (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.000 INFO:teuthology.orchestra.run.trial007.stdout:Setting up radosgw (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.067 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mds (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.126 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T20:51:41.126 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T20:51:41.251 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T20:51:41.251 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T20:51:41.503 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.574 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T20:51:41.574 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T20:51:41.629 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-base (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.736 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T20:51:41.903 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-osd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:41.997 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T20:51:41.997 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T20:51:42.115 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mds (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.174 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T20:51:42.174 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T20:51:42.360 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-k8sevents (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.370 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.380 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.452 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T20:51:42.452 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T20:51:42.558 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.614 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T20:51:42.614 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T20:51:42.837 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.847 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.848 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-dashboard (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.858 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-volume (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:42.968 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T20:51:42.989 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T20:51:42.993 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-osd (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.079 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T20:51:43.079 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T20:51:43.404 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.404 INFO:teuthology.orchestra.run.trial061.stdout:Running kernel seems to be up-to-date. 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout:The processor microcode seems to be up-to-date. 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout:No services need to be restarted. 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout:No containers need to be restarted. 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout:No user sessions are running outdated binaries. 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:43.405 INFO:teuthology.orchestra.run.trial061.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T20:51:43.456 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr-k8sevents (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.464 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.475 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mon (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.548 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T20:51:43.548 INFO:teuthology.orchestra.run.trial007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T20:51:43.941 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr-cephadm (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.951 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.952 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-mgr-dashboard (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:43.962 INFO:teuthology.orchestra.run.trial007.stdout:Setting up ceph-volume (20.2.0-794-ga5c3084f-1jammy) ... 2026-02-22T20:51:44.069 INFO:teuthology.orchestra.run.trial007.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T20:51:44.151 INFO:teuthology.orchestra.run.trial007.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T20:51:44.195 INFO:teuthology.orchestra.run.trial061.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T20:51:44.202 DEBUG:teuthology.parallel:result is None 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout:Running kernel seems to be up-to-date. 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout:The processor microcode seems to be up-to-date. 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.819 INFO:teuthology.orchestra.run.trial007.stdout:No services need to be restarted. 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout:No containers need to be restarted. 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout:No user sessions are running outdated binaries. 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:44.820 INFO:teuthology.orchestra.run.trial007.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T20:51:45.649 INFO:teuthology.orchestra.run.trial007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T20:51:45.655 DEBUG:teuthology.parallel:result is None 2026-02-22T20:51:45.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a5c3084f688b1f6eff223b8d259a8316f9844c8e 2026-02-22T20:51:45.821 DEBUG:teuthology.orchestra.run.trial007:> dpkg-query -W -f '${Version}' ceph 2026-02-22T20:51:45.832 INFO:teuthology.orchestra.run.trial007.stdout:20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:45.833 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:45.833 INFO:teuthology.task.install:The correct ceph version 20.2.0-794-ga5c3084f-1jammy is installed. 2026-02-22T20:51:45.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a5c3084f688b1f6eff223b8d259a8316f9844c8e 2026-02-22T20:51:45.984 DEBUG:teuthology.orchestra.run.trial061:> dpkg-query -W -f '${Version}' ceph 2026-02-22T20:51:45.994 INFO:teuthology.orchestra.run.trial061.stdout:20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:45.994 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-794-ga5c3084f-1jammy 2026-02-22T20:51:45.994 INFO:teuthology.task.install:The correct ceph version 20.2.0-794-ga5c3084f-1jammy is installed. 2026-02-22T20:51:45.996 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T20:51:45.996 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:45.996 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T20:51:46.007 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:46.007 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T20:51:46.043 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T20:51:46.044 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:46.044 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T20:51:46.058 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T20:51:46.110 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:46.111 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T20:51:46.119 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T20:51:46.170 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T20:51:46.171 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:46.171 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T20:51:46.180 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T20:51:46.230 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:46.230 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T20:51:46.239 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T20:51:46.290 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T20:51:46.290 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:46.291 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T20:51:46.300 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T20:51:46.350 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:46.350 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T20:51:46.357 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T20:51:46.406 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T20:51:46.518 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T20:51:46.518 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod 777 /var/log/ceph 2026-02-22T20:51:46.519 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 777 /var/log/ceph 2026-02-22T20:51:46.528 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T20:51:46.528 DEBUG:teuthology.orchestra.run.trial007:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T20:51:46.571 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T20:51:46.578 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T20:51:46.579 DEBUG:teuthology.orchestra.run.trial007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T20:51:46.620 DEBUG:teuthology.orchestra.run.trial061:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T20:51:46.644 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T20:51:46.644 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T20:51:46.644 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598', 'branch': 'wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{v2/{compr$/{yes$/{snappy}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '64598', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'cephadm': {'distro-suffix': 'rockylinux-10'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle', 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e'}}, 'owner': 'scheduled_nmordech@soko04.front.sepia.ceph.com', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 966, 'sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a5c3084f688b1f6eff223b8d259a8316f9844c8e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a5c3084f688b1f6eff223b8d259a8316f9844c8e', 'targets': {'trial007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVv+s27R3iHxRiNvI0MxAehzo1NQ3JlIj1VWctzL+4UHDNzKNPt8G1ORO3tuMeO05/h3XRu24GiPAF/tcx/3Pg=', 'trial061.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNS3Li6fb7vMqKZ4kKd9hGB/OoGjqBn/GLR4nHUsCl4O678aCZV6Evxsr5sMj1fYyGP8nTwCw1DWsja1bXuZZnQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'freeze_mon_duration': 20, 'freeze_mon_probability': 10, 'revive_delay': 20, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:44:01', 'tube': 'trial', 'user': 'nmordech', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T20:51:46.645 DEBUG:teuthology.orchestra.run.trial007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T20:51:46.671 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T20:51:46.675 DEBUG:teuthology.orchestra.run.trial007:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T20:51:46.716 DEBUG:teuthology.orchestra.run.trial061:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T20:51:46.726 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:46.727 DEBUG:teuthology.orchestra.run.trial007:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T20:51:46.771 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T20:51:46.771 DEBUG:teuthology.orchestra.run.trial007:> stat /dev/vg_nvme/lv_1 2026-02-22T20:51:46.818 INFO:teuthology.orchestra.run.trial007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout:Access: 2026-02-22 20:50:53.791715717 +0000 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout:Modify: 2026-02-22 20:50:53.643718241 +0000 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout:Change: 2026-02-22 20:50:53.643718241 +0000 2026-02-22T20:51:46.819 INFO:teuthology.orchestra.run.trial007.stdout: Birth: - 2026-02-22T20:51:46.820 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T20:51:46.869 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records in 2026-02-22T20:51:46.870 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records out 2026-02-22T20:51:46.870 INFO:teuthology.orchestra.run.trial007.stderr:512 bytes copied, 0.000180706 s, 2.8 MB/s 2026-02-22T20:51:46.871 DEBUG:teuthology.orchestra.run.trial007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T20:51:46.920 DEBUG:teuthology.orchestra.run.trial007:> stat /dev/vg_nvme/lv_2 2026-02-22T20:51:46.965 INFO:teuthology.orchestra.run.trial007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout:Device: 5h/5d Inode: 930 Links: 1 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout:Access: 2026-02-22 20:50:54.111710269 +0000 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout:Modify: 2026-02-22 20:50:53.943713131 +0000 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout:Change: 2026-02-22 20:50:53.943713131 +0000 2026-02-22T20:51:46.966 INFO:teuthology.orchestra.run.trial007.stdout: Birth: - 2026-02-22T20:51:46.966 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T20:51:47.013 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records in 2026-02-22T20:51:47.013 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records out 2026-02-22T20:51:47.013 INFO:teuthology.orchestra.run.trial007.stderr:512 bytes copied, 0.000175556 s, 2.9 MB/s 2026-02-22T20:51:47.014 DEBUG:teuthology.orchestra.run.trial007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T20:51:47.059 DEBUG:teuthology.orchestra.run.trial007:> stat /dev/vg_nvme/lv_3 2026-02-22T20:51:47.106 INFO:teuthology.orchestra.run.trial007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T20:51:47.106 INFO:teuthology.orchestra.run.trial007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout:Device: 5h/5d Inode: 966 Links: 1 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout:Access: 2026-02-22 20:50:54.431704815 +0000 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout:Modify: 2026-02-22 20:50:54.271707544 +0000 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout:Change: 2026-02-22 20:50:54.271707544 +0000 2026-02-22T20:51:47.107 INFO:teuthology.orchestra.run.trial007.stdout: Birth: - 2026-02-22T20:51:47.107 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T20:51:47.153 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records in 2026-02-22T20:51:47.153 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records out 2026-02-22T20:51:47.153 INFO:teuthology.orchestra.run.trial007.stderr:512 bytes copied, 0.000186567 s, 2.7 MB/s 2026-02-22T20:51:47.153 DEBUG:teuthology.orchestra.run.trial007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T20:51:47.199 DEBUG:teuthology.orchestra.run.trial007:> stat /dev/vg_nvme/lv_4 2026-02-22T20:51:47.246 INFO:teuthology.orchestra.run.trial007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T20:51:47.246 INFO:teuthology.orchestra.run.trial007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout:Access: 2026-02-22 20:50:54.599701956 +0000 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout:Modify: 2026-02-22 20:50:54.595702025 +0000 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout:Change: 2026-02-22 20:50:54.595702025 +0000 2026-02-22T20:51:47.247 INFO:teuthology.orchestra.run.trial007.stdout: Birth: - 2026-02-22T20:51:47.247 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T20:51:47.297 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records in 2026-02-22T20:51:47.298 INFO:teuthology.orchestra.run.trial007.stderr:1+0 records out 2026-02-22T20:51:47.298 INFO:teuthology.orchestra.run.trial007.stderr:512 bytes copied, 0.000216493 s, 2.4 MB/s 2026-02-22T20:51:47.299 DEBUG:teuthology.orchestra.run.trial007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T20:51:47.348 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:47.348 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:47.348 DEBUG:teuthology.orchestra.run.trial061:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T20:51:47.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T20:51:47.354 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_1 2026-02-22T20:51:47.398 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 913 Links: 1 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 20:50:54.168032344 +0000 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 20:50:53.988035408 +0000 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 20:50:53.988035408 +0000 2026-02-22T20:51:47.399 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T20:51:47.400 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T20:51:47.450 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T20:51:47.450 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T20:51:47.450 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000197316 s, 2.6 MB/s 2026-02-22T20:51:47.451 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T20:51:47.500 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_2 2026-02-22T20:51:47.546 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T20:51:47.546 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 929 Links: 1 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 20:50:54.532026143 +0000 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 20:50:54.336029480 +0000 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 20:50:54.336029480 +0000 2026-02-22T20:51:47.547 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T20:51:47.547 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T20:51:47.593 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T20:51:47.593 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T20:51:47.593 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000182329 s, 2.8 MB/s 2026-02-22T20:51:47.594 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T20:51:47.640 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_3 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 964 Links: 1 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 20:50:54.868020420 +0000 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 20:50:54.692023418 +0000 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 20:50:54.692023418 +0000 2026-02-22T20:51:47.687 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T20:51:47.688 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T20:51:47.738 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T20:51:47.754 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T20:51:47.754 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000187298 s, 2.7 MB/s 2026-02-22T20:51:47.757 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T20:51:47.805 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_4 2026-02-22T20:51:47.850 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T20:51:47.850 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 977 Links: 1 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 20:50:55.204014696 +0000 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 20:50:55.024017762 +0000 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 20:50:55.024017762 +0000 2026-02-22T20:51:47.851 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T20:51:47.851 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T20:51:47.897 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T20:51:47.898 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T20:51:47.898 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000169776 s, 3.0 MB/s 2026-02-22T20:51:47.899 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T20:51:47.948 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:47.948 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial061.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-22T20:51:47.948 INFO:tasks.ceph:Generating config... 2026-02-22T20:51:47.951 INFO:tasks.ceph:[client] debug monc = 20 2026-02-22T20:51:47.951 INFO:tasks.ceph:[client] debug ms = 1 2026-02-22T20:51:47.951 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-22T20:51:47.951 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-22T20:51:47.951 INFO:tasks.ceph:[global] ms bind msgr1 = False 2026-02-22T20:51:47.951 INFO:tasks.ceph:[global] ms bind msgr2 = True 2026-02-22T20:51:47.952 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-22T20:51:47.952 INFO:tasks.ceph:[global] ms type = async 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-22T20:51:47.952 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T20:51:47.953 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-22T20:51:47.953 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] bluestore write v2 = True 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] mon client ping interval = 4 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] mon client ping timeout = 12 2026-02-22T20:51:47.954 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T20:51:47.955 INFO:tasks.ceph:[osd] osd_mclock_skip_benchmark = True 2026-02-22T20:51:47.956 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T20:51:47.956 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T20:51:47.974 INFO:teuthology.orchestra.run.trial007.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T20:51:47.978 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T20:51:48.037 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T20:51:48.086 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.7'), ('mon.c', '[v2:10.20.193.7:3301,v1:10.20.193.7:6790]'), ('mon.b', '10.20.193.61')] 2026-02-22T20:51:48.086 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.7,[v2:10.20.193.7:3301,v1:10.20.193.7:6790],10.20.193.61', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client ping interval': 4, 'mon client ping timeout': 12, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-22T20:51:48.087 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:48.087 DEBUG:teuthology.orchestra.run.trial007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T20:51:48.130 DEBUG:teuthology.orchestra.run.trial007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.7 --addv c '[v2:10.20.193.7:3301,v1:10.20.193.7:6790]' --add b 10.20.193.61 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:48.189 INFO:teuthology.orchestra.run.trial007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:48.189 INFO:teuthology.orchestra.run.trial007.stdout:monmaptool: generated fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:51:48.189 INFO:teuthology.orchestra.run.trial007.stdout:setting min_mon_release = tentacle 2026-02-22T20:51:48.189 INFO:teuthology.orchestra.run.trial007.stdout:epoch 0 2026-02-22T20:51:48.189 INFO:teuthology.orchestra.run.trial007.stdout:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:min_mon_release 20 (tentacle) 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:election_strategy: 1 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:51:48.190 INFO:teuthology.orchestra.run.trial007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-22T20:51:48.190 DEBUG:teuthology.orchestra.run.trial007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T20:51:48.237 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ec79d088-5ee7-4a8c-8cac-a194b076cc72... 2026-02-22T20:51:48.238 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T20:51:48.280 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T20:51:48.298 INFO:teuthology.orchestra.run.trial007.stdout:[global] 2026-02-22T20:51:48.298 INFO:teuthology.orchestra.run.trial007.stdout: chdir = "" 2026-02-22T20:51:48.298 INFO:teuthology.orchestra.run.trial007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T20:51:48.298 INFO:teuthology.orchestra.run.trial007.stdout: auth supported = cephx 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: filestore xattr use omap = true 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: mon clock drift allowed = 1.000 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: osd crush chooseleaf type = 0 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: auth debug = true 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: ms die on old message = true 2026-02-22T20:51:48.299 INFO:teuthology.orchestra.run.trial007.stdout: ms die on bug = true 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: mon pg warn max object skew = 0 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: osd pool default size = 2 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: mon osd allow primary affinity = true 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: mon osd allow pg remap = true 2026-02-22T20:51:48.300 INFO:teuthology.orchestra.run.trial007.stdout: mon warn on legacy crush tunables = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon warn on crush straw calc version zero = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon warn on no sortbitwise = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon warn on osd down out interval zero = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon warn on too few osds = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: mon_allow_pool_size_one = true 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.301 INFO:teuthology.orchestra.run.trial007.stdout: osd default data pool replay window = 5 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon allow pool delete = true 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon cluster log file level = debug 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: debug asserts on shutdown = true 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon health detail to clog = false 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon host = "10.20.193.7,[v2:10.20.193.7:3301,v1:10.20.193.7:6790],10.20.193.61" 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon client directed command retry = 5 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: mon election default strategy = 1 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: ms bind msgr1 = False 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: ms bind msgr2 = True 2026-02-22T20:51:48.302 INFO:teuthology.orchestra.run.trial007.stdout: ms inject socket failures = 5000 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: ms type = async 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: fsid = ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout:[osd] 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd journal size = 100 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd scrub load threshold = 5.0 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd scrub max interval = 600 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd mclock profile = high_recovery_ops 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd mclock skip benchmark = True 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd recover clone overlap = true 2026-02-22T20:51:48.303 INFO:teuthology.orchestra.run.trial007.stdout: osd recovery max chunk = 1048576 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd debug shutdown = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd debug op order = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd debug verify stray on activate = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd debug trim objects = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd open classes on start = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd debug pg log writeout = true 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd deep scrub update digest min age = 30 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: osd map max advance = 10 2026-02-22T20:51:48.304 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: journal zero on create = true 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: filestore ondisk finisher threads = 3 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: filestore apply finisher threads = 3 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bdev debug aio = true 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: osd debug misdirected ops = true 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bdev async discard = True 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bdev enable discard = True 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bluestore allocator = btree 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bluestore block size = 96636764160 2026-02-22T20:51:48.305 INFO:teuthology.orchestra.run.trial007.stdout: bluestore compression algorithm = snappy 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: bluestore compression mode = aggressive 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: bluestore fsck on mount = True 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: bluestore onode segment size = 0 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: bluestore write v2 = True 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: bluestore zero block detection = True 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: debug bluefs = 20 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: debug bluestore = 20 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: debug ms = 1 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: debug osd = 20 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: debug rocksdb = 10 2026-02-22T20:51:48.306 INFO:teuthology.orchestra.run.trial007.stdout: mon client ping interval = 4 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: mon client ping timeout = 12 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: mon osd full ratio = 0.9 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: mon osd nearfull ratio = 0.8 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: osd debug verify cached snaps = True 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: osd debug verify missing on start = True 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: osd failsafe full ratio = 0.95 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: osd mclock override recovery settings = True 2026-02-22T20:51:48.307 INFO:teuthology.orchestra.run.trial007.stdout: osd objectstore = bluestore 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: osd op queue = debug_random 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: osd op queue cut off = debug_random 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: osd_mclock_skip_benchmark = True 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout:[mgr] 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: debug ms = 1 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: debug mgr = 20 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: debug mon = 20 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: debug auth = 20 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: mon reweight min pgs per osd = 4 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: mon reweight min bytes per osd = 10 2026-02-22T20:51:48.308 INFO:teuthology.orchestra.run.trial007.stdout: mgr/telemetry/nag = false 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout:[mon] 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: debug ms = 1 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: debug mon = 20 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: debug paxos = 20 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: debug auth = 20 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon data avail warn = 5 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon mgr mkfs grace = 240 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon reweight min pgs per osd = 4 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon osd reporter subtree level = osd 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon osd prime pg temp = true 2026-02-22T20:51:48.309 INFO:teuthology.orchestra.run.trial007.stdout: mon reweight min bytes per osd = 10 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: # 1m isn't quite enough 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: mon_down_mkfs_grace = 2m 2026-02-22T20:51:48.310 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon_warn_on_filestore_osds = false 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon min osdmap epochs = 25 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon osdmap full prune interval = 2 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon osdmap full prune min = 15 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon osdmap full prune txsize = 2 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon scrub inject crc mismatch = 0.01 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon scrub inject missing keys = 0.05 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: mon scrub interval = 300 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: paxos service trim min = 5 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout:[client] 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: rgw cache enabled = true 2026-02-22T20:51:48.311 INFO:teuthology.orchestra.run.trial007.stdout: rgw enable ops log = true 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout: rgw enable usage log = true 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout: debug monc = 20 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout: debug ms = 1 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout:[mon.a] 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout:[mon.c] 2026-02-22T20:51:48.312 INFO:teuthology.orchestra.run.trial007.stdout:[mon.b] 2026-02-22T20:51:48.314 INFO:teuthology.orchestra.run.trial061.stdout:[global] 2026-02-22T20:51:48.314 INFO:teuthology.orchestra.run.trial061.stdout: chdir = "" 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: auth supported = cephx 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: filestore xattr use omap = true 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: mon clock drift allowed = 1.000 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.315 INFO:teuthology.orchestra.run.trial061.stdout: osd crush chooseleaf type = 0 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: auth debug = true 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: ms die on old message = true 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: ms die on bug = true 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: mon pg warn max object skew = 0 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.316 INFO:teuthology.orchestra.run.trial061.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: osd pool default size = 2 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon osd allow primary affinity = true 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon osd allow pg remap = true 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on legacy crush tunables = false 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on crush straw calc version zero = false 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on no sortbitwise = false 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on osd down out interval zero = false 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on too few osds = false 2026-02-22T20:51:48.317 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: mon_allow_pool_size_one = true 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: osd default data pool replay window = 5 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: mon allow pool delete = true 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.318 INFO:teuthology.orchestra.run.trial061.stdout: mon cluster log file level = debug 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: debug asserts on shutdown = true 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: mon health detail to clog = false 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: mon host = "10.20.193.7,[v2:10.20.193.7:3301,v1:10.20.193.7:6790],10.20.193.61" 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: mon client directed command retry = 5 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: mon election default strategy = 1 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: ms bind msgr1 = False 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: ms bind msgr2 = True 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: ms inject socket failures = 5000 2026-02-22T20:51:48.319 INFO:teuthology.orchestra.run.trial061.stdout: ms type = async 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: fsid = ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout:[osd] 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: osd journal size = 100 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: osd scrub load threshold = 5.0 2026-02-22T20:51:48.320 INFO:teuthology.orchestra.run.trial061.stdout: osd scrub max interval = 600 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock profile = high_recovery_ops 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock skip benchmark = True 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd recover clone overlap = true 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd recovery max chunk = 1048576 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd debug shutdown = true 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd debug op order = true 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify stray on activate = true 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd debug trim objects = true 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.321 INFO:teuthology.orchestra.run.trial061.stdout: osd open classes on start = true 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: osd debug pg log writeout = true 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: osd deep scrub update digest min age = 30 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: osd map max advance = 10 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: journal zero on create = true 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: filestore ondisk finisher threads = 3 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: filestore apply finisher threads = 3 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.322 INFO:teuthology.orchestra.run.trial061.stdout: bdev debug aio = true 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: osd debug misdirected ops = true 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bdev async discard = True 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bdev enable discard = True 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore allocator = btree 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore block size = 96636764160 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore compression algorithm = snappy 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore compression mode = aggressive 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore fsck on mount = True 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore onode segment size = 0 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore write v2 = True 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: bluestore zero block detection = True 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: debug bluefs = 20 2026-02-22T20:51:48.323 INFO:teuthology.orchestra.run.trial061.stdout: debug bluestore = 20 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: debug osd = 20 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: debug rocksdb = 10 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: mon client ping interval = 4 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: mon client ping timeout = 12 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: mon osd full ratio = 0.9 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: mon osd nearfull ratio = 0.8 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify cached snaps = True 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify missing on start = True 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd failsafe full ratio = 0.95 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock override recovery settings = True 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd objectstore = bluestore 2026-02-22T20:51:48.324 INFO:teuthology.orchestra.run.trial061.stdout: osd op queue = debug_random 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: osd op queue cut off = debug_random 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: osd_mclock_skip_benchmark = True 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout:[mgr] 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: debug mgr = 20 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: debug mon = 20 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: debug auth = 20 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min pgs per osd = 4 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min bytes per osd = 10 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: mgr/telemetry/nag = false 2026-02-22T20:51:48.325 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout:[mon] 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: debug mon = 20 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: debug paxos = 20 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: debug auth = 20 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon data avail warn = 5 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon mgr mkfs grace = 240 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min pgs per osd = 4 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon osd reporter subtree level = osd 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon osd prime pg temp = true 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min bytes per osd = 10 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.326 INFO:teuthology.orchestra.run.trial061.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: # 1m isn't quite enough 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon_down_mkfs_grace = 2m 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_filestore_osds = false 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon min osdmap epochs = 25 2026-02-22T20:51:48.327 INFO:teuthology.orchestra.run.trial061.stdout: mon osdmap full prune interval = 2 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: mon osdmap full prune min = 15 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: mon osdmap full prune txsize = 2 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: mon scrub inject crc mismatch = 0.01 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: mon scrub inject missing keys = 0.05 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: mon scrub interval = 300 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: paxos service trim min = 5 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout:[client] 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: rgw cache enabled = true 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: rgw enable ops log = true 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: rgw enable usage log = true 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T20:51:48.328 INFO:teuthology.orchestra.run.trial061.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T20:51:48.329 INFO:teuthology.orchestra.run.trial061.stdout: debug monc = 20 2026-02-22T20:51:48.329 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T20:51:48.329 INFO:teuthology.orchestra.run.trial061.stdout:[mon.a] 2026-02-22T20:51:48.329 INFO:teuthology.orchestra.run.trial061.stdout:[mon.c] 2026-02-22T20:51:48.329 INFO:teuthology.orchestra.run.trial061.stdout:[mon.b] 2026-02-22T20:51:48.329 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T20:51:48.330 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T20:51:48.377 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T20:51:48.378 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:48.378 DEBUG:teuthology.orchestra.run.trial007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T20:51:48.423 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:48.424 DEBUG:teuthology.orchestra.run.trial007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T20:51:48.475 INFO:tasks.ceph:Sending monmap to node ubuntu@trial007.front.sepia.ceph.com 2026-02-22T20:51:48.475 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:48.475 DEBUG:teuthology.orchestra.run.trial007:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T20:51:48.475 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T20:51:48.536 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:48.537 DEBUG:teuthology.orchestra.run.trial007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:48.587 INFO:tasks.ceph:Sending monmap to node ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:51:48.588 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:48.588 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T20:51:48.588 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T20:51:48.604 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:48.604 DEBUG:teuthology.orchestra.run.trial061:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:48.651 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T20:51:48.651 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T20:51:48.651 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T20:51:48.717 INFO:teuthology.orchestra.run.trial061.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T20:51:48.720 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T20:51:48.721 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T20:51:48.721 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T20:51:48.779 INFO:teuthology.orchestra.run.trial061.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T20:51:48.786 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T20:51:48.787 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial061.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-22T20:51:48.787 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T20:51:48.796 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:48.797 INFO:tasks.ceph:role: osd.0 2026-02-22T20:51:48.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T20:51:48.797 DEBUG:teuthology.orchestra.run.trial007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T20:51:48.852 INFO:teuthology.orchestra.run.trial007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:48.852 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:48.852 INFO:teuthology.orchestra.run.trial007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:48.852 INFO:teuthology.orchestra.run.trial007.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:48.853 INFO:teuthology.orchestra.run.trial007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:49.431 INFO:teuthology.orchestra.run.trial007.stdout:Discarding blocks...Done. 2026-02-22T20:51:49.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial007.front.sepia.ceph.com -o noatime 2026-02-22T20:51:49.434 DEBUG:teuthology.orchestra.run.trial007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T20:51:49.488 DEBUG:teuthology.orchestra.run.trial007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T20:51:49.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:49.537 INFO:teuthology.orchestra.run.trial007.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:49.538 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T20:51:49.587 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:49.587 INFO:tasks.ceph:role: osd.1 2026-02-22T20:51:49.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T20:51:49.587 DEBUG:teuthology.orchestra.run.trial007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:49.641 INFO:teuthology.orchestra.run.trial007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:49.642 INFO:teuthology.orchestra.run.trial007.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:49.642 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:49.642 INFO:teuthology.orchestra.run.trial007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:50.209 INFO:teuthology.orchestra.run.trial007.stdout:Discarding blocks...Done. 2026-02-22T20:51:50.210 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial007.front.sepia.ceph.com -o noatime 2026-02-22T20:51:50.211 DEBUG:teuthology.orchestra.run.trial007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T20:51:50.268 DEBUG:teuthology.orchestra.run.trial007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T20:51:50.316 INFO:teuthology.orchestra.run.trial007.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:50.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:50.316 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T20:51:50.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:50.366 INFO:tasks.ceph:role: osd.2 2026-02-22T20:51:50.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T20:51:50.367 DEBUG:teuthology.orchestra.run.trial007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:50.420 INFO:teuthology.orchestra.run.trial007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:50.983 INFO:teuthology.orchestra.run.trial007.stdout:Discarding blocks...Done. 2026-02-22T20:51:50.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial007.front.sepia.ceph.com -o noatime 2026-02-22T20:51:50.984 DEBUG:teuthology.orchestra.run.trial007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T20:51:51.039 DEBUG:teuthology.orchestra.run.trial007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T20:51:51.088 INFO:teuthology.orchestra.run.trial007.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:51.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:51.089 DEBUG:teuthology.orchestra.run.trial007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:51.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:51.150+0000 7fa8bb965a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T20:51:51.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:51.150+0000 7fa8bb965a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T20:51:51.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:51.150+0000 7fa8bb965a40 -1 bdev(0x5567626af800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:51.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:51.150+0000 7fa8bb965a40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T20:51:52.031 DEBUG:teuthology.orchestra.run.trial007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T20:51:52.084 DEBUG:teuthology.orchestra.run.trial007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:52.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:52.146+0000 7f10a9b6aa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T20:51:52.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:52.146+0000 7f10a9b6aa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T20:51:52.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:52.146+0000 7f10a9b6aa40 -1 bdev(0x5620c014f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:52.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:52.146+0000 7f10a9b6aa40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T20:51:53.045 DEBUG:teuthology.orchestra.run.trial007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T20:51:53.096 DEBUG:teuthology.orchestra.run.trial007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:53.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:53.158+0000 7f2ffa50ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T20:51:53.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:53.158+0000 7f2ffa50ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T20:51:53.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:53.158+0000 7f2ffa50ba40 -1 bdev(0x560febe97800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:53.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:51:53.158+0000 7f2ffa50ba40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T20:51:54.025 DEBUG:teuthology.orchestra.run.trial007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T20:51:54.075 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T20:51:54.085 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:54.085 INFO:tasks.ceph:role: osd.3 2026-02-22T20:51:54.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:51:54.085 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:54.136 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:54.137 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:54.137 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:54.710 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T20:51:54.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T20:51:54.712 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-22T20:51:54.770 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T20:51:54.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:54.817 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:54.817 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-22T20:51:54.867 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:54.868 INFO:tasks.ceph:role: osd.4 2026-02-22T20:51:54.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:51:54.868 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:54.921 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:54.922 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:54.922 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:54.922 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:54.922 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:55.488 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T20:51:55.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T20:51:55.490 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-22T20:51:55.543 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-22T20:51:55.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:55.594 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:55.594 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-22T20:51:55.643 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-22T20:51:55.643 INFO:tasks.ceph:role: osd.5 2026-02-22T20:51:55.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:51:55.644 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T20:51:55.696 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T20:51:55.697 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T20:51:55.697 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T20:51:56.260 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T20:51:56.261 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T20:51:56.262 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-22T20:51:56.315 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-22T20:51:56.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T20:51:56.365 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T20:51:56.366 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:56.429 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:56.417+0000 7f0279ad1a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T20:51:56.430 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:56.417+0000 7f0279ad1a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T20:51:56.431 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:56.417+0000 7f0279ad1a40 -1 bdev(0x562f28711800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:56.431 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:56.417+0000 7f0279ad1a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T20:51:57.285 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T20:51:57.340 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:57.404 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:57.393+0000 7f3d3ad36a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-22T20:51:57.404 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:57.393+0000 7f3d3ad36a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-22T20:51:57.404 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:57.393+0000 7f3d3ad36a40 -1 bdev(0x55edd7bff800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:57.404 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:57.393+0000 7f3d3ad36a40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-22T20:51:58.300 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-22T20:51:58.352 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:51:58.417 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:58.405+0000 7fee6c6a2a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-22T20:51:58.417 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:58.405+0000 7fee6c6a2a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-22T20:51:58.417 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:58.405+0000 7fee6c6a2a40 -1 bdev(0x5631a4343800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-22T20:51:58.417 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:51:58.405+0000 7fee6c6a2a40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-22T20:51:59.375 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-22T20:51:59.428 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T20:51:59.428 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:59.428 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T20:51:59.440 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:59.440 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T20:51:59.492 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:51:59.492 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T20:51:59.544 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:59.544 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T20:51:59.555 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:59.555 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T20:51:59.607 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:59.607 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-22T20:51:59.656 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:59.656 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-22T20:51:59.707 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:51:59.708 DEBUG:teuthology.orchestra.run.trial061:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T20:51:59.755 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T20:51:59.755 DEBUG:teuthology.orchestra.run.trial007:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T20:51:59.757 DEBUG:teuthology.orchestra.run.trial061:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T20:51:59.801 INFO:teuthology.orchestra.run.trial007.stdout:[osd.0] 2026-02-22T20:51:59.801 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBnbJtpjY0oCRAAoug2L6SumlBPaRY24FQdlA== 2026-02-22T20:51:59.801 INFO:teuthology.orchestra.run.trial007.stdout:[osd.1] 2026-02-22T20:51:59.801 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBobJtpqbrZCBAA+u4WAmjKb1TuYiAUaea3Hg== 2026-02-22T20:51:59.801 INFO:teuthology.orchestra.run.trial007.stdout:[osd.2] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBpbJtppwGZCRAAtw/+nbjTHI1pg6gz/53Y3g== 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout:[mgr.x] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBkbJtpn0pOKhAA2ZwSAP6G2Xv5PLRNKmz6sQ== 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout:[osd.3] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBsbJtpQycmGRAAv7YhTTSJMIRncmEnqGZ/cA== 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout:[osd.4] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBtbJtpWaWXFxAAonrw8PY55nHVIvsa+nr77Q== 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout:[osd.5] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBubJtpl4RZGBAAXhZdqvPHQtmSx5KRFec45g== 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout:[client.0] 2026-02-22T20:51:59.802 INFO:teuthology.orchestra.run.trial007.stdout: key = AQBkbJtpb7UELhAA53fdoJLSuBCSuu4YwVkzDQ== 2026-02-22T20:51:59.805 INFO:teuthology.orchestra.run.trial061.stdout:[osd.0] 2026-02-22T20:51:59.805 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBnbJtpjY0oCRAAoug2L6SumlBPaRY24FQdlA== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[osd.1] 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBobJtpqbrZCBAA+u4WAmjKb1TuYiAUaea3Hg== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[osd.2] 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBpbJtppwGZCRAAtw/+nbjTHI1pg6gz/53Y3g== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[mgr.x] 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBkbJtpn0pOKhAA2ZwSAP6G2Xv5PLRNKmz6sQ== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[osd.3] 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBsbJtpQycmGRAAv7YhTTSJMIRncmEnqGZ/cA== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[osd.4] 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBtbJtpWaWXFxAAonrw8PY55nHVIvsa+nr77Q== 2026-02-22T20:51:59.806 INFO:teuthology.orchestra.run.trial061.stdout:[osd.5] 2026-02-22T20:51:59.807 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBubJtpl4RZGBAAXhZdqvPHQtmSx5KRFec45g== 2026-02-22T20:51:59.807 INFO:teuthology.orchestra.run.trial061.stdout:[client.0] 2026-02-22T20:51:59.807 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBkbJtpb7UELhAA53fdoJLSuBCSuu4YwVkzDQ== 2026-02-22T20:51:59.808 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:51:59.848 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:51:59.873 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:51:59.912 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:51:59.937 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:51:59.976 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.000 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T20:52:00.040 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T20:52:00.068 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.104 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.131 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.169 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.199 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.231 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T20:52:00.264 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T20:52:00.292 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T20:52:00.332 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T20:52:00.332 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T20:52:00.361 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T20:52:00.433 DEBUG:teuthology.orchestra.run.trial007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T20:52:00.482 DEBUG:teuthology.orchestra.run.trial007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-22T20:52:00.531 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T20:52:00.601 DEBUG:teuthology.orchestra.run.trial007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-22T20:52:00.655 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-22T20:52:00.664 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T20:52:00.733 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-22T20:52:00.783 DEBUG:teuthology.orchestra.run.trial007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:52:00.785 DEBUG:teuthology.orchestra.run.trial061:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T20:52:00.831 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T20:52:00.832 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T20:52:00.832 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T20:52:00.834 INFO:tasks.ceph.mon.a:Started 2026-02-22T20:52:00.835 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T20:52:00.835 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T20:52:00.838 INFO:tasks.ceph.mon.c:Started 2026-02-22T20:52:00.838 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T20:52:00.838 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T20:52:00.876 INFO:tasks.ceph.mon.b:Started 2026-02-22T20:52:00.877 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T20:52:00.877 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T20:52:00.877 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T20:52:00.879 INFO:tasks.ceph.mgr.x:Started 2026-02-22T20:52:00.879 DEBUG:tasks.ceph:set 0 configs 2026-02-22T20:52:00.880 DEBUG:teuthology.orchestra.run.trial007:> sudo ceph --cluster ceph config dump 2026-02-22T20:52:00.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: get_monmap_and_config 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: build_initial_monmap 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: monmap: 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:00.937824+0000 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:00.937824+0000 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:00.937 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 Processor -- start 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 -- start start 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: init 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb62013f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-b con 0x7fb62013fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb620180d00 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62008fd70 con 0x7fb620180d00 2026-02-22T20:52:00.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb620092bc0 con 0x7fb62013f290 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb62008e1f0 con 0x7fb62013fd70 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb625e7a640 10 monclient(hunting): authenticate will time out at 533.410854s 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33240/0 (socket says 10.20.193.7:33240) 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 -- 10.20.193.7:0/1485534458 learned_addr learned my addr 10.20.193.7:0/1485534458 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 10 monclient(hunting): get_auth_request con 0x7fb62013fd70 auth_method 0 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61ffff640 1 --1- 10.20.193.7:0/1485534458 >> v1:10.20.193.7:6789/0 conn(0x7fb620180d00 0x7fb6201a10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:49322/0 (socket says 10.20.193.7:49322) 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb6201807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb6201807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:00.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:00.934+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 10 monclient(hunting): get_auth_request con 0x7fb62013fd70 auth_method 0 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb6201807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb6201807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:01.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:01.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.138+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:52:01.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046502231 0 0) 0x7fb614002ca0 con 0x7fb620180d00 2026-02-22T20:52:01.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:52:01.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): my global_id is 4098 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb604003620 con 0x7fb620180d00 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999297728 0 0) 0x7fb620092bc0 con 0x7fb62013f290 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): my global_id is 4099 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb614002ca0 con 0x7fb62013f290 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3417317459 0 0) 0x7fb604003620 con 0x7fb620180d00 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb6201807c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb6201807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 >> v1:10.20.193.61:6789/0 conn(0x7fb62013f290 legacy=0x7fb62013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62008e6d0 con 0x7fb620180d00 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fb6140033b0 con 0x7fb620180d00 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:52:01.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: dump: 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 >> v1:10.20.193.7:6789/0 conn(0x7fb620180d00 legacy=0x7fb6201a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb604003da0 0x7fb604004190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): picked mon.a con 0x7fb604003da0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb604004930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): picked mon.c con 0x7fb62013fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604005000 0x7fb604065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): picked mon.b con 0x7fb604005000 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb62008e1f0 con 0x7fb604003da0 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb604065fd0 con 0x7fb604005000 2026-02-22T20:52:01.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb604066150 con 0x7fb62013fd70 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb604003da0 0x7fb604004190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb604004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): get_auth_request con 0x7fb604003da0 auth_method 0 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): get_auth_request con 0x7fb62013fd70 auth_method 0 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604005000 0x7fb604065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 10 monclient(hunting): get_auth_request con 0x7fb604005000 auth_method 0 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient(hunting): handle_auth_done global_id 4098 payload 293 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 msgr2=0x7fb604004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62013fd70 0x7fb604004930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604005000 msgr2=0x7fb604065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604005000 0x7fb604065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 monclient: found mon.a 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 1 -- 10.20.193.7:0/1485534458 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb604003620 con 0x7fb604003da0 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb625e7a640 5 monclient: authenticate success, global_id 4098 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb625e7a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.170+0000 7fb61ffff640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604005000 0x7fb604065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb604003da0 0x7fb604004190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb60c007fd0 tx=0x7fb60c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6414262b3d5cb854 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c002d60 con 0x7fb604003da0 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: dump: 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.190 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0052a0 con 0x7fb604003da0 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 1 -- 10.20.193.7:0/1485534458 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0068d0 con 0x7fb604003da0 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:01.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 4 set_mon_vals no callback set 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61e7fc640 10 monclient: dump: 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: shutdown 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb604003da0 msgr2=0x7fb604004190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 --2- 10.20.193.7:0/1485534458 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb604003da0 0x7fb604004190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb60c007fd0 tx=0x7fb60c01c590 comp rx=0 tx=0).stop 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 1 -- 10.20.193.7:0/1485534458 reap_dead start 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- 10.20.193.7:0/1485534458 shutdown_connections 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- 10.20.193.7:0/1485534458 >> 10.20.193.7:0/1485534458 conn(0x7fb620093df0 msgr2=0x7fb6200902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- 10.20.193.7:0/1485534458 shutdown_connections 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- 10.20.193.7:0/1485534458 wait complete. 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: monmap: 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:01.193 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 Processor -- start 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- start start 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: init 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604003da0 0x7fb62017d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-b con 0x7fb604003da0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-c con 0x7fb62017f2a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb62010f130 0x7fb62010f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): picked mon.noname-a con 0x7fb62010f130 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb620163360 con 0x7fb62010f130 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201631e0 con 0x7fb604003da0 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb6201634e0 con 0x7fb62017f2a0 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb625e7a640 10 monclient(hunting): authenticate will time out at 533.651644s 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33270/0 (socket says 10.20.193.7:33270) 2026-02-22T20:52:01.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 -- 10.20.193.7:0/2127914590 learned_addr learned my addr 10.20.193.7:0/2127914590 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): get_auth_request con 0x7fb62017f2a0 auth_method 0 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb62010f130 0x7fb62010f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): get_auth_request con 0x7fb62010f130 auth_method 0 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604003da0 0x7fb62017d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 10 monclient(hunting): get_auth_request con 0x7fb604003da0 auth_method 0 2026-02-22T20:52:01.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient(hunting): handle_auth_done global_id 4103 payload 824 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 -- 10.20.193.7:0/2127914590 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604003da0 msgr2=0x7fb62017d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604003da0 0x7fb62017d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 -- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb62010f130 msgr2=0x7fb62010f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb62010f130 0x7fb62010f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 monclient: found mon.noname-c 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.174+0000 7fb61effd640 1 -- 10.20.193.7:0/2127914590 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62017fc30 con 0x7fb62017f2a0 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb61effd640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb610013950 tx=0x7fb610013e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61001a070 con 0x7fb62017f2a0 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: dump: 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb610004440 con 0x7fb62017f2a0 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61000f040 con 0x7fb62017f2a0 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: dump: 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.199 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb61dffb640 4 set_mon_vals no callback set 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 5 monclient: authenticate success, global_id 4103 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _renew_subs 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62008a9e0 con 0x7fb62017f2a0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _renew_subs 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb620180200 con 0x7fb62017f2a0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fb610027060 con 0x7fb62017f2a0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb610016b50 con 0x7fb62017f2a0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62013f660 con 0x7fb62017f2a0 2026-02-22T20:52:01.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7fb610016da0 con 0x7fb62017f2a0 2026-02-22T20:52:01.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.178+0000 7fb5fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:01.201 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.185+0000 7f9c498c7280 -1 mgr[py] Loading module balancer in main interpreter 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb620180a00 con 0x7fb62017f2a0 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb5fbfff640 1 -- 10.20.193.7:0/2127914590 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (secure 0 0 0) 0x7fb610005a80 con 0x7fb62017f2a0 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb5fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb5fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:01.230 INFO:teuthology.orchestra.run.trial007.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-22T20:52:01.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 10 monclient: shutdown 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 msgr2=0x7fb62017bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb610013950 tx=0x7fb610013e10 comp rx=0 tx=0).stop 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 shutdown_connections 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb62010f130 0x7fb62010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb62017f2a0 0x7fb62017bcb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 --2- 10.20.193.7:0/2127914590 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb604003da0 0x7fb62017d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 >> 10.20.193.7:0/2127914590 conn(0x7fb620093df0 msgr2=0x7fb620055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 shutdown_connections 2026-02-22T20:52:01.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.226+0000 7fb625e7a640 1 -- 10.20.193.7:0/2127914590 wait complete. 2026-02-22T20:52:01.245 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T20:52:01.245 DEBUG:teuthology.orchestra.run.trial007:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T20:52:01.248 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.237+0000 7f9c498c7280 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-22T20:52:01.251 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.237+0000 7f9c498c7280 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-22T20:52:01.263 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.253+0000 7f9c498c7280 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-22T20:52:01.317 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.302+0000 7f26e6d3c640 10 monclient: get_monmap_and_config 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.302+0000 7f26e6d3c640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.302+0000 7f26e6d3c640 10 monclient: monmap: 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:01.307477+0000 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:01.307477+0000 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:01.318 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 Processor -- start 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- start start 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: init 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26e008f050 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26e01607b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f26e01822b0 0x7f26e01a2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-c con 0x7f26e01822b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e005c330 con 0x7f26e008f050 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e008a2c0 con 0x7f26e01607b0 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f26e008ad70 con 0x7f26e01822b0 2026-02-22T20:52:01.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient(hunting): authenticate will time out at 533.780725s 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 0x7f26e008f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:49326/0 (socket says 10.20.193.7:49326) 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1011131789 learned_addr learned my addr 10.20.193.7:0/1011131789 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 --2- 10.20.193.7:0/1011131789 >> v2:10.20.193.61:3300/0 conn(0x7f26e01822b0 0x7f26e01a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1011131789 >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 legacy=0x7f26e008f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1011131789 >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 legacy=0x7f26e008f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 --1- 10.20.193.7:0/1011131789 >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 0x7f26e008f420 :-1 s=OPENED pgs=9 cs=1 l=1).handle_message read tag failed 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e4ab1640 1 --1- 10.20.193.7:0/1011131789 >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 0x7f26e008f420 :-1 s=OPENED pgs=9 cs=1 l=1).fault on lossy channel, failing 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): get_auth_request con 0x7f26e01822b0 auth_method 0 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.7:6789/0 2026-02-22T20:52:01.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient(hunting): handle_auth_done global_id 4108 payload 274 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 -- 10.20.193.7:0/1011131789 >> v1:10.20.193.61:6789/0 conn(0x7f26e01607b0 legacy=0x7f26e0180b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 -- 10.20.193.7:0/1011131789 >> v1:10.20.193.7:6789/0 conn(0x7f26e008f050 legacy=0x7f26e008f420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 monclient: found mon.noname-c 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 -- 10.20.193.7:0/1011131789 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e003a060 con 0x7f26e01822b0 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e52b2640 1 --2- 10.20.193.7:0/1011131789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01822b0 0x7f26e01a2690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26e0056e80 tx=0x7f26dc01c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2274e7bfc88d75d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 1 -- 10.20.193.7:0/1011131789 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0b2070 con 0x7f26e01822b0 2026-02-22T20:52:01.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: dump: 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 1 -- 10.20.193.7:0/1011131789 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc0a5740 con 0x7f26e01822b0 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 1 -- 10.20.193.7:0/1011131789 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0a5b30 con 0x7f26e01822b0 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 5 monclient: authenticate success, global_id 4108 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 4 set_mon_vals no callback set 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26d77fe640 10 monclient: dump: 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.323 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: shutdown 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1011131789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01822b0 msgr2=0x7f26e01a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1011131789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01822b0 0x7f26e01a2690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26e0056e80 tx=0x7f26dc01c7f0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1011131789 shutdown_connections 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1011131789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01822b0 0x7f26e01a2690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1011131789 >> 10.20.193.7:0/1011131789 conn(0x7f26e0038f20 msgr2=0x7f26e0039320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1011131789 shutdown_connections 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1011131789 wait complete. 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: monmap: 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:01.325 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 Processor -- start 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 1 -- start start 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.306+0000 7f26e6d3c640 10 monclient: init 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-a con 0x7f26e008f050 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01607b0 0x7f26e016a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-b con 0x7f26e01607b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26e01822b0 0x7f26e0141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): picked mon.noname-c con 0x7f26e01822b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26e005c7b0 con 0x7f26e008f050 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0060020 con 0x7f26e01607b0 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f26e0160b80 con 0x7f26e01822b0 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient(hunting): authenticate will time out at 533.784409s 2026-02-22T20:52:01.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57228/0 (socket says 10.20.193.7:57228) 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1951476693 learned_addr learned my addr 10.20.193.7:0/1951476693 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): get_auth_request con 0x7f26e008f050 auth_method 0 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26e01822b0 0x7f26e0141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01607b0 0x7f26e016a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): get_auth_request con 0x7f26e01822b0 auth_method 0 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): get_auth_request con 0x7f26e01607b0 auth_method 0 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e52b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient(hunting): handle_auth_done global_id 4110 payload 824 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26e01822b0 msgr2=0x7f26e0141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26e01822b0 0x7f26e0141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1951476693 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01607b0 msgr2=0x7f26e016a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01607b0 0x7f26e016a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 monclient: found mon.noname-a 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 -- 10.20.193.7:0/1951476693 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e0144d50 con 0x7f26e008f050 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e4ab1640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c700 tx=0x7f26d000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26e008f050 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: dump: 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.331 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d0005bd0 con 0x7f26e008f050 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0007070 con 0x7f26e008f050 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 5 monclient: authenticate success, global_id 4110 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d6ffd640 4 set_mon_vals no callback set 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _renew_subs 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e015bd80 con 0x7f26e008f050 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: dump: 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.333 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _renew_subs 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01441c0 con 0x7f26e008f050 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f26d0007620 con 0x7f26e008f050 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f26d001b7b0 con 0x7f26e008f050 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e008f420 con 0x7f26e008f050 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f26d001b9f0 con 0x7f26e008f050 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.310+0000 7f26d57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:01.335 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.301+0000 7f9c498c7280 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-22T20:52:01.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T20:52:01.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T20:52:01.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:01.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f26e008afc0 con 0x7f26e008f050 2026-02-22T20:52:01.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26d57fa640 1 -- 10.20.193.7:0/1951476693 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f26d001bc30 con 0x7f26e008f050 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26d57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26d57fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:adjusted tunables profile to default 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 10 monclient: shutdown 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 msgr2=0x7f26e0143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c700 tx=0x7f26d000cbc0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 shutdown_connections 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26e01822b0 0x7f26e0141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26e01607b0 0x7f26e016a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 --2- 10.20.193.7:0/1951476693 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26e008f050 0x7f26e0143830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 >> 10.20.193.7:0/1951476693 conn(0x7f26e0038f20 msgr2=0x7f26e015b160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 shutdown_connections 2026-02-22T20:52:01.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:01.342+0000 7f26e6d3c640 1 -- 10.20.193.7:0/1951476693 wait complete. 2026-02-22T20:52:01.355 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T20:52:01.355 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T20:52:01.355 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:52:01.355 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T20:52:01.358 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.345+0000 7f9c498c7280 -1 mgr[py] Loading module status in main interpreter 2026-02-22T20:52:01.359 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.349+0000 7f9c498c7280 -1 mgr[py] Loading module nfs in main interpreter 2026-02-22T20:52:01.366 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:52:01.366 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T20:52:01.368 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.357+0000 7f9c498c7280 -1 mgr[py] Loading module localpool in main interpreter 2026-02-22T20:52:01.369 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.357+0000 7f9c498c7280 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-22T20:52:01.415 DEBUG:teuthology.orchestra.run.trial007:> set -ex 2026-02-22T20:52:01.416 DEBUG:teuthology.orchestra.run.trial007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T20:52:01.453 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.441+0000 7f9c498c7280 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-22T20:52:01.467 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:52:01.468 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T20:52:01.476 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:52:01.476 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-22T20:52:01.527 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T20:52:01.527 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-22T20:52:01.581 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new b9fd6863-f28a-4c0f-befd-40a634c44bbd 0 2026-02-22T20:52:01.585 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.573+0000 7f9c498c7280 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-22T20:52:01.586 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.573+0000 7f9c498c7280 -1 mgr[py] Loading module stats in main interpreter 2026-02-22T20:52:01.588 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.577+0000 7f9c498c7280 -1 mgr[py] Loading module insights in main interpreter 2026-02-22T20:52:01.590 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.577+0000 7f9c498c7280 -1 mgr[py] Loading module crash in main interpreter 2026-02-22T20:52:01.593 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.581+0000 7f9c498c7280 -1 mgr[py] Loading module selftest in main interpreter 2026-02-22T20:52:01.596 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.585+0000 7f9c498c7280 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-22T20:52:01.603 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.593+0000 7f9c498c7280 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-22T20:52:01.620 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.609+0000 7f9c498c7280 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-22T20:52:01.629 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.617+0000 7f9c498c7280 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-22T20:52:01.630 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.617+0000 7f9c498c7280 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: get_monmap_and_config 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: monmap: 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:01.636406+0000 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:01.636406+0000 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 Processor -- start 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 -- start start 2026-02-22T20:52:01.644 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: init 2026-02-22T20:52:01.645 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.645 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-22T20:52:01.645 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f39cc13c410 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:01.645 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f39cc160610 0x7f39cc1809f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-a con 0x7f39cc160610 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f39cc180f30 0x7f39cc1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-c con 0x7f39cc180f30 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc092c20 con 0x7f39cc13c410 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f39cc08fe40 con 0x7f39cc160610 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f39cc0916d0 con 0x7f39cc180f30 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient(hunting): authenticate will time out at 533.358260s 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cb7fe640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f39cc13c410 0x7f39cc13c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.61:43440/0 (socket says 10.20.193.61:43440) 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cb7fe640 1 -- 10.20.193.61:0/1498264651 learned_addr learned my addr 10.20.193.61:0/1498264651 (peer_addr_for_me v1:10.20.193.61:0/0) 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 --2- 10.20.193.61:0/1498264651 >> v2:10.20.193.61:3300/0 conn(0x7f39cc180f30 0x7f39cc1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): get_auth_request con 0x7f39cc180f30 auth_method 0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 1 --2- 10.20.193.61:0/1498264651 >> v2:10.20.193.7:3300/0 conn(0x7f39cc160610 0x7f39cc1809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): get_auth_request con 0x7f39cc160610 auth_method 0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 1 -- 10.20.193.61:0/1498264651 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444145513 0 0) 0x7f39cc092c20 con 0x7f39cc13c410 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient(hunting): my global_id is 4120 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 1 -- 10.20.193.61:0/1498264651 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39b0003620 con 0x7f39cc13c410 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient(hunting): handle_auth_done global_id 4117 payload 274 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 -- 10.20.193.61:0/1498264651 >> v2:10.20.193.7:3300/0 conn(0x7f39cc160610 msgr2=0x7f39cc1809f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 --2- 10.20.193.61:0/1498264651 >> v2:10.20.193.7:3300/0 conn(0x7f39cc160610 0x7f39cc1809f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 -- 10.20.193.61:0/1498264651 >> v1:10.20.193.61:6789/0 conn(0x7f39cc13c410 legacy=0x7f39cc13c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.646 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 monclient: found mon.noname-c 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 -- 10.20.193.61:0/1498264651 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0929a0 con 0x7f39cc180f30 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39cbfff640 1 --2- 10.20.193.61:0/1498264651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc180f30 0x7f39cc1a1310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39cc060050 tx=0x7f39c001c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7c49f6c9ca2ab1 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 1 -- 10.20.193.61:0/1498264651 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c00a66c0 con 0x7f39cc180f30 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: dump: 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.647 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 5 monclient: authenticate success, global_id 4117 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 1 -- 10.20.193.61:0/1498264651 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c00a6860 con 0x7f39cc180f30 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39d2245640 4 set_mon_vals no callback set 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 1 -- 10.20.193.61:0/1498264651 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c00a6c50 con 0x7f39cc180f30 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.633+0000 7f39ca7fc640 10 monclient: dump: 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: shutdown 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/1498264651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc180f30 msgr2=0x7f39cc1a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- 10.20.193.61:0/1498264651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc180f30 0x7f39cc1a1310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39cc060050 tx=0x7f39c001c7f0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/1498264651 shutdown_connections 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- 10.20.193.61:0/1498264651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc180f30 0x7f39cc1a1310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- 10.20.193.61:0/1498264651 >> v2:10.20.193.7:3300/0 conn(0x7f39cc160610 0x7f39cc1809f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/1498264651 >> 10.20.193.61:0/1498264651 conn(0x7f39cc0905a0 msgr2=0x7f39cc0909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/1498264651 shutdown_connections 2026-02-22T20:52:01.648 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/1498264651 wait complete. 2026-02-22T20:52:01.648 INFO:tasks.ceph.mgr.x.trial061.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: monmap: 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 Processor -- start 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- start start 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: init 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-b con 0x7f39cc13c410 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f39cc160610 0x7f39cc17e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-c con 0x7f39cc160610 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 0x7f39cc17ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): picked mon.noname-a con 0x7f39cc180f30 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc1a4400 con 0x7f39cc180f30 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc1a4280 con 0x7f39cc13c410 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc1a4580 con 0x7f39cc160610 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient(hunting): authenticate will time out at 533.361114s 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58636/0 (socket says 10.20.193.61:58636) 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 -- 10.20.193.61:0/3857376260 learned_addr learned my addr 10.20.193.61:0/3857376260 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): get_auth_request con 0x7f39cc13c410 auth_method 0 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.650 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39caffd640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f39cc160610 0x7f39cc17e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39caffd640 10 monclient(hunting): get_auth_request con 0x7f39cc160610 auth_method 0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39caffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cbfff640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 0x7f39cc17ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 -- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f39cc160610 msgr2=0x7f39cc17e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f39cc160610 0x7f39cc17e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 -- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 msgr2=0x7f39cc17ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 0x7f39cc17ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 -- 10.20.193.61:0/3857376260 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc17f270 con 0x7f39cc13c410 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cbfff640 10 monclient: get_auth_request con 0x7f39cc180f30 auth_method 0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cbfff640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 0x7f39cc17ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39cb7fe640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c700 tx=0x7f39b800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8017070 con 0x7f39cc13c410 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: dump: 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.651 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8005bb0 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8007070 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 5 monclient: authenticate success, global_id 4123 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _renew_subs 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39c9ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc08aac0 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 10 monclient: dump: 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _renew_subs 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc1631b0 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f39b8007620 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7f39b801c800 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.637+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc0382a0 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.641+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f39b8021070 con 0x7f39cc13c410 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.641+0000 7f39a7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.652 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.641+0000 7f39a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:01.669 INFO:tasks.ceph.mgr.x.trial061.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-22T20:52:01.675 INFO:tasks.ceph.mgr.x.trial061.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-22T20:52:01.682 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.669+0000 7f39d2245640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b9fd6863-f28a-4c0f-befd-40a634c44bbd", "id": 0}] 2026-02-22T20:52:01.682 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.669+0000 7f39d2245640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b9fd6863-f28a-4c0f-befd-40a634c44bbd", "id": 0}] 2026-02-22T20:52:01.682 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.669+0000 7f39d2245640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.682 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.669+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9fd6863-f28a-4c0f-befd-40a634c44bbd", "id": 0} v 0) -- 0x7f39cc13c7e0 con 0x7f39cc13c410 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39a7fff640 1 -- 10.20.193.61:0/3857376260 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9fd6863-f28a-4c0f-befd-40a634c44bbd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f39b801ca90 con 0x7f39cc13c410 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39a7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b9fd6863-f28a-4c0f-befd-40a634c44bbd", "id": 0}] 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stdout:0 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 10 monclient: shutdown 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 msgr2=0x7f39cc17ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.685 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c700 tx=0x7f39b800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 shutdown_connections 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f39cc180f30 0x7f39cc17ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f39cc160610 0x7f39cc17e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 --2- 10.20.193.61:0/3857376260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f39cc13c410 0x7f39cc17ba60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 >> 10.20.193.61:0/3857376260 conn(0x7f39cc0905a0 msgr2=0x7f39cc13e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 shutdown_connections 2026-02-22T20:52:01.686 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.673+0000 7f39d2245640 1 -- 10.20.193.61:0/3857376260 wait complete. 2026-02-22T20:52:01.694 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new a57b05b8-207a-47ab-a248-c9deb6dea261 1 2026-02-22T20:52:01.717 INFO:tasks.ceph.mgr.x.trial061.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-22T20:52:01.723 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.713+0000 7f9c498c7280 -1 mgr[py] Loading module influx in main interpreter 2026-02-22T20:52:01.725 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.713+0000 7f9c498c7280 -1 mgr[py] Loading module alerts in main interpreter 2026-02-22T20:52:01.727 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.717+0000 7f9c498c7280 -1 mgr[py] Loading module volumes in main interpreter 2026-02-22T20:52:01.755 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.745+0000 7f9c498c7280 -1 mgr[py] Loading module rgw in main interpreter 2026-02-22T20:52:01.759 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.749+0000 7f9c498c7280 -1 mgr[py] Loading module iostat in main interpreter 2026-02-22T20:52:01.760 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.749+0000 7f9c498c7280 -1 mgr[py] Loading module progress in main interpreter 2026-02-22T20:52:01.763 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.753+0000 7f9c498c7280 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-22T20:52:01.766 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.753+0000 7f9c498c7280 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-22T20:52:01.778 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 10 monclient: get_monmap_and_config 2026-02-22T20:52:01.778 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.778 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 10 monclient: monmap: 2026-02-22T20:52:01.778 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:01.770812+0000 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:01.770812+0000 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:01.779 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 1 Processor -- start 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 1 -- start start 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.765+0000 7f1d57f5c640 10 monclient: init 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1d5013c410 0x7f1d5013c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.788 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-c con 0x7f1d5013c410 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1d5013f300 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1d5013fe40 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d50092c20 con 0x7f1d5013f300 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d500916d0 con 0x7f1d5013fe40 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5008fe40 con 0x7f1d5013c410 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): authenticate will time out at 533.492435s 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1d5013c410 0x7f1d5013c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1d5013c410 0x7f1d5013c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58648/0 (socket says 10.20.193.61:58648) 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 -- 10.20.193.61:0/4040740547 learned_addr learned my addr 10.20.193.61:0/4040740547 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:01.789 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): get_auth_request con 0x7f1d5013c410 auth_method 0 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d564d2640 1 -- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 legacy=0x7f1d501a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d564d2640 1 --1- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 0x7f1d501a1640 :-1 s=OPENED pgs=12 cs=1 l=1).write_message error sending 0x7f1d500916d0, (32) Broken pipe 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d564d2640 1 --1- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 0x7f1d501a1640 :-1 s=OPENED pgs=12 cs=1 l=1).write_event send msg failed 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d564d2640 1 --1- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 0x7f1d501a1640 :-1 s=OPENED pgs=12 cs=1 l=1).write_event send msg failed 2026-02-22T20:52:01.790 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d564d2640 1 --1- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 0x7f1d501a1640 :-1 s=OPENED pgs=12 cs=1 l=1).fault on lossy channel, failing 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.61:6789/0 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient(hunting): handle_auth_done global_id 4126 payload 274 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 -- 10.20.193.61:0/4040740547 >> v1:10.20.193.61:6789/0 conn(0x7f1d5013fe40 legacy=0x7f1d501a1640 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 -- 10.20.193.61:0/4040740547 >> v1:10.20.193.7:6789/0 conn(0x7f1d5013f300 legacy=0x7f1d5013f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 monclient: found mon.noname-c 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 -- 10.20.193.61:0/4040740547 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d500929a0 con 0x7f1d5013c410 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d55cd1640 1 --2- 10.20.193.61:0/4040740547 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013c410 0x7f1d5013c7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d50053740 tx=0x7f1d4001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8692d69c8a467452 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 1 -- 10.20.193.61:0/4040740547 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400b0070 con 0x7f1d5013c410 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.791 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: dump: 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.792 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 1 -- 10.20.193.61:0/4040740547 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d400ab600 con 0x7f1d5013c410 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 1 -- 10.20.193.61:0/4040740547 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400ab9d0 con 0x7f1d5013c410 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d54ccf640 10 monclient: dump: 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.793 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 5 monclient: authenticate success, global_id 4126 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 4 set_mon_vals no callback set 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: shutdown 2026-02-22T20:52:01.794 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- 10.20.193.61:0/4040740547 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013c410 msgr2=0x7f1d5013c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- 10.20.193.61:0/4040740547 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013c410 0x7f1d5013c7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d50053740 tx=0x7f1d4001c460 comp rx=0 tx=0).stop 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- 10.20.193.61:0/4040740547 shutdown_connections 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- 10.20.193.61:0/4040740547 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013c410 0x7f1d5013c7e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- 10.20.193.61:0/4040740547 >> 10.20.193.61:0/4040740547 conn(0x7f1d500905a0 msgr2=0x7f1d500909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- 10.20.193.61:0/4040740547 shutdown_connections 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- 10.20.193.61:0/4040740547 wait complete. 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: monmap: 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:01.795 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 Processor -- start 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- start start 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: init 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:01.796 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 0x7f1d5012bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-c con 0x7f1d5013c410 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-b con 0x7f1d5013f300 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d5013fe40 0x7f1d5012a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): picked mon.noname-a con 0x7f1d5013fe40 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501a5700 con 0x7f1d5013fe40 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501a5580 con 0x7f1d5013f300 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1d501a5880 con 0x7f1d5013c410 2026-02-22T20:52:01.797 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d57f5c640 10 monclient(hunting): authenticate will time out at 533.495894s 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.769+0000 7f1d554d0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58664/0 (socket says 10.20.193.61:58664) 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 -- 10.20.193.61:0/3984024427 learned_addr learned my addr 10.20.193.61:0/3984024427 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): get_auth_request con 0x7f1d5013f300 auth_method 0 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 0x7f1d5012bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.798 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d564d2640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d5013fe40 0x7f1d5012a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 10 monclient(hunting): get_auth_request con 0x7f1d5013c410 auth_method 0 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d564d2640 10 monclient(hunting): get_auth_request con 0x7f1d5013fe40 auth_method 0 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d564d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d564d2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d564d2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient(hunting): handle_auth_done global_id 4129 payload 824 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 -- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 msgr2=0x7f1d5012bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.799 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 0x7f1d5012bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 -- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d5013fe40 msgr2=0x7f1d5012a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d5013fe40 0x7f1d5012a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 monclient: found mon.noname-b 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 -- 10.20.193.61:0/3984024427 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5012d290 con 0x7f1d5013f300 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d55cd1640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 0x7f1d5012bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d554d0640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c4f0 tx=0x7f1d4400c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44016020 con 0x7f1d5013f300 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.800 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: dump: 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.801 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44005220 con 0x7f1d5013f300 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 5 monclient: authenticate success, global_id 4129 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440068d0 con 0x7f1d5013f300 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: dump: 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.802 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3ffff640 4 set_mon_vals no callback set 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _renew_subs 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 1 -- 10.20.193.61:0/3984024427 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d50056e10 con 0x7f1d5013f300 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _renew_subs 2026-02-22T20:52:01.803 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 1 -- 10.20.193.61:0/3984024427 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5013bea0 con 0x7f1d5013f300 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d57f5c640 1 -- 10.20.193.61:0/3984024427 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d500382a0 con 0x7f1d5013f300 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f1d44007030 con 0x7f1d5013f300 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7f1d4401b400 con 0x7f1d5013f300 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f1d44020020 con 0x7f1d5013f300 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.804 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.773+0000 7f1d3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:01.847 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d57f5c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a57b05b8-207a-47ab-a248-c9deb6dea261", "id": 1}] 2026-02-22T20:52:01.847 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d57f5c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a57b05b8-207a-47ab-a248-c9deb6dea261", "id": 1}] 2026-02-22T20:52:01.847 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d57f5c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.847 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d57f5c640 1 -- 10.20.193.61:0/3984024427 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a57b05b8-207a-47ab-a248-c9deb6dea261", "id": 1} v 0) -- 0x7f1d5005fc70 con 0x7f1d5013f300 2026-02-22T20:52:01.849 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d3e7fc640 1 -- 10.20.193.61:0/3984024427 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a57b05b8-207a-47ab-a248-c9deb6dea261", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1d44012630 con 0x7f1d5013f300 2026-02-22T20:52:01.850 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a57b05b8-207a-47ab-a248-c9deb6dea261", "id": 1}] 2026-02-22T20:52:01.850 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.837+0000 7f1d3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:01.850 INFO:teuthology.orchestra.run.trial061.stdout:1 2026-02-22T20:52:01.854 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 10 monclient: shutdown 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 -- 10.20.193.61:0/3984024427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 msgr2=0x7f1d50129f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c4f0 tx=0x7f1d4400c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 -- 10.20.193.61:0/3984024427 shutdown_connections 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d5013fe40 0x7f1d5012a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d5013f300 0x7f1d50129f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 --2- 10.20.193.61:0/3984024427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d5013c410 0x7f1d5012bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 -- 10.20.193.61:0/3984024427 >> 10.20.193.61:0/3984024427 conn(0x7f1d500905a0 msgr2=0x7f1d5008d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 -- 10.20.193.61:0/3984024427 shutdown_connections 2026-02-22T20:52:01.855 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.841+0000 7f1d17fff640 1 -- 10.20.193.61:0/3984024427 wait complete. 2026-02-22T20:52:01.866 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new 1e035cce-ceb4-4867-bd15-6b83dc07e33c 2 2026-02-22T20:52:01.889 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:01.877+0000 7f9c498c7280 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-22T20:52:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Starting 2026-02-22T20:52:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:52:01] 2026-02-22T20:52:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:52:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:52:01 2026-02-22T20:52:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:52:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:No pools available 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Starting 2026-02-22T20:52:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:ident set(), fault set() 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: {} 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Loading... 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:No stored events to load 2026-02-22T20:52:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Loaded [] historic events 2026-02-22T20:52:01.951 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: get_monmap_and_config 2026-02-22T20:52:01.951 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: monmap: 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:01.936780+0000 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:01.936780+0000 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:01.952 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:01.953 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:01.953 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Loaded OSDMap, ready. 2026-02-22T20:52:01.956 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 Processor -- start 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 -- start start 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: init 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbffc13c410 0x7fbffc13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc13c410 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13f300 0x7fbffc13f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.957 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): picked mon.noname-b con 0x7fbffc13f300 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbffc13fc70 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc092c20 con 0x7fbffc13fc70 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc08fe40 con 0x7fbffc13c410 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc0916d0 con 0x7fbffc13f300 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient(hunting): authenticate will time out at 533.658168s 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbffc13c410 0x7fbffc13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbffc13c410 0x7fbffc13c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58686/0 (socket says 10.20.193.61:58686) 2026-02-22T20:52:01.958 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 -- 10.20.193.61:0/3211572827 learned_addr learned my addr 10.20.193.61:0/3211572827 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): get_auth_request con 0x7fbffc13c410 auth_method 0 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient(hunting): handle_auth_done global_id 4141 payload 274 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 -- 10.20.193.61:0/3211572827 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13f300 msgr2=0x7fbffc13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc001ce9640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13f300 0x7fbffc13f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13f300 0x7fbffc13f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 -- 10.20.193.61:0/3211572827 >> v1:10.20.193.61:6789/0 conn(0x7fbffc13fc70 legacy=0x7fbffc1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.959 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 monclient: found mon.noname-c 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 -- 10.20.193.61:0/3211572827 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc1400f0 con 0x7fbffc13c410 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0024ea640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13c410 0x7fbffc13c7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009910 tx=0x7fbfec01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16c204d75c9005ca server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 1 -- 10.20.193.61:0/3211572827 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b0070 con 0x7fbffc13c410 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: dump: 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.960 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 1 -- 10.20.193.61:0/3211572827 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0ab640 con 0x7fbffc13c410 2026-02-22T20:52:01.961 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 5 monclient: authenticate success, global_id 4141 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 1 -- 10.20.193.61:0/3211572827 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0aba10 con 0x7fbffc13c410 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc0014e8640 10 monclient: dump: 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.962 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.963 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.963 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.963 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.963 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:01.963 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.933+0000 7fc004775640 4 set_mon_vals no callback set 2026-02-22T20:52:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:recovery thread starting 2026-02-22T20:52:01.964 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: shutdown 2026-02-22T20:52:01.964 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.964 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3211572827 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13c410 msgr2=0x7fbffc13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.964 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13c410 0x7fbffc13c7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009910 tx=0x7fbfec01c500 comp rx=0 tx=0).stop 2026-02-22T20:52:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:starting setup 2026-02-22T20:52:01.965 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3211572827 shutdown_connections 2026-02-22T20:52:01.965 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13f300 0x7fbffc13f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.965 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- 10.20.193.61:0/3211572827 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13c410 0x7fbffc13c7e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.966 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3211572827 >> 10.20.193.61:0/3211572827 conn(0x7fbffc0905a0 msgr2=0x7fbffc0909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.966 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3211572827 shutdown_connections 2026-02-22T20:52:01.966 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3211572827 wait complete. 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:52:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: build_initial_monmap 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: monmap: 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.968 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:01.969 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:01.969 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:01.969 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:52:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:52:01.971 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 Processor -- start 2026-02-22T20:52:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:52:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:52:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:01.972 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- start start 2026-02-22T20:52:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:01.972 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: init 2026-02-22T20:52:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13c410 0x7fbffc150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc13c410 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbffc13f300 0x7fbffc150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): picked mon.noname-a con 0x7fbffc13f300 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:01.974 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): picked mon.noname-b con 0x7fbffc13fc70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc13cea0 con 0x7fbffc13f300 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc13cd20 con 0x7fbffc13fc70 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc1a4570 con 0x7fbffc13c410 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:01.975 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient(hunting): authenticate will time out at 533.660942s 2026-02-22T20:52:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:setting log level based on debug_mgr: DEBUG (20/20) 2026-02-22T20:52:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:52:01.976 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58698/0 (socket says 10.20.193.61:58698) 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 -- 10.20.193.61:0/3025614309 learned_addr learned my addr 10.20.193.61:0/3025614309 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): get_auth_request con 0x7fbffc13fc70 auth_method 0 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.977 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:52:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:52:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:52:01.978 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:01.978 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:52:01.978 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc001ce9640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbffc13f300 0x7fbffc150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.979 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:01.979 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc001ce9640 10 monclient(hunting): get_auth_request con 0x7fbffc13f300 auth_method 0 2026-02-22T20:52:01.979 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc001ce9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.979 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc001ce9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.979 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc001ce9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:01.980 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc0024ea640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13c410 0x7fbffc150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:01.980 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc0024ea640 10 monclient(hunting): get_auth_request con 0x7fbffc13c410 auth_method 0 2026-02-22T20:52:01.980 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc0024ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:01.980 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc0024ea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:01.981 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc0024ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:01.981 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient(hunting): handle_auth_done global_id 4150 payload 824 2026-02-22T20:52:01.981 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 -- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13c410 msgr2=0x7fbffc150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.981 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13c410 0x7fbffc150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 -- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbffc13f300 msgr2=0x7fbffc150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbffc13f300 0x7fbffc150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient: _finish_hunting 0 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 monclient: found mon.noname-b 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 -- 10.20.193.61:0/3025614309 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc13bd70 con 0x7fbffc13fc70 2026-02-22T20:52:01.982 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc002ceb640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbff800cbb0 tx=0x7fbff800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:52:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:52:01.983 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800ad40 con 0x7fbffc13fc70 2026-02-22T20:52:01.983 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.983 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: dump: 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:01.984 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8003a20 con 0x7fbffc13fc70 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 5 monclient: authenticate success, global_id 4150 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _renew_subs 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc08aac0 con 0x7fbffc13fc70 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8003dd0 con 0x7fbffc13fc70 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc000ce7640 4 set_mon_vals no callback set 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: dump: 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:01.985 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:01.986 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:01.986 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:52:01.986 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _renew_subs 2026-02-22T20:52:01.986 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.986 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc12cf20 con 0x7fbffc13fc70 2026-02-22T20:52:01.987 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: queue is initialized 2026-02-22T20:52:01.987 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: starting 2026-02-22T20:52:01.987 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:PerfHandler: starting 2026-02-22T20:52:01.987 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.987 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.987 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.987 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc13c7e0 con 0x7fbffc13fc70 2026-02-22T20:52:01.987 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:sequence=0, tasks_by_sequence={}, tasks_by_id={} 2026-02-22T20:52:01.988 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TaskHandler: starting 2026-02-22T20:52:01.988 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 2) ==== 48476+0+0 (secure 0 0 0) 0x7fbff8023060 con 0x7fbffc13fc70 2026-02-22T20:52:01.988 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7fbff804e690 con 0x7fbffc13fc70 2026-02-22T20:52:01.988 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7fbff801bd20 con 0x7fbffc13fc70 2026-02-22T20:52:01.988 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:01.988 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.937+0000 7fbfe2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: queue is initialized 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: starting 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:setup complete 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning 4 to execute more jobs concurrently 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1771793521.945872.0 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1771793521.945872.0] starting 2026-02-22T20:52:01.991 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1771793521.9461102.1 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1771793521.9461102.1] starting 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1771793521.946447.2 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1771793521.946447.2] starting 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name cloner.1771793521.9467263.3 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [cloner.1771793521.9467263.3] starting 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:tick thread cloner.tick starting 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning 4 to execute more jobs concurrently 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1771793521.9474673.0 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.992 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:user is not opted-in 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waiting for mgr to warm up 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1771793521.9474673.0] starting 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1771793521.948032.1 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1771793521.948032.1] starting 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1771793521.9482865.2 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1771793521.9482865.2] starting 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:spawning new thread with name purgejob.1771793521.9484541.3 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:thread [purgejob.1771793521.9484541.3] starting 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:tick thread purgejob.tick starting 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locking with 5 timeout 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:01.993 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:mgr_util:locked 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.969+0000 7fc004775640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1e035cce-ceb4-4867-bd15-6b83dc07e33c", "id": 2}] 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.969+0000 7fc004775640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1e035cce-ceb4-4867-bd15-6b83dc07e33c", "id": 2}] 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.969+0000 7fc004775640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.969+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e035cce-ceb4-4867-bd15-6b83dc07e33c", "id": 2} v 0) -- 0x7fbffc05fc70 con 0x7fbffc13fc70 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fbfe2ffd640 1 -- 10.20.193.61:0/3025614309 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e035cce-ceb4-4867-bd15-6b83dc07e33c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbff8016e10 con 0x7fbffc13fc70 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fbfe2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1e035cce-ceb4-4867-bd15-6b83dc07e33c", "id": 2}] 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fbfe2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:01.994 INFO:teuthology.orchestra.run.trial061.stdout:2 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 10 monclient: shutdown 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 msgr2=0x7fbffc129f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbff800cbb0 tx=0x7fbff800a430 comp rx=0 tx=0).stop 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 shutdown_connections 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbffc13fc70 0x7fbffc129f30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbffc13f300 0x7fbffc150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.995 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 --2- 10.20.193.61:0/3025614309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbffc13c410 0x7fbffc150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:01.996 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 >> 10.20.193.61:0/3025614309 conn(0x7fbffc0905a0 msgr2=0x7fbffc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:01.996 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 shutdown_connections 2026-02-22T20:52:01.996 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:01.973+0000 7fc004775640 1 -- 10.20.193.61:0/3025614309 wait complete. 2026-02-22T20:52:01.996 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new 49157d62-16e1-4563-9c5d-95d0bde3e8a7 3 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: get_monmap_and_config 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: monmap: 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:02.046116+0000 2026-02-22T20:52:02.054 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:02.046116+0000 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 Processor -- start 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 -- start start 2026-02-22T20:52:02.055 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: init 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f42d8139f20 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f42d815e260 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f42d817fd60 0x7f42d81a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.060 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-c con 0x7f42d817fd60 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d8088ef0 con 0x7f42d815e260 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d808b940 con 0x7f42d8139f20 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f42d8089120 con 0x7f42d817fd60 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42e04d7640 10 monclient(hunting): authenticate will time out at 533.767619s 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42de24c640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f42d8139f20 0x7f42d813a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.61:43470/0 (socket says 10.20.193.61:43470) 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42de24c640 1 -- 10.20.193.61:0/3974913510 learned_addr learned my addr 10.20.193.61:0/3974913510 (peer_addr_for_me v1:10.20.193.61:0/0) 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 1 --2- 10.20.193.61:0/3974913510 >> v2:10.20.193.61:3300/0 conn(0x7f42d817fd60 0x7f42d81a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): get_auth_request con 0x7f42d817fd60 auth_method 0 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient(hunting): handle_auth_done global_id 4159 payload 274 2026-02-22T20:52:02.061 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 1 -- 10.20.193.61:0/3974913510 >> v1:10.20.193.61:6789/0 conn(0x7f42d8139f20 legacy=0x7f42d813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 1 -- 10.20.193.61:0/3974913510 >> v1:10.20.193.7:6789/0 conn(0x7f42d815e260 legacy=0x7f42d817e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 1 monclient: found mon.noname-c 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.041+0000 7f42dea4d640 1 -- 10.20.193.61:0/3974913510 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d808a780 con 0x7f42d817fd60 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 1 --2- 10.20.193.61:0/3974913510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d817fd60 0x7f42d81a0140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42d80568b0 tx=0x7f42d401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c335adfae58ed2a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 1 -- 10.20.193.61:0/3974913510 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40b2070 con 0x7f42d817fd60 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: dump: 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.062 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 1 -- 10.20.193.61:0/3974913510 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d40a58c0 con 0x7f42d817fd60 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 5 monclient: authenticate success, global_id 4159 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 1 -- 10.20.193.61:0/3974913510 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d40a5cb0 con 0x7f42d817fd60 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dd24a640 10 monclient: dump: 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.063 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 4 set_mon_vals no callback set 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: shutdown 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/3974913510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d817fd60 msgr2=0x7f42d81a0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 --2- 10.20.193.61:0/3974913510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d817fd60 0x7f42d81a0140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42d80568b0 tx=0x7f42d401c7e0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/3974913510 shutdown_connections 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 --2- 10.20.193.61:0/3974913510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d817fd60 0x7f42d81a0140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/3974913510 >> 10.20.193.61:0/3974913510 conn(0x7f42d808fa30 msgr2=0x7f42d808bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/3974913510 shutdown_connections 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/3974913510 wait complete. 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: monmap: 2026-02-22T20:52:02.064 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 Processor -- start 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- start start 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: init 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-b con 0x7f42d8139f20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42d815e260 0x7f42d813e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-c con 0x7f42d815e260 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.065 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42d817fd60 0x7f42d813e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): picked mon.noname-a con 0x7f42d817fd60 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42d81a3020 con 0x7f42d817fd60 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f42d81a2ea0 con 0x7f42d8139f20 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f42d81a31a0 con 0x7f42d815e260 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient(hunting): authenticate will time out at 533.771240s 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58734/0 (socket says 10.20.193.61:58734) 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 -- 10.20.193.61:0/605165241 learned_addr learned my addr 10.20.193.61:0/605165241 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): get_auth_request con 0x7f42d8139f20 auth_method 0 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.066 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dda4b640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42d815e260 0x7f42d813e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42d817fd60 0x7f42d813e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dda4b640 10 monclient(hunting): get_auth_request con 0x7f42d815e260 auth_method 0 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dda4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dda4b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dda4b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 10 monclient(hunting): get_auth_request con 0x7f42d817fd60 auth_method 0 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dea4d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient(hunting): handle_auth_done global_id 4165 payload 824 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 -- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42d815e260 msgr2=0x7f42d813e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42d815e260 0x7f42d813e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 -- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42d817fd60 msgr2=0x7f42d813e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42d817fd60 0x7f42d813e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 monclient: found mon.noname-b 2026-02-22T20:52:02.067 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 -- 10.20.193.61:0/605165241 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d813bab0 con 0x7f42d8139f20 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42de24c640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c700 tx=0x7f42c800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d8139f20 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: dump: 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.068 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c8005bd0 con 0x7f42d8139f20 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 5 monclient: authenticate success, global_id 4165 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _renew_subs 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d813ff20 con 0x7f42d8139f20 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8007070 con 0x7f42d8139f20 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42beffd640 10 monclient: dump: 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.069 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _renew_subs 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42dca49640 4 set_mon_vals no callback set 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.045+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81404f0 con 0x7f42d8139f20 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42e04d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42e04d7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 2) ==== 48476+0+0 (secure 0 0 0) 0x7f42c8007210 con 0x7f42d8139f20 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42e04d7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d80382a0 con 0x7f42d8139f20 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f42c804cf90 con 0x7f42d8139f20 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f42c801a360 con 0x7f42d8139f20 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.070 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.049+0000 7f42beffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:02.093 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.081+0000 7f42e04d7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "49157d62-16e1-4563-9c5d-95d0bde3e8a7", "id": 3}] 2026-02-22T20:52:02.093 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.081+0000 7f42e04d7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "49157d62-16e1-4563-9c5d-95d0bde3e8a7", "id": 3}] 2026-02-22T20:52:02.093 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.081+0000 7f42e04d7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.093 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.081+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49157d62-16e1-4563-9c5d-95d0bde3e8a7", "id": 3} v 0) -- 0x7f42d805fc70 con 0x7f42d8139f20 2026-02-22T20:52:02.095 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42beffd640 1 -- 10.20.193.61:0/605165241 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49157d62-16e1-4563-9c5d-95d0bde3e8a7", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f42c800a5e0 con 0x7f42d8139f20 2026-02-22T20:52:02.095 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "49157d62-16e1-4563-9c5d-95d0bde3e8a7", "id": 3}] 2026-02-22T20:52:02.095 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42beffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:02.096 INFO:teuthology.orchestra.run.trial061.stdout:3 2026-02-22T20:52:02.096 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 10 monclient: shutdown 2026-02-22T20:52:02.096 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 msgr2=0x7f42d813f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c700 tx=0x7f42c800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 shutdown_connections 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42d817fd60 0x7f42d813e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42d815e260 0x7f42d813e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 --2- 10.20.193.61:0/605165241 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f42d8139f20 0x7f42d813f590 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 >> 10.20.193.61:0/605165241 conn(0x7f42d808fa30 msgr2=0x7f42d813b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 shutdown_connections 2026-02-22T20:52:02.097 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.085+0000 7f42e04d7640 1 -- 10.20.193.61:0/605165241 wait complete. 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:52:02.103 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.104 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.105 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.106 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.107 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.108 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.108 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.108 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.108 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.108 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.109 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new 85daa601-dea8-4ae4-96a9-e63025b59fa3 4 2026-02-22T20:52:02.167 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: get_monmap_and_config 2026-02-22T20:52:02.167 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.167 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: monmap: 2026-02-22T20:52:02.167 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.167 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:02.159912+0000 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:02.159912+0000 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 Processor -- start 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 -- start start 2026-02-22T20:52:02.168 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: init 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f103013c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-b con 0x7f103013c410 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f103013f300 0x7f103013f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-a con 0x7f103013f300 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f103013fc70 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1030092c20 con 0x7f103013fc70 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f103008fe40 con 0x7f103013f300 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f10300916d0 con 0x7f103013c410 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient(hunting): authenticate will time out at 533.881707s 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102ffff640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f103013fc70 0x7f10301a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.61:43476/0 (socket says 10.20.193.61:43476) 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102ffff640 1 -- 10.20.193.61:0/4151480264 learned_addr learned my addr 10.20.193.61:0/4151480264 (peer_addr_for_me v1:10.20.193.61:0/0) 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 --2- 10.20.193.61:0/4151480264 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f103013c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): get_auth_request con 0x7f103013c410 auth_method 0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 1 --2- 10.20.193.61:0/4151480264 >> v2:10.20.193.7:3300/0 conn(0x7f103013f300 0x7f103013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): get_auth_request con 0x7f103013f300 auth_method 0 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.169 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543198577 0 0) 0x7f1030092c20 con 0x7f103013fc70 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient(hunting): my global_id is 4168 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1014003620 con 0x7f103013fc70 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient(hunting): handle_auth_done global_id 4139 payload 274 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 -- 10.20.193.61:0/4151480264 >> v2:10.20.193.7:3300/0 conn(0x7f103013f300 msgr2=0x7f103013f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 --2- 10.20.193.61:0/4151480264 >> v2:10.20.193.7:3300/0 conn(0x7f103013f300 0x7f103013f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 -- 10.20.193.61:0/4151480264 >> v1:10.20.193.61:6789/0 conn(0x7f103013fc70 legacy=0x7f10301a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1181816074 0 0) 0x7f1014003620 con 0x7f103013fc70 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 -- 10.20.193.61:0/4151480264 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301400f0 con 0x7f103013c410 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102f7fe640 1 --2- 10.20.193.61:0/4151480264 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f103013c7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f103005ceb0 tx=0x7f101c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec992de1c6c56c82 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.170 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c0b0070 con 0x7f103013c410 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: dump: 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 5 monclient: authenticate success, global_id 4139 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c0ab400 con 0x7f103013c410 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 1 -- 10.20.193.61:0/4151480264 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10240031e0 con 0x7f103013c410 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f102e7fc640 10 monclient: dump: 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:02.171 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.157+0000 7f1035adc640 4 set_mon_vals no callback set 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: shutdown 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/4151480264 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 msgr2=0x7f103013c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- 10.20.193.61:0/4151480264 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f103013c7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f103005ceb0 tx=0x7f101c01c3a0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/4151480264 shutdown_connections 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- 10.20.193.61:0/4151480264 >> v2:10.20.193.7:3300/0 conn(0x7f103013f300 0x7f103013f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- 10.20.193.61:0/4151480264 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f103013c7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/4151480264 >> 10.20.193.61:0/4151480264 conn(0x7f10300905a0 msgr2=0x7f10300909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/4151480264 shutdown_connections 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/4151480264 wait complete. 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: monmap: 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 Processor -- start 2026-02-22T20:52:02.172 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- start start 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: init 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f1030150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-c con 0x7f103013c410 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-b con 0x7f103013f300 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f103013fc70 0x7f1030129f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.173 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): picked mon.noname-a con 0x7f103013fc70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f103013cea0 con 0x7f103013fc70 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f103013cd20 con 0x7f103013f300 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f10301a4570 con 0x7f103013c410 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient(hunting): authenticate will time out at 533.885376s 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58746/0 (socket says 10.20.193.61:58746) 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f1030150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 -- 10.20.193.61:0/178818645 learned_addr learned my addr 10.20.193.61:0/178818645 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): get_auth_request con 0x7f103013f300 auth_method 0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): get_auth_request con 0x7f103013c410 auth_method 0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f103013fc70 0x7f1030129f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): get_auth_request con 0x7f103013fc70 auth_method 0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient(hunting): handle_auth_done global_id 4171 payload 824 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 -- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 msgr2=0x7f1030150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f1030150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 -- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f103013fc70 msgr2=0x7f1030129f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f103013fc70 0x7f1030129f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 monclient: found mon.noname-b 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 -- 10.20.193.61:0/178818645 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103008aac0 con 0x7f103013f300 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102effd640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1020009430 tx=0x7f102000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.174 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020017070 con 0x7f103013f300 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: dump: 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102000c8e0 con 0x7f103013f300 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 5 monclient: authenticate success, global_id 4171 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _renew_subs 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103013eed0 con 0x7f103013f300 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102000ccb0 con 0x7f103013f300 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 10 monclient: dump: 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f102dffb640 4 set_mon_vals no callback set 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _renew_subs 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103012d790 con 0x7f103013f300 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.175 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff0005190 con 0x7f103013f300 2026-02-22T20:52:02.176 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 2) ==== 48476+0+0 (secure 0 0 0) 0x7f1020023060 con 0x7f103013f300 2026-02-22T20:52:02.176 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.161+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f102004d650 con 0x7f103013f300 2026-02-22T20:52:02.176 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.165+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f1020016600 con 0x7f103013f300 2026-02-22T20:52:02.176 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.165+0000 7f100bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.176 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.165+0000 7f100bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:02.208 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "85daa601-dea8-4ae4-96a9-e63025b59fa3", "id": 4}] 2026-02-22T20:52:02.208 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "85daa601-dea8-4ae4-96a9-e63025b59fa3", "id": 4}] 2026-02-22T20:52:02.208 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.208 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "85daa601-dea8-4ae4-96a9-e63025b59fa3", "id": 4} v 0) -- 0x7f0ff0005480 con 0x7f103013f300 2026-02-22T20:52:02.209 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f100bfff640 1 -- 10.20.193.61:0/178818645 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85daa601-dea8-4ae4-96a9-e63025b59fa3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1020004540 con 0x7f103013f300 2026-02-22T20:52:02.209 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f100bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "85daa601-dea8-4ae4-96a9-e63025b59fa3", "id": 4}] 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f100bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stdout:4 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 10 monclient: shutdown 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 msgr2=0x7f1030150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1020009430 tx=0x7f102000ed60 comp rx=0 tx=0).stop 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 shutdown_connections 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f103013fc70 0x7f1030129f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f103013f300 0x7f1030150c40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 --2- 10.20.193.61:0/178818645 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f103013c410 0x7f1030150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 >> 10.20.193.61:0/178818645 conn(0x7f10300905a0 msgr2=0x7f1030055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 shutdown_connections 2026-02-22T20:52:02.210 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.197+0000 7f1035adc640 1 -- 10.20.193.61:0/178818645 wait complete. 2026-02-22T20:52:02.221 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd new 1b76906c-4806-416b-a8e1-e379d468ee76 5 2026-02-22T20:52:02.290 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 10 monclient: get_monmap_and_config 2026-02-22T20:52:02.290 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.290 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 10 monclient: monmap: 2026-02-22T20:52:02.290 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:52:02.270638+0000 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:52:02.270638+0000 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:02.291 INFO:teuthology.orchestra.run.trial061.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 1 Processor -- start 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 1 -- start start 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.265+0000 7f37d8e8b640 10 monclient: init 2026-02-22T20:52:02.292 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37d405c2c0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-c con 0x7f37d408f760 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f37d4180c90 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:02.293 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d4060010 con 0x7f37d405c2c0 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d408af30 con 0x7f37d4180c90 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f37d408a720 con 0x7f37d408f760 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient(hunting): authenticate will time out at 533.992173s 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.294 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58752/0 (socket says 10.20.193.61:58752) 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 -- 10.20.193.61:0/765507250 learned_addr learned my addr 10.20.193.61:0/765507250 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): get_auth_request con 0x7f37d408f760 auth_method 0 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d2d76640 1 --1- 10.20.193.61:0/765507250 >> v1:10.20.193.61:6789/0 conn(0x7f37d4180c90 0x7f37d41a1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.61:43478/0 (socket says 10.20.193.61:43478) 2026-02-22T20:52:02.295 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient(hunting): handle_auth_done global_id 4174 payload 274 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 -- 10.20.193.61:0/765507250 >> v1:10.20.193.61:6789/0 conn(0x7f37d4180c90 legacy=0x7f37d41a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 -- 10.20.193.61:0/765507250 >> v1:10.20.193.7:6789/0 conn(0x7f37d405c2c0 legacy=0x7f37d408f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.296 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 monclient: found mon.noname-c 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 -- 10.20.193.61:0/765507250 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d403a0c0 con 0x7f37d408f760 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1d74640 1 --2- 10.20.193.61:0/765507250 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d408f760 0x7f37d4180750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0090a0 tx=0x7f37bc01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6f50baf87f7416 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.297 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 1 -- 10.20.193.61:0/765507250 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0b0070 con 0x7f37d408f760 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: dump: 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.298 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.299 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 1 -- 10.20.193.61:0/765507250 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37bc0ab640 con 0x7f37d408f760 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 1 -- 10.20.193.61:0/765507250 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0aba10 con 0x7f37d408f760 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 5 monclient: authenticate success, global_id 4174 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 4 set_mon_vals no callback set 2026-02-22T20:52:02.300 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d1573640 10 monclient: dump: 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.301 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: shutdown 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- 10.20.193.61:0/765507250 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d408f760 msgr2=0x7f37d4180750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/765507250 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d408f760 0x7f37d4180750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0090a0 tx=0x7f37bc01c500 comp rx=0 tx=0).stop 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- 10.20.193.61:0/765507250 shutdown_connections 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/765507250 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- 10.20.193.61:0/765507250 >> 10.20.193.61:0/765507250 conn(0x7f37d4038f20 msgr2=0x7f37d4039320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- 10.20.193.61:0/765507250 shutdown_connections 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- 10.20.193.61:0/765507250 wait complete. 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.302 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: monmap: 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:epoch 0 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 0.000000 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:created 0.000000 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:02.303 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 Processor -- start 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 1 -- start start 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.269+0000 7f37d8e8b640 10 monclient: init 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-b con 0x7f37d405c2c0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-a con 0x7f37d408f760 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 0x7f37d4126fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): picked mon.noname-c con 0x7f37d4180c90 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.304 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37d41a51c0 con 0x7f37d408f760 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f37d408ac50 con 0x7f37d405c2c0 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f37d41a5340 con 0x7f37d4180c90 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient(hunting): authenticate will time out at 533.996215s 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.61:3300/0 says I am v2:10.20.193.61:58760/0 (socket says 10.20.193.61:58760) 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 -- 10.20.193.61:0/1552266966 learned_addr learned my addr 10.20.193.61:0/1552266966 (peer_addr_for_me v2:10.20.193.61:0/0) 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): get_auth_request con 0x7f37d405c2c0 auth_method 0 2026-02-22T20:52:02.305 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d1d74640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d1d74640 10 monclient(hunting): get_auth_request con 0x7f37d408f760 auth_method 0 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.306 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient(hunting): handle_auth_done global_id 4180 payload 824 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2d76640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 0x7f37d4126fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 -- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 msgr2=0x7f37d4126fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 0x7f37d4126fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 -- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37d408f760 msgr2=0x7f37d4180750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 monclient: found mon.noname-b 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.307 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 -- 10.20.193.61:0/1552266966 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d405ddf0 con 0x7f37d405c2c0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2d76640 10 monclient: get_auth_request con 0x7f37d4180c90 auth_method 0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2d76640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 0x7f37d4126fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d2575640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f37c800c4f0 tx=0x7f37c800c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8016020 con 0x7f37d405c2c0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: dump: 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.308 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8005220 con 0x7f37d405c2c0 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.309 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80068d0 con 0x7f37d405c2c0 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d0d72640 4 set_mon_vals no callback set 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: dump: 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:epoch 1 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:election_strategy: 1 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.310 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 5 monclient: authenticate success, global_id 4180 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _renew_subs 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d412a970 con 0x7f37d405c2c0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _renew_subs 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d4129de0 con 0x7f37d405c2c0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 4 ==== mgrmap(e 2) ==== 48476+0+0 (secure 0 0 0) 0x7f37c8006a70 con 0x7f37d405c2c0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d408f050 con 0x7f37d405c2c0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (secure 0 0 0) 0x7f37c804d460 con 0x7f37d405c2c0 2026-02-22T20:52:02.311 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f37c8020020 con 0x7f37d405c2c0 2026-02-22T20:52:02.312 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.312 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.273+0000 7f37baffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:02.319 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.305+0000 7f37d8e8b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1b76906c-4806-416b-a8e1-e379d468ee76", "id": 5}] 2026-02-22T20:52:02.319 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.305+0000 7f37d8e8b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1b76906c-4806-416b-a8e1-e379d468ee76", "id": 5}] 2026-02-22T20:52:02.319 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.305+0000 7f37d8e8b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:52:02.319 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.305+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b76906c-4806-416b-a8e1-e379d468ee76", "id": 5} v 0) -- 0x7f37d418aed0 con 0x7f37d405c2c0 2026-02-22T20:52:02.321 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37baffd640 1 -- 10.20.193.61:0/1552266966 <== mon.1 v2:10.20.193.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b76906c-4806-416b-a8e1-e379d468ee76", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f37d405ddf0 con 0x7f37d405c2c0 2026-02-22T20:52:02.321 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1b76906c-4806-416b-a8e1-e379d468ee76", "id": 5}] 2026-02-22T20:52:02.321 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37baffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:02.321 INFO:teuthology.orchestra.run.trial061.stdout:5 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 10 monclient: shutdown 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 msgr2=0x7f37d418a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f37c800c4f0 tx=0x7f37c800c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 shutdown_connections 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37d4180c90 0x7f37d4126fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.322 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37d408f760 0x7f37d4180750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.323 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 --2- 10.20.193.61:0/1552266966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f37d405c2c0 0x7f37d418a990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.323 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 >> 10.20.193.61:0/1552266966 conn(0x7f37d4038f20 msgr2=0x7f37d4087550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.323 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 shutdown_connections 2026-02-22T20:52:02.323 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T20:52:02.309+0000 7f37d8e8b640 1 -- 10.20.193.61:0/1552266966 wait complete. 2026-02-22T20:52:02.323 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:52:02.330 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:52:02.331 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:52:02.332 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:52:02.333 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.334 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:02.335 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:02.336 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T20:52:02.336 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T20:52:02.338 INFO:tasks.ceph.osd.0:Started 2026-02-22T20:52:02.338 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T20:52:02.338 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T20:52:02.340 INFO:tasks.ceph.osd.1:Started 2026-02-22T20:52:02.340 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T20:52:02.340 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T20:52:02.342 INFO:tasks.ceph.osd.2:Started 2026-02-22T20:52:02.342 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T20:52:02.342 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T20:52:02.344 INFO:tasks.ceph.osd.3:Started 2026-02-22T20:52:02.344 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-22T20:52:02.344 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-22T20:52:02.346 INFO:tasks.ceph.osd.4:Started 2026-02-22T20:52:02.346 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-22T20:52:02.346 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-22T20:52:02.348 INFO:tasks.ceph.osd.5:Started 2026-02-22T20:52:02.348 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:02.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: get_monmap_and_config 2026-02-22T20:52:02.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: monmap: 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:02.409171+0000 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:02.409171+0000 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:02.415 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 Processor -- start 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 -- start start 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: init 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f519813f290 0x7f519813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): picked mon.noname-a con 0x7f519813f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f519813fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:02.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f51981a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): picked mon.noname-b con 0x7f519813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f519808fd70 con 0x7f519813fba0 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f519808e1f0 con 0x7f519813f290 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f519808ec90 con 0x7f519813c680 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient(hunting): authenticate will time out at 534.882051s 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f519813f290 0x7f519813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f51981a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f519813fba0 0x7f519813bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:49364/0 (socket says 10.20.193.7:49364) 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f51981a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33322/0 (socket says 10.20.193.7:33322) 2026-02-22T20:52:02.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 1 -- 10.20.193.7:0/448601912 learned_addr learned my addr 10.20.193.7:0/448601912 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f519813f290 0x7f519813f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57260/0 (socket says 10.20.193.7:57260) 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): get_auth_request con 0x7f519813f290 auth_method 0 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): get_auth_request con 0x7f519813c680 auth_method 0 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient(hunting): handle_auth_done global_id 4176 payload 274 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 -- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 msgr2=0x7f51981a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 --2- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f51981a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 -- 10.20.193.7:0/448601912 >> v1:10.20.193.7:6789/0 conn(0x7f519813fba0 legacy=0x7f519813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 monclient: found mon.noname-a 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 1 -- 10.20.193.7:0/448601912 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596603573 0 0) 0x7f5180002920 con 0x7f519813fba0 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 -- 10.20.193.7:0/448601912 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5198092bc0 con 0x7f519813f290 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:02.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5196d76640 1 --2- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813f290 0x7f519813f660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f518c004780 tx=0x7f518c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14d82c9aa5851ed server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 1 -- 10.20.193.7:0/448601912 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0b0070 con 0x7f519813f290 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: dump: 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.420 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 1 -- 10.20.193.7:0/448601912 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518c0ab600 con 0x7f519813f290 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 1 -- 10.20.193.7:0/448601912 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0ab9d0 con 0x7f519813f290 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 5 monclient: authenticate success, global_id 4176 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 4 set_mon_vals no callback set 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:02.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f5195d74640 10 monclient: dump: 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 10 monclient: shutdown 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 -- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813f290 msgr2=0x7f519813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.406+0000 7f519d082640 1 --2- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813f290 0x7f519813f660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f518c004780 tx=0x7f518c01c440 comp rx=0 tx=0).stop 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/448601912 shutdown_connections 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 --2- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f51981a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 --2- 10.20.193.7:0/448601912 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813f290 0x7f519813f660 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/448601912 >> 10.20.193.7:0/448601912 conn(0x7f5198093df0 msgr2=0x7f51980902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/448601912 shutdown_connections 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/448601912 wait complete. 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: build_initial_monmap 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: monmap: 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:02.423 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 Processor -- start 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- start start 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: init 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): picked mon.noname-c con 0x7f519813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f519813f290 0x7f519812a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): picked mon.noname-b con 0x7f519813f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): picked mon.noname-a con 0x7f519813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51981a46c0 con 0x7f519813fba0 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f51981a4540 con 0x7f519813f290 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f51981a4840 con 0x7f519813c680 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient(hunting): authenticate will time out at 534.884847s 2026-02-22T20:52:02.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33338/0 (socket says 10.20.193.7:33338) 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57272/0 (socket says 10.20.193.7:57272) 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 -- 10.20.193.7:0/3646458860 learned_addr learned my addr 10.20.193.7:0/3646458860 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): get_auth_request con 0x7f519813c680 auth_method 0 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): get_auth_request con 0x7f519813fba0 auth_method 0 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196575640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f519813f290 0x7f519812a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196575640 10 monclient(hunting): get_auth_request con 0x7f519813f290 auth_method 0 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient(hunting): handle_auth_done global_id 4157 payload 824 2026-02-22T20:52:02.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 -- 10.20.193.7:0/3646458860 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f519813f290 msgr2=0x7f519812a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f519813f290 0x7f519812a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 -- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 msgr2=0x7f519812a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 monclient: found mon.noname-c 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 -- 10.20.193.7:0/3646458860 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519812d790 con 0x7f519813c680 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5197577640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:02.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5196d76640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f518c01c480 tx=0x7f518c0191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0b0040 con 0x7f519813c680 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: dump: 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.429 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518c0b9070 con 0x7f519813c680 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0abbb0 con 0x7f519813c680 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: dump: 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:02.430 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f5195573640 4 set_mon_vals no callback set 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 5 monclient: authenticate success, global_id 4157 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _renew_subs 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519813ee90 con 0x7f519813c680 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _renew_subs 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f519812cc00 con 0x7f519813c680 2026-02-22T20:52:02.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519813f660 con 0x7f519813c680 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 2) ==== 48476+0+0 (secure 0 0 0) 0x7f518c003710 con 0x7f519813c680 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7f518c0e77d0 con 0x7f519813c680 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (secure 0 0 0) 0x7f518c016150 con 0x7f519813c680 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:02.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.410+0000 7f51777fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:02.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:02.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:02.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:02.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f519813c3a0 con 0x7f519813c680 2026-02-22T20:52:02.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f51777fe640 1 -- 10.20.193.7:0/3646458860 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (secure 0 0 0) 0x7f518c0a5e20 con 0x7f519813c680 2026-02-22T20:52:02.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f51777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:02.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f51777fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:02.443 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:02.443 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":8,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:02.319702+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:02.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 10 monclient: shutdown 2026-02-22T20:52:02.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:02.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 msgr2=0x7f5198129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f518c01c480 tx=0x7f518c0191e0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 shutdown_connections 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f519813fba0 0x7f519812a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f519813f290 0x7f519812a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 --2- 10.20.193.7:0/3646458860 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f519813c680 0x7f5198129e50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 >> 10.20.193.7:0/3646458860 conn(0x7f5198093df0 msgr2=0x7f5198055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 shutdown_connections 2026-02-22T20:52:02.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:02.438+0000 7f519d082640 1 -- 10.20.193.7:0/3646458860 wait complete. 2026-02-22T20:52:02.452 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T20:52:02.452 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T20:52:02.756 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T20:52:02.745+0000 7f5c2a4b6a40 -1 Falling back to public interface 2026-02-22T20:52:02.757 INFO:tasks.ceph.osd.4.trial061.stderr:2026-02-22T20:52:02.745+0000 7fa21982aa40 -1 Falling back to public interface 2026-02-22T20:52:02.760 INFO:tasks.ceph.osd.0.trial007.stderr:2026-02-22T20:52:02.758+0000 7ff184c2ba40 -1 Falling back to public interface 2026-02-22T20:52:02.760 INFO:tasks.ceph.osd.1.trial007.stderr:2026-02-22T20:52:02.758+0000 7f1f4be5ea40 -1 Falling back to public interface 2026-02-22T20:52:02.784 INFO:tasks.ceph.osd.2.trial007.stderr:2026-02-22T20:52:02.782+0000 7f6138a49a40 -1 Falling back to public interface 2026-02-22T20:52:02.784 INFO:tasks.ceph.osd.5.trial061.stderr:2026-02-22T20:52:02.773+0000 7f4bd6f87a40 -1 Falling back to public interface 2026-02-22T20:52:02.924 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:02.913+0000 7f9b73b69640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-22T20:52:02.924 INFO:tasks.ceph.mgr.x.trial061.stderr:2026-02-22T20:52:02.913+0000 7f9b73b69640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-22T20:52:03.057 DEBUG:teuthology.orchestra.run.trial007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:03.130 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: get_monmap_and_config 2026-02-22T20:52:03.131 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: build_initial_monmap 2026-02-22T20:52:03.131 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: monmap: 2026-02-22T20:52:03.131 INFO:teuthology.misc.health.trial007.stderr:epoch 0 2026-02-22T20:52:03.131 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:52:03.113921+0000 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:52:03.113921+0000 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:03.132 INFO:teuthology.misc.health.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:03.133 INFO:teuthology.misc.health.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:03.133 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.134 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 Processor -- start 2026-02-22T20:52:03.134 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 -- start start 2026-02-22T20:52:03.134 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: init 2026-02-22T20:52:03.134 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:03.134 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-22T20:52:03.135 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.135 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-b con 0x7f85e013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:03.135 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 0x7f85e013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-c con 0x7f85e013fba0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f85e013c4b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e008fd70 con 0x7f85e013c4b0 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f85e008e1f0 con 0x7f85e013fba0 2026-02-22T20:52:03.136 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85e008ec90 con 0x7f85e013f290 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85e5bc3640 10 monclient(hunting): authenticate will time out at 535.586862s 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33354/0 (socket says 10.20.193.7:33354) 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 -- 10.20.193.7:0/980690425 learned_addr learned my addr 10.20.193.7:0/980690425 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): get_auth_request con 0x7f85e013f290 auth_method 0 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:03.137 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:03.138 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:03.138 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:03.138 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:03.138 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 1 --2- 10.20.193.7:0/980690425 >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 0x7f85e013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 10 monclient(hunting): get_auth_request con 0x7f85e013fba0 auth_method 0 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient(hunting): handle_auth_done global_id 4160 payload 274 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 -- 10.20.193.7:0/980690425 >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 msgr2=0x7f85e013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 --2- 10.20.193.7:0/980690425 >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 0x7f85e013bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 -- 10.20.193.7:0/980690425 >> v1:10.20.193.61:6789/0 conn(0x7f85e013c4b0 legacy=0x7f85e01a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85df7fe640 1 -- 10.20.193.7:0/980690425 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e0092bc0 con 0x7f85e013f290 2026-02-22T20:52:03.139 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.110+0000 7f85deffd640 1 --2- 10.20.193.7:0/980690425 >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 0x7f85e013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 1 --2- 10.20.193.7:0/980690425 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0090a0 tx=0x7f85cc01c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15edf3ef1a9c69f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 1 -- 10.20.193.7:0/980690425 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0aa600 con 0x7f85e013f290 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: dump: 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 1 -- 10.20.193.7:0/980690425 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc0af070 con 0x7f85e013f290 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 1 -- 10.20.193.7:0/980690425 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0aa9c0 con 0x7f85e013f290 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 5 monclient: authenticate success, global_id 4160 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 4 set_mon_vals no callback set 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85de7fc640 10 monclient: dump: 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.140 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: shutdown 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/980690425 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 msgr2=0x7f85e013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/980690425 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0090a0 tx=0x7f85cc01c590 comp rx=0 tx=0).stop 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/980690425 shutdown_connections 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/980690425 >> v2:10.20.193.61:3300/0 conn(0x7f85e013fba0 0x7f85e013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/980690425 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013f290 0x7f85e013f660 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/980690425 >> 10.20.193.7:0/980690425 conn(0x7f85e0093df0 msgr2=0x7f85e00902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/980690425 shutdown_connections 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/980690425 wait complete. 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: build_initial_monmap 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: monmap: 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:epoch 0 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:created 0.000000 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 Processor -- start 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- start start 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: init 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85e013c4b0 0x7f85e0129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-b con 0x7f85e013c4b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85e013f290 0x7f85e012a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-a con 0x7f85e013f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): picked mon.noname-c con 0x7f85e013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85e0090de0 con 0x7f85e013f290 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f85e0090c60 con 0x7f85e013c4b0 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85e01a4710 con 0x7f85e013fba0 2026-02-22T20:52:03.141 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient(hunting): authenticate will time out at 535.590430s 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85e013f290 0x7f85e012a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:33370/0 (socket says 10.20.193.7:33370) 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 -- 10.20.193.7:0/2623428809 learned_addr learned my addr 10.20.193.7:0/2623428809 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): get_auth_request con 0x7f85e013fba0 auth_method 0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): get_auth_request con 0x7f85e013f290 auth_method 0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85e013c4b0 0x7f85e0129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): get_auth_request con 0x7f85e013c4b0 auth_method 0 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient(hunting): handle_auth_done global_id 4163 payload 824 2026-02-22T20:52:03.142 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 -- 10.20.193.7:0/2623428809 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85e013c4b0 msgr2=0x7f85e0129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85e013c4b0 0x7f85e0129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 -- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85e013f290 msgr2=0x7f85e012a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85e013f290 0x7f85e012a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 monclient: found mon.noname-c 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 -- 10.20.193.7:0/2623428809 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e012d590 con 0x7f85e013fba0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85dffff640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85d400cbf0 tx=0x7f85d400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d4016020 con 0x7f85e013fba0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: dump: 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:03.143 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d400ad50 con 0x7f85e013fba0 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d4012640 con 0x7f85e013fba0 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85ddffb640 4 set_mon_vals no callback set 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 10 monclient: dump: 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:03.144 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 5 monclient: authenticate success, global_id 4163 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _renew_subs 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e012d870 con 0x7f85e013fba0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _renew_subs 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e0057610 con 0x7f85e013fba0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 3) ==== 48568+0+0 (secure 0 0 0) 0x7f85d40127e0 con 0x7f85e013fba0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e013f660 con 0x7f85e013fba0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 --2- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 0x7f85b005ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.114+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7f85d404e530 con 0x7f85e013fba0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85df7fe640 1 --2- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 0x7f85b005ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:03.145 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85df7fe640 10 monclient: get_auth_request con 0x7f85b003a970 auth_method 0 2026-02-22T20:52:03.146 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85df7fe640 1 --2- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 0x7f85b005ae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85cc006d40 tx=0x7f85cc0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:03.146 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f85d4020020 con 0x7f85e013fba0 2026-02-22T20:52:03.146 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85bbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:03.146 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.118+0000 7f85bbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:03.204 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:03.204 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:03.204 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:03.204 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85e005fb70 con 0x7f85e013fba0 2026-02-22T20:52:03.205 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85bbfff640 1 -- 10.20.193.7:0/2623428809 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (secure 0 0 0) 0x7f85e008fd70 con 0x7f85e013fba0 2026-02-22T20:52:03.205 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85bbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:03.205 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85bbfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:03.205 INFO:teuthology.misc.health.trial007.stdout: 2026-02-22T20:52:03.205 INFO:teuthology.misc.health.trial007.stdout:{"epoch":8,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:02.319702+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:03.206 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 msgr2=0x7f85b005ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.206 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 0x7f85b005ae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85cc006d40 tx=0x7f85cc0a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:03.206 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 10 monclient: shutdown 2026-02-22T20:52:03.206 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 msgr2=0x7f85e012a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85d400cbf0 tx=0x7f85d400a430 comp rx=0 tx=0).stop 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 shutdown_connections 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85e013fba0 0x7f85e012a8d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85e013f290 0x7f85e012a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85b003a970 0x7f85b005ae20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 --2- 10.20.193.7:0/2623428809 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85e013c4b0 0x7f85e0129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 >> 10.20.193.7:0/2623428809 conn(0x7f85e0093df0 msgr2=0x7f85e0055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 shutdown_connections 2026-02-22T20:52:03.207 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:03.202+0000 7f85e5bc3640 1 -- 10.20.193.7:0/2623428809 wait complete. 2026-02-22T20:52:03.214 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-22T20:52:03.803 INFO:tasks.ceph.osd.0.trial007.stderr:2026-02-22T20:52:03.802+0000 7ff184c2ba40 -1 osd.0 0 log_to_monitors true 2026-02-22T20:52:03.815 INFO:tasks.ceph.osd.4.trial061.stderr:2026-02-22T20:52:03.805+0000 7fa21982aa40 -1 osd.4 0 log_to_monitors true 2026-02-22T20:52:03.834 INFO:tasks.ceph.osd.5.trial061.stderr:2026-02-22T20:52:03.821+0000 7f4bd6f87a40 -1 osd.5 0 log_to_monitors true 2026-02-22T20:52:03.836 INFO:tasks.ceph.osd.1.trial007.stderr:2026-02-22T20:52:03.834+0000 7f1f4be5ea40 -1 osd.1 0 log_to_monitors true 2026-02-22T20:52:03.865 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T20:52:03.853+0000 7f5c2a4b6a40 -1 osd.3 0 log_to_monitors true 2026-02-22T20:52:03.882 INFO:tasks.ceph.osd.2.trial007.stderr:2026-02-22T20:52:03.878+0000 7f6138a49a40 -1 osd.2 0 log_to_monitors true 2026-02-22T20:52:03.942 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:not enough osds to create mgr pool 2026-02-22T20:52:03.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-22T20:52:05.187 INFO:tasks.ceph.osd.2.trial007.stderr:2026-02-22T20:52:05.182+0000 7f61341cf640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T20:52:05.187 INFO:tasks.ceph.osd.0.trial007.stderr:2026-02-22T20:52:05.186+0000 7ff1803b1640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T20:52:05.188 INFO:tasks.ceph.osd.4.trial061.stderr:2026-02-22T20:52:05.177+0000 7fa214fb0640 -1 osd.4 0 waiting for initial osdmap 2026-02-22T20:52:05.188 INFO:tasks.ceph.osd.1.trial007.stderr:2026-02-22T20:52:05.186+0000 7f1f475e4640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T20:52:05.188 INFO:tasks.ceph.osd.5.trial061.stderr:2026-02-22T20:52:05.177+0000 7f4bd270d640 -1 osd.5 0 waiting for initial osdmap 2026-02-22T20:52:05.189 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T20:52:05.177+0000 7f5c25c3c640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T20:52:05.190 INFO:tasks.ceph.osd.2.trial007.stderr:2026-02-22T20:52:05.186+0000 7f612bfe8640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.190 INFO:tasks.ceph.osd.0.trial007.stderr:2026-02-22T20:52:05.186+0000 7ff17c1d2640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.191 INFO:tasks.ceph.osd.4.trial061.stderr:2026-02-22T20:52:05.177+0000 7fa20cdc9640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.191 INFO:tasks.ceph.osd.1.trial007.stderr:2026-02-22T20:52:05.186+0000 7f1f3f3fd640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.191 INFO:tasks.ceph.osd.5.trial061.stderr:2026-02-22T20:52:05.177+0000 7f4bca526640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.191 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T20:52:05.181+0000 7f5c21a5d640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T20:52:05.943 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:not enough osds to create mgr pool 2026-02-22T20:52:05.943 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 2 seconds 2026-02-22T20:52:06.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:06.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:07.944 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:creating mgr pool 2026-02-22T20:52:07.944 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:creating new mgr pool 2026-02-22T20:52:08.197 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:mon_command: 'osd pool create' -> 0 in 0.254s 2026-02-22T20:52:09.201 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:mon_command: 'osd pool application enable' -> 0 in 1.003s 2026-02-22T20:52:09.201 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:using uri file:///.mgr:devicehealth/main.db?vfs=ceph 2026-02-22T20:52:09.642 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:new libcephsqlite addrv = 10.20.193.61:0/1387718487 2026-02-22T20:52:09.649 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:creating main.db for devicehealth 2026-02-22T20:52:09.655 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:52:09.659 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:finished reading legacy pool, complete = True 2026-02-22T20:52:09.659 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:get_kv('last_scrape') 2026-02-22T20:52:09.662 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Last scrape None 2026-02-22T20:52:09.662 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Check health 2026-02-22T20:52:09.665 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Last scrape never, next scrape due 20260222-205209 2026-02-22T20:52:09.665 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.0 2026-02-22T20:52:09.700 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B003EC 2026-02-22T20:52:09.711 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B003EC wear level to 0.0 2026-02-22T20:52:09.713 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.1 2026-02-22T20:52:09.745 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B003EC 2026-02-22T20:52:09.745 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.2 2026-02-22T20:52:09.779 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B00400 2026-02-22T20:52:09.790 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B00400 wear level to 0.0 2026-02-22T20:52:09.792 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.3 2026-02-22T20:52:09.818 DEBUG:teuthology.orchestra.run.trial007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:09.828 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B00232 2026-02-22T20:52:09.840 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B00232 wear level to 0.0 2026-02-22T20:52:09.842 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.4 2026-02-22T20:52:09.873 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B00232 2026-02-22T20:52:09.873 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon osd.5 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: get_monmap_and_config 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: build_initial_monmap 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: monmap: 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:epoch 0 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:52:09.874435+0000 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:52:09.874435+0000 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:09.873 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 Processor -- start 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 -- start start 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: init 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fa068091c70 0x7fa068092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-c con 0x7fa068091c70 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa06813f1b0 0x7fa06813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-a con 0x7fa06813f1b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa06813fb10 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06808e6a0 con 0x7fa06813fb10 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa06808e910 con 0x7fa06813f1b0 2026-02-22T20:52:09.874 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fa06808ebf0 con 0x7fa068091c70 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06f313640 10 monclient(hunting): authenticate will time out at 542.347321s 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa06813f1b0 0x7fa06813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa06813f1b0 0x7fa06813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45998/0 (socket says 10.20.193.7:45998) 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 -- 10.20.193.7:0/1128530789 learned_addr learned my addr 10.20.193.7:0/1128530789 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): get_auth_request con 0x7fa06813f1b0 auth_method 0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d889640 1 --1- 10.20.193.7:0/1128530789 >> v1:10.20.193.7:6789/0 conn(0x7fa06813fb10 0x7fa0681a0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39214/0 (socket says 10.20.193.7:39214) 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 1 --2- 10.20.193.7:0/1128530789 >> v2:10.20.193.61:3300/0 conn(0x7fa068091c70 0x7fa068092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): get_auth_request con 0x7fa068091c70 auth_method 0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient(hunting): handle_auth_done global_id 4209 payload 274 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 -- 10.20.193.7:0/1128530789 >> v2:10.20.193.61:3300/0 conn(0x7fa068091c70 msgr2=0x7fa068092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 --2- 10.20.193.7:0/1128530789 >> v2:10.20.193.61:3300/0 conn(0x7fa068091c70 0x7fa068092040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 -- 10.20.193.7:0/1128530789 >> v1:10.20.193.7:6789/0 conn(0x7fa06813fb10 legacy=0x7fa0681a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient: _finish_hunting 0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 monclient: found mon.noname-a 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa06c887640 1 -- 10.20.193.7:0/1128530789 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06808eed0 con 0x7fa06813f1b0 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa057fff640 1 -- 10.20.193.7:0/1128530789 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441073042 0 0) 0x7fa06808e6a0 con 0x7fa06813fb10 2026-02-22T20:52:09.875 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.870+0000 7fa057fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- 10.20.193.7:0/1128530789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06813f5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa068090990 tx=0x7fa05c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde12b443c3db153 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 1 -- 10.20.193.7:0/1128530789 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0a7070 con 0x7fa06813f1b0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: dump: 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 5 monclient: authenticate success, global_id 4209 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 1 -- 10.20.193.7:0/1128530789 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0b0070 con 0x7fa06813f1b0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 1 -- 10.20.193.7:0/1128530789 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0ab890 con 0x7fa06813f1b0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa057fff640 10 monclient: dump: 2026-02-22T20:52:09.876 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 4 set_mon_vals no callback set 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: shutdown 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/1128530789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 msgr2=0x7fa06813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- 10.20.193.7:0/1128530789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06813f5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa068090990 tx=0x7fa05c01c4a0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/1128530789 shutdown_connections 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- 10.20.193.7:0/1128530789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06813f5d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- 10.20.193.7:0/1128530789 >> v2:10.20.193.61:3300/0 conn(0x7fa068091c70 0x7fa068092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/1128530789 >> 10.20.193.7:0/1128530789 conn(0x7fa068093d80 msgr2=0x7fa068090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/1128530789 shutdown_connections 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/1128530789 wait complete. 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: build_initial_monmap 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: monmap: 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:epoch 0 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:created 0.000000 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:09.877 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.878 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 Processor -- start 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- start start 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: init 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 0x7fa06812ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-c con 0x7fa068091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-a con 0x7fa06813f1b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 0x7fa06812b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): picked mon.noname-b con 0x7fa06813fb10 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa068091700 con 0x7fa06813f1b0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa068091580 con 0x7fa06813fb10 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa0681a4440 con 0x7fa068091c70 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient(hunting): authenticate will time out at 542.350514s 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46004/0 (socket says 10.20.193.7:46004) 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 -- 10.20.193.7:0/204612739 learned_addr learned my addr 10.20.193.7:0/204612739 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 0x7fa06812ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): get_auth_request con 0x7fa06813f1b0 auth_method 0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): get_auth_request con 0x7fa068091c70 auth_method 0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 0x7fa06812b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 10 monclient(hunting): get_auth_request con 0x7fa06813fb10 auth_method 0 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:09.879 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient(hunting): handle_auth_done global_id 4215 payload 824 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 -- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 msgr2=0x7fa06812ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 0x7fa06812ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 -- 10.20.193.7:0/204612739 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 msgr2=0x7fa06812b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 0x7fa06812b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient: _finish_hunting 0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 monclient: found mon.noname-a 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 -- 10.20.193.7:0/204612739 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06808a970 con 0x7fa06813f1b0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d889640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 0x7fa06812b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06d088640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 0x7fa06812ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06c887640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa05c002410 tx=0x7fa05c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004220 con 0x7fa06813f1b0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: dump: 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0043c0 con 0x7fa06813f1b0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003710 con 0x7fa06813f1b0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 10 monclient: dump: 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:epoch 1 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:election_strategy: 1 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:09.880 INFO:teuthology.misc.health.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr: 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa0577fe640 4 set_mon_vals no callback set 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 5 monclient: authenticate success, global_id 4215 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _renew_subs 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06812e6d0 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _renew_subs 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06812e9b0 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068092040 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 4) ==== 48674+0+0 (secure 0 0 0) 0x7fa05c0038b0 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 --2- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 0x7fa03805af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.874+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3147+0+0 (secure 0 0 0) 0x7fa05c0e8e00 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa06d088640 1 --2- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 0x7fa03805af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa06d088640 10 monclient: get_auth_request con 0x7fa03803aa80 auth_method 0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa06d088640 1 --2- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 0x7fa03805af30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa058004780 tx=0x7fa058009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa06808a970 con 0x7fa06813f1b0 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa055ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:09.881 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.878+0000 7fa055ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:09.906 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:created device MTFDKCC1T9TGP-1BK1JABYY_012510B00261 2026-02-22T20:52:09.918 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:updating MTFDKCC1T9TGP-1BK1JABYY_012510B00261 wear level to 0.0 2026-02-22T20:52:09.920 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon mon.a 2026-02-22T20:52:09.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B003EC 2026-02-22T20:52:09.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon mon.b 2026-02-22T20:52:09.966 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa06f313640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:09.966 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa06f313640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:09.966 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa06f313640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:09.966 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa06812db40 con 0x7fa06813f1b0 2026-02-22T20:52:09.967 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa055ffb640 1 -- 10.20.193.7:0/204612739 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8891 (secure 0 0 0) 0x7fa05c0161b0 con 0x7fa06813f1b0 2026-02-22T20:52:09.967 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa055ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:09.967 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.962+0000 7fa055ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:09.967 INFO:teuthology.misc.health.trial007.stdout: 2026-02-22T20:52:09.967 INFO:teuthology.misc.health.trial007.stdout:{"epoch":13,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:09.196956+0000","last_up_change":"2026-02-22T20:52:06.185700+0000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T20:52:07.953655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6800","nonce":2743492886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6801","nonce":2743492886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6805","nonce":2743492886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6803","nonce":2743492886}]},"public_addr":"10.20.193.7:6800/2743492886","cluster_addr":"10.20.193.7:6801/2743492886","heartbeat_back_addr":"10.20.193.7:6805/2743492886","heartbeat_front_addr":"10.20.193.7:6803/2743492886","state":["exists","up"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6802","nonce":2057498835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6804","nonce":2057498835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6807","nonce":2057498835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6806","nonce":2057498835}]},"public_addr":"10.20.193.7:6802/2057498835","cluster_addr":"10.20.193.7:6804/2057498835","heartbeat_back_addr":"10.20.193.7:6807/2057498835","heartbeat_front_addr":"10.20.193.7:6806/2057498835","state":["exists","up"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6808","nonce":1121527665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6809","nonce":1121527665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6811","nonce":1121527665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6810","nonce":1121527665}]},"public_addr":"10.20.193.7:6808/1121527665","cluster_addr":"10.20.193.7:6809/1121527665","heartbeat_back_addr":"10.20.193.7:6811/1121527665","heartbeat_front_addr":"10.20.193.7:6810/1121527665","state":["exists","up"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":3528802164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":3528802164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":3528802164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":3528802164}]},"public_addr":"10.20.193.61:6802/3528802164","cluster_addr":"10.20.193.61:6804/3528802164","heartbeat_back_addr":"10.20.193.61:6808/3528802164","heartbeat_front_addr":"10.20.193.61:6806/3528802164","state":["exists","up"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6801","nonce":461213399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6803","nonce":461213399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6807","nonce":461213399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6805","nonce":461213399}]},"public_addr":"10.20.193.61:6801/461213399","cluster_addr":"10.20.193.61:6803/461213399","heartbeat_back_addr":"10.20.193.61:6807/461213399","heartbeat_front_addr":"10.20.193.61:6805/461213399","state":["exists","up"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6809","nonce":837853154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":837853154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":837853154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6811","nonce":837853154}]},"public_addr":"10.20.193.61:6809/837853154","cluster_addr":"10.20.193.61:6810/837853154","heartbeat_back_addr":"10.20.193.61:6812/837853154","heartbeat_front_addr":"10.20.193.61:6811/837853154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 msgr2=0x7fa03805af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 0x7fa03805af30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa058004780 tx=0x7fa058009290 comp rx=0 tx=0).stop 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 10 monclient: shutdown 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 msgr2=0x7fa06812b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa05c002410 tx=0x7fa05c01ace0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 shutdown_connections 2026-02-22T20:52:09.968 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa03803aa80 0x7fa03805af30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa06813fb10 0x7fa06812b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa06813f1b0 0x7fa06812b0d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 --2- 10.20.193.7:0/204612739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa068091c70 0x7fa06812ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 >> 10.20.193.7:0/204612739 conn(0x7fa068093d80 msgr2=0x7fa068056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 shutdown_connections 2026-02-22T20:52:09.969 INFO:teuthology.misc.health.trial007.stderr:2026-02-22T20:52:09.966+0000 7fa06f313640 1 -- 10.20.193.7:0/204612739 wait complete. 2026-02-22T20:52:09.977 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-22T20:52:09.977 INFO:tasks.ceph:Creating RBD pool 2026-02-22T20:52:09.977 DEBUG:teuthology.orchestra.run.trial007:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T20:52:09.978 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B00232 2026-02-22T20:52:09.978 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:do_scrape_daemon mon.c 2026-02-22T20:52:10.008 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:skipping duplicate MTFDKCC1T9TGP-1BK1JABYY_012510B003EC 2026-02-22T20:52:10.008 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:set_kv('last_scrape', '20260222-205209') 2026-02-22T20:52:10.017 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 600 seconds 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: get_monmap_and_config 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: build_initial_monmap 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: monmap: 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:10.038862+0000 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:10.038862+0000 2026-02-22T20:52:10.038 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:10.039 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 Processor -- start 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 -- start start 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: init 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fba3413f3f0 0x7fba34057420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-c con 0x7fba3413f3f0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fba3413f7c0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba3408c480 0x7fba341a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-a con 0x7fba3408c480 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba34088300 con 0x7fba3413f7c0 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fba34090ea0 con 0x7fba3408c480 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fba34055ef0 con 0x7fba3413f3f0 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba392ff640 10 monclient(hunting): authenticate will time out at 542.511778s 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba3408c480 0x7fba341a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba3408c480 0x7fba341a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46018/0 (socket says 10.20.193.7:46018) 2026-02-22T20:52:10.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 1 -- 10.20.193.7:0/1412488002 learned_addr learned my addr 10.20.193.7:0/1412488002 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 10 monclient(hunting): get_auth_request con 0x7fba3408c480 auth_method 0 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.034+0000 7fba38afe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 1 --2- 10.20.193.7:0/1412488002 >> v2:10.20.193.61:3300/0 conn(0x7fba3413f3f0 0x7fba34057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_done global_id 4221 payload 274 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 -- 10.20.193.7:0/1412488002 >> v2:10.20.193.61:3300/0 conn(0x7fba3413f3f0 msgr2=0x7fba34057420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:10.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 --2- 10.20.193.7:0/1412488002 >> v2:10.20.193.61:3300/0 conn(0x7fba3413f3f0 0x7fba34057420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 -- 10.20.193.7:0/1412488002 >> v1:10.20.193.61:6789/0 conn(0x7fba3413f7c0 legacy=0x7fba3408bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 monclient: found mon.noname-a 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 -- 10.20.193.7:0/1412488002 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba340906a0 con 0x7fba3408c480 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 --2- 10.20.193.7:0/1412488002 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3408c480 0x7fba341a1300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba3405dad0 tx=0x7fba2801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe89ace007636a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 1 -- 10.20.193.7:0/1412488002 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba280b2070 con 0x7fba3408c480 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: dump: 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.052 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 1 -- 10.20.193.7:0/1412488002 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba280a5940 con 0x7fba3408c480 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 1 -- 10.20.193.7:0/1412488002 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba280a5d30 con 0x7fba3408c480 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba32ffd640 10 monclient: dump: 2026-02-22T20:52:10.053 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 5 monclient: authenticate success, global_id 4221 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:10.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 4 set_mon_vals no callback set 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: shutdown 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- 10.20.193.7:0/1412488002 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3408c480 msgr2=0x7fba341a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- 10.20.193.7:0/1412488002 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3408c480 0x7fba341a1300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fba3405dad0 tx=0x7fba2801c880 comp rx=0 tx=0).stop 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- 10.20.193.7:0/1412488002 shutdown_connections 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- 10.20.193.7:0/1412488002 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3408c480 0x7fba341a1300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- 10.20.193.7:0/1412488002 >> v2:10.20.193.61:3300/0 conn(0x7fba3413f3f0 0x7fba34057420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- 10.20.193.7:0/1412488002 >> 10.20.193.7:0/1412488002 conn(0x7fba34091b00 msgr2=0x7fba3408de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- 10.20.193.7:0/1412488002 shutdown_connections 2026-02-22T20:52:10.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- 10.20.193.7:0/1412488002 wait complete. 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: build_initial_monmap 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: monmap: 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:10.056 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 Processor -- start 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- start start 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: init 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba3408c480 0x7fba34150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-b con 0x7fba3408c480 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:10.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-a con 0x7fba3413f3f0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba3413f7c0 0x7fba3412a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): picked mon.noname-c con 0x7fba3413f7c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba341a4060 con 0x7fba3413f3f0 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fba341a41e0 con 0x7fba3408c480 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fba341a4360 con 0x7fba3413f7c0 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:10.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba392ff640 10 monclient(hunting): authenticate will time out at 542.515592s 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46020/0 (socket says 10.20.193.7:46020) 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 -- 10.20.193.7:0/2297382578 learned_addr learned my addr 10.20.193.7:0/2297382578 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): get_auth_request con 0x7fba3413f3f0 auth_method 0 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba3413f7c0 0x7fba3412a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba3408c480 0x7fba34150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): get_auth_request con 0x7fba3413f7c0 auth_method 0 2026-02-22T20:52:10.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): get_auth_request con 0x7fba3408c480 auth_method 0 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba38afe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient(hunting): handle_auth_done global_id 4224 payload 824 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 -- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba3413f7c0 msgr2=0x7fba3412a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba3413f7c0 0x7fba3412a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 -- 10.20.193.7:0/2297382578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba3408c480 msgr2=0x7fba34150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba3408c480 0x7fba34150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.038+0000 7fba337fe640 1 -- 10.20.193.7:0/2297382578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3413cb50 con 0x7fba3413f3f0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba337fe640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c4f0 tx=0x7fba2400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24016020 con 0x7fba3413f3f0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: dump: 2026-02-22T20:52:10.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:10.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba24005220 con 0x7fba3413f3f0 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba240068d0 con 0x7fba3413f3f0 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: dump: 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.064 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba327fc640 4 set_mon_vals no callback set 2026-02-22T20:52:10.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 5 monclient: authenticate success, global_id 4224 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _renew_subs 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3412ca80 con 0x7fba3413f3f0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _renew_subs 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3412d6b0 con 0x7fba3413f3f0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba34057420 con 0x7fba3413f3f0 2026-02-22T20:52:10.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 4) ==== 48674+0+0 (secure 0 0 0) 0x7fba24006a70 con 0x7fba3413f3f0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 --2- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 0x7fba0405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3147+0+0 (secure 0 0 0) 0x7fba2404de40 con 0x7fba3413f3f0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba33fff640 1 --2- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 0x7fba0405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba33fff640 10 monclient: get_auth_request con 0x7fba0403aa90 auth_method 0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba33fff640 1 --2- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 0x7fba0405af40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba20004780 tx=0x7fba20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fba24020020 con 0x7fba3413f3f0 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:10.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.042+0000 7fba30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:10.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.122+0000 7fba392ff640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T20:52:10.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.122+0000 7fba392ff640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T20:52:10.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.122+0000 7fba392ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.122+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fba34087b50 con 0x7fba3413f3f0 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba30ff9640 1 -- 10.20.193.7:0/2297382578 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7fba24013070 con 0x7fba3413f3f0 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba30ff9640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:pool 'rbd' created 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 msgr2=0x7fba0405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 0x7fba0405af40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba20004780 tx=0x7fba20008040 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 10 monclient: shutdown 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 msgr2=0x7fba341508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c4f0 tx=0x7fba2400c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 shutdown_connections 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba3413f7c0 0x7fba3412a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba3413f3f0 0x7fba341508a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba0403aa90 0x7fba0405af40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 --2- 10.20.193.7:0/2297382578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba3408c480 0x7fba34150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 >> 10.20.193.7:0/2297382578 conn(0x7fba34091b00 msgr2=0x7fba34085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 shutdown_connections 2026-02-22T20:52:10.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.202+0000 7fba392ff640 1 -- 10.20.193.7:0/2297382578 wait complete. 2026-02-22T20:52:10.215 DEBUG:teuthology.orchestra.run.trial007:> rbd --cluster ceph pool init rbd 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.226+0000 7fb25c914200 10 monclient: get_monmap_and_config 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.226+0000 7fb25c914200 10 monclient: build_initial_monmap 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.226+0000 7fb25c914200 10 monclient: monmap: 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:10.231490+0000 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:10.231490+0000 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:10.230 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:10.231 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:10.231 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:10.231 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 Processor -- start 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- start start 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: init 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: _reopen_session rank -1 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-b con 0x562eb13aafb0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-c-legacy con 0x562eb13a9c30 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- >> v2:10.20.193.7:3300/0 conn(0x562eb13aa060 0x562eb13cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-a con 0x562eb13aa060 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x562eb120be00 con 0x562eb13a9c30 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x562eb12295e0 con 0x562eb13aa060 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x562eb128a680 con 0x562eb13aafb0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): _renew_subs 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): authenticate will time out at 542.704530s 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x562eb13aa060 0x562eb13cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x562eb13aa060 0x562eb13cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46026/0 (socket says 10.20.193.7:46026) 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 -- 10.20.193.7:0/675390148 learned_addr learned my addr 10.20.193.7:0/675390148 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46302/0 (socket says 10.20.193.7:46302) 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): get_auth_request con 0x562eb13aa060 auth_method 0 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): get_auth_request con 0x562eb13aafb0 auth_method 0 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_done global_id 4227 payload 274 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 -- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 msgr2=0x562eb1479b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 -- 10.20.193.7:0/675390148 >> v1:10.20.193.61:6789/0 conn(0x562eb13a9c30 legacy=0x562eb13caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient: _finish_hunting 0 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 monclient: found mon.noname-a 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 -- 10.20.193.7:0/675390148 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb1200a10 con 0x562eb13aa060 2026-02-22T20:52:10.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13aa060 0x562eb13cb2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb24c005bb0 tx=0x7fb24c01b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90c3f86c20f3d07 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 1 -- 10.20.193.7:0/675390148 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0ab440 con 0x562eb13aa060 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: dump: 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.234 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: _finish_auth 0 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: _check_auth_tickets 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 1 -- 10.20.193.7:0/675390148 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c0ab5e0 con 0x562eb13aa060 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 5 monclient: authenticate success, global_id 4227 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 1 -- 10.20.193.7:0/675390148 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0ab990 con 0x562eb13aa060 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25a3e6640 10 monclient: dump: 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: get_monmap_and_config success 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 4 set_mon_vals no callback set 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: shutdown 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13aa060 msgr2=0x562eb13cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13aa060 0x562eb13cb2b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb24c005bb0 tx=0x7fb24c01b080 comp rx=0 tx=0).stop 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- 10.20.193.7:0/675390148 shutdown_connections 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13aa060 0x562eb13cb2b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- 10.20.193.7:0/675390148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1479b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- 10.20.193.7:0/675390148 >> 10.20.193.7:0/675390148 conn(0x562eb13c8dd0 msgr2=0x562eb13aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- 10.20.193.7:0/675390148 shutdown_connections 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- 10.20.193.7:0/675390148 wait complete. 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: build_initial_monmap 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: monmap: 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 Processor -- start 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- start start 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: init 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: _reopen_session rank -1 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 0x562eb1466170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-a con 0x562eb13a9c30 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x562eb13aa060 0x562eb14666b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-b con 0x562eb13aa060 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1466bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): picked mon.noname-c con 0x562eb13aafb0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x562eb12196f0 con 0x562eb13a9c30 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x562eb1285f10 con 0x562eb13aa060 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x562eb13c5bb0 con 0x562eb13aafb0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): _renew_subs 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c914200 10 monclient(hunting): authenticate will time out at 542.707738s 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 0x562eb1466170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 0x562eb1466170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46028/0 (socket says 10.20.193.7:46028) 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 1 -- 10.20.193.7:0/3406860995 learned_addr learned my addr 10.20.193.7:0/3406860995 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): get_auth_request con 0x562eb13a9c30 auth_method 0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1466bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): get_auth_request con 0x562eb13aafb0 auth_method 0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25c671640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25abe7640 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x562eb13aa060 0x562eb14666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25abe7640 10 monclient(hunting): get_auth_request con 0x562eb13aa060 auth_method 0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25abe7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25abe7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.230+0000 7fb25abe7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 10 monclient(hunting): handle_auth_done global_id 4230 payload 824 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 -- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 msgr2=0x562eb1466bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x562eb13aafb0 0x562eb1466bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 -- 10.20.193.7:0/3406860995 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x562eb13aa060 msgr2=0x562eb14666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x562eb13aa060 0x562eb14666b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 10 monclient: _finish_hunting 0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 monclient: found mon.noname-a 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb1210540 con 0x562eb13a9c30 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25b3e8640 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 0x562eb1466170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb250005bd0 tx=0x7fb250008760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250012790 con 0x562eb13a9c30 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: dump: 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb250012930 con 0x562eb13a9c30 2026-02-22T20:52:10.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 5 monclient: authenticate success, global_id 4230 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _renew_subs 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562eb14684b0 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250012d00 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 10 monclient: dump: 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb259be5640 4 set_mon_vals no callback set 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _renew_subs 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb1467950 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 4) ==== 48674+0+0 (secure 0 0 0) 0x7fb250013420 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb23c039290 0x7fb23c059740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3492+0+0 (secure 0 0 0) 0x7fb25004d540 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x562eb1468fe0 con 0x562eb13a9c30 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25abe7640 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb23c039290 0x7fb23c059740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25abe7640 10 monclient: get_auth_request con 0x7fb23c039290 auth_method 0 2026-02-22T20:52:10.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.234+0000 7fb25abe7640 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb23c039290 0x7fb23c059740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x562eb13c5f60 tx=0x7fb244003640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:10.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:10.918+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fb25001c400 con 0x562eb13a9c30 2026-02-22T20:52:11.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7fb250011b90 con 0x562eb13a9c30 2026-02-22T20:52:11.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-22T20:52:11.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-22T20:52:11.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c914200 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:11.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x562eb1299920 con 0x562eb13a9c30 2026-02-22T20:52:11.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 8 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fb25004c160 con 0x562eb13a9c30 2026-02-22T20:52:11.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 10 monclient: handle_get_version_reply finishing 1 version 15 2026-02-22T20:52:11.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb259be5640 10 monclient: _renew_subs 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb259be5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb259be5640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fb234002af0 con 0x562eb13a9c30 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 9 ==== osd_map(15..15 src has 1..15) ==== 661+0+0 (secure 0 0 0) 0x7fb25001f100 con 0x562eb13a9c30 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c914200 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6809/837853154 conn(0x562eb14ca210 0x562eb14ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> v2:10.20.193.61:6809/837853154 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x562eb14cab20 con 0x562eb14ca210 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c671640 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6809/837853154 conn(0x562eb14ca210 0x562eb14ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.202+0000 7fb25c671640 10 monclient: get_auth_request con 0x562eb14ca210 auth_method 0 2026-02-22T20:52:11.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.206+0000 7fb25c671640 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6809/837853154 conn(0x562eb14ca210 0x562eb14ca5e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:11.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.206+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 <== osd.5 v2:10.20.193.61:6809/837853154 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fb24c0ab6a0 con 0x562eb14ca210 2026-02-22T20:52:11.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.206+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> v2:10.20.193.61:6809/837853154 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x562eb1548980 con 0x562eb14ca210 2026-02-22T20:52:11.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.210+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 <== osd.5 v2:10.20.193.61:6809/837853154 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb24c0ab6a0 con 0x562eb14ca210 2026-02-22T20:52:11.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 --> v2:10.20.193.61:6809/837853154 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x562eb1547a60 con 0x562eb14ca210 2026-02-22T20:52:11.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.210+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 <== osd.5 v2:10.20.193.61:6809/837853154 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb24c0ab6a0 con 0x562eb14ca210 2026-02-22T20:52:11.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.210+0000 7fb2593e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:11.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:11.210+0000 7fb2593e4640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fb238001f50 con 0x562eb13a9c30 2026-02-22T20:52:11.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:11.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:11.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7fb250030070 con 0x562eb13a9c30 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb2437fe640 10 monclient: _renew_subs 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb2437fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fb23c05d2f0 con 0x562eb13a9c30 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 11 ==== osd_map(16..16 src has 1..16) ==== 629+0+0 (secure 0 0 0) 0x7fb25004b0c0 con 0x562eb13a9c30 2026-02-22T20:52:12.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.206+0000 7fb259be5640 1 -- 10.20.193.7:0/3406860995 --> v2:10.20.193.61:6809/837853154 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fb234005800 con 0x562eb14ca210 2026-02-22T20:52:12.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.210+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 <== osd.5 v2:10.20.193.61:6809/837853154 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb24c0ab6a0 con 0x562eb14ca210 2026-02-22T20:52:12.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.210+0000 7fb2593e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:12.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:12.210+0000 7fb2593e4640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7fb2380033a0 con 0x562eb13a9c30 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7fb250020160 con 0x562eb13a9c30 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb2437fe640 10 monclient: _renew_subs 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb2437fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fb23c05d4c0 con 0x562eb13a9c30 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb2437fe640 1 -- 10.20.193.7:0/3406860995 <== mon.0 v2:10.20.193.7:3300/0 13 ==== osd_map(17..17 src has 1..17) ==== 657+0+0 (secure 0 0 0) 0x7fb25004ec90 con 0x562eb13a9c30 2026-02-22T20:52:13.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb259be5640 1 -- 10.20.193.7:0/3406860995 --> v2:10.20.193.61:6809/837853154 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fb234005ba0 con 0x562eb14ca210 2026-02-22T20:52:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 <== osd.5 v2:10.20.193.61:6809/837853154 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c0ab6a0 con 0x562eb14ca210 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6809/837853154 conn(0x562eb14ca210 msgr2=0x562eb14ca5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6809/837853154 conn(0x562eb14ca210 0x562eb14ca5e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb23c039290 msgr2=0x7fb23c059740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 --2- 10.20.193.7:0/3406860995 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb23c039290 0x7fb23c059740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x562eb13c5f60 tx=0x7fb244003640 comp rx=0 tx=0).stop 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 10 monclient: shutdown 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 msgr2=0x562eb1466170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 --2- 10.20.193.7:0/3406860995 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x562eb13a9c30 0x562eb1466170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb250005bd0 tx=0x7fb250008760 comp rx=0 tx=0).stop 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c671640 1 -- 10.20.193.7:0/3406860995 reap_dead start 2026-02-22T20:52:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 shutdown_connections 2026-02-22T20:52:13.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 >> 10.20.193.7:0/3406860995 conn(0x562eb13c8dd0 msgr2=0x562eb13c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 shutdown_connections 2026-02-22T20:52:13.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.210+0000 7fb25c914200 1 -- 10.20.193.7:0/3406860995 wait complete. 2026-02-22T20:52:13.219 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T20:52:13.220 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-22T20:52:13.220 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T20:52:13.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.318+0000 7f7e0d2a6640 10 monclient: get_monmap_and_config 2026-02-22T20:52:13.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.318+0000 7f7e0d2a6640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.318+0000 7f7e0d2a6640 10 monclient: monmap: 2026-02-22T20:52:13.322 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.322 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:13.323544+0000 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:13.323544+0000 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:13.323 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 Processor -- start 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- start start 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: init 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f7e0813f290 0x7f7e0813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-c con 0x7f7e0813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7e0813fba0 0x7f7e0813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-a con 0x7f7e0813fba0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7e0813c4b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e0808fd70 con 0x7f7e0813c4b0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0808e1f0 con 0x7f7e0813fba0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0808ec90 con 0x7f7e0813f290 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient(hunting): authenticate will time out at 545.796593s 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7e0813fba0 0x7f7e0813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7e0813fba0 0x7f7e0813bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46036/0 (socket says 10.20.193.7:46036) 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 -- 10.20.193.7:0/4249429607 learned_addr learned my addr 10.20.193.7:0/4249429607 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e077fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f7e0813c4b0 0x7f7e081a07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39222/0 (socket says 10.20.193.7:39222) 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): get_auth_request con 0x7f7e0813fba0 auth_method 0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e06ffd640 1 --2- 10.20.193.7:0/4249429607 >> v2:10.20.193.61:3300/0 conn(0x7f7e0813f290 0x7f7e0813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e06ffd640 10 monclient(hunting): get_auth_request con 0x7f7e0813f290 auth_method 0 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient(hunting): handle_auth_done global_id 4233 payload 274 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 -- 10.20.193.7:0/4249429607 >> v2:10.20.193.61:3300/0 conn(0x7f7e0813f290 msgr2=0x7f7e0813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 --2- 10.20.193.7:0/4249429607 >> v2:10.20.193.61:3300/0 conn(0x7f7e0813f290 0x7f7e0813f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 -- 10.20.193.7:0/4249429607 >> v1:10.20.193.7:6789/0 conn(0x7f7e0813c4b0 legacy=0x7f7e081a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 monclient: found mon.noname-a 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 -- 10.20.193.7:0/4249429607 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e08092bc0 con 0x7f7e0813fba0 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e067fc640 1 --2- 10.20.193.7:0/4249429607 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bf70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e080947c0 tx=0x7f7df001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d2356fe21ed90e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 1 -- 10.20.193.7:0/4249429607 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df00aa610 con 0x7f7e0813fba0 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: dump: 2026-02-22T20:52:13.329 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 1 -- 10.20.193.7:0/4249429607 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df00af070 con 0x7f7e0813fba0 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 1 -- 10.20.193.7:0/4249429607 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df00aa9d0 con 0x7f7e0813fba0 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e05ffb640 10 monclient: dump: 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.330 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 5 monclient: authenticate success, global_id 4233 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 4 set_mon_vals no callback set 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: shutdown 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/4249429607 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813fba0 msgr2=0x7f7e0813bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/4249429607 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bf70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e080947c0 tx=0x7f7df001c4b0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/4249429607 shutdown_connections 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/4249429607 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bf70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/4249429607 >> v2:10.20.193.61:3300/0 conn(0x7f7e0813f290 0x7f7e0813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/4249429607 >> 10.20.193.7:0/4249429607 conn(0x7f7e08093df0 msgr2=0x7f7e080902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/4249429607 shutdown_connections 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/4249429607 wait complete. 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.322+0000 7f7e0d2a6640 10 monclient: monmap: 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:13.331 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 Processor -- start 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- start start 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: init 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 0x7f7e08150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-a con 0x7f7e0813c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-c con 0x7f7e0813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): picked mon.noname-b con 0x7f7e0813fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08090c60 con 0x7f7e0813c4b0 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f7e081400a0 con 0x7f7e0813fba0 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7e08090de0 con 0x7f7e0813f290 2026-02-22T20:52:13.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient(hunting): authenticate will time out at 545.800674s 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 0x7f7e08150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46320/0 (socket says 10.20.193.7:46320) 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 0x7f7e08150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46042/0 (socket says 10.20.193.7:46042) 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 -- 10.20.193.7:0/3370474062 learned_addr learned my addr 10.20.193.7:0/3370474062 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): get_auth_request con 0x7f7e0813f290 auth_method 0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): get_auth_request con 0x7f7e0813c4b0 auth_method 0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e077fe640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e077fe640 10 monclient(hunting): get_auth_request con 0x7f7e0813fba0 auth_method 0 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e077fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient(hunting): handle_auth_done global_id 4202 payload 824 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 -- 10.20.193.7:0/3370474062 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7e0813fba0 msgr2=0x7f7e0813bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 -- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 msgr2=0x7f7e08150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 0x7f7e08150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 monclient: found mon.noname-c 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 -- 10.20.193.7:0/3370474062 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e08056de0 con 0x7f7e0813f290 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e067fc640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7df0004780 tx=0x7f7df001acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004220 con 0x7f7e0813f290 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: dump: 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.334 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df00043c0 con 0x7f7e0813f290 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 5 monclient: authenticate success, global_id 4202 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _renew_subs 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0812c920 con 0x7f7e0813f290 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0003910 con 0x7f7e0813f290 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 10 monclient: dump: 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.335 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e057fa640 4 set_mon_vals no callback set 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _renew_subs 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0812bdc0 con 0x7f7e0813f290 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0813f660 con 0x7f7e0813f290 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7df0003ab0 con 0x7f7e0813f290 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 --2- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 0x7f7dd405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f7df00e9070 con 0x7f7e0813f290 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 1 --2- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 0x7f7dd405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 10 monclient: get_auth_request con 0x7f7dd403ab10 auth_method 0 2026-02-22T20:52:13.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.326+0000 7f7e06ffd640 1 --2- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 0x7f7dd405afc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc004780 tx=0x7f7dfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.330+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f7df00a7070 con 0x7f7e0813f290 2026-02-22T20:52:13.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.330+0000 7f7de77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.330+0000 7f7de77fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7e0813dfb0 con 0x7f7e0813f290 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7de77fe640 1 -- 10.20.193.7:0/3370474062 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (secure 0 0 0) 0x7f7df00161f0 con 0x7f7e0813f290 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7de77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-22T20:52:13.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7de77fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:13.415 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 msgr2=0x7f7dd405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 0x7f7dd405afc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc004780 tx=0x7f7dfc008040 comp rx=0 tx=0).stop 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 10 monclient: shutdown 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 msgr2=0x7f7e0813b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7df0004780 tx=0x7f7df001acf0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 shutdown_connections 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7dd403ab10 0x7f7dd405afc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7e0813fba0 0x7f7e0813bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7e0813f290 0x7f7e0813b710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 --2- 10.20.193.7:0/3370474062 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7e0813c4b0 0x7f7e08150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 >> 10.20.193.7:0/3370474062 conn(0x7f7e08093df0 msgr2=0x7f7e08055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 shutdown_connections 2026-02-22T20:52:13.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.410+0000 7f7e0d2a6640 1 -- 10.20.193.7:0/3370474062 wait complete. 2026-02-22T20:52:13.424 INFO:teuthology.orchestra.run.trial007.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-22T20:52:13.424 INFO:tasks.ceph_manager:config epoch is 1 2026-02-22T20:52:13.424 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T20:52:13.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T20:52:13.425 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: get_monmap_and_config 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: monmap: 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.487 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:13.486301+0000 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:13.486301+0000 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 Processor -- start 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 -- start start 2026-02-22T20:52:13.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: init 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f913c091c70 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): picked mon.noname-b con 0x7f913c1604e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f913c180e00 0x7f913c1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): picked mon.noname-a con 0x7f913c180e00 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913c08e6a0 con 0x7f913c091c70 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f913c08e910 con 0x7f913c180e00 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f913c08ebf0 con 0x7f913c1604e0 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f914231a640 10 monclient(hunting): authenticate will time out at 545.959180s 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f913c180e00 0x7f913c1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46332/0 (socket says 10.20.193.7:46332) 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 -- 10.20.193.7:0/725749626 learned_addr learned my addr 10.20.193.7:0/725749626 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): get_auth_request con 0x7f913c1604e0 auth_method 0 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): get_auth_request con 0x7f913c180e00 auth_method 0 2026-02-22T20:52:13.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient(hunting): handle_auth_done global_id 4205 payload 274 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 -- 10.20.193.7:0/725749626 >> v2:10.20.193.7:3300/0 conn(0x7f913c180e00 msgr2=0x7f913c1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:13.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 --2- 10.20.193.7:0/725749626 >> v2:10.20.193.7:3300/0 conn(0x7f913c180e00 0x7f913c1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 -- 10.20.193.7:0/725749626 >> v1:10.20.193.61:6789/0 conn(0x7f913c091c70 legacy=0x7f913c092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.482+0000 7f913b7fe640 1 -- 10.20.193.7:0/725749626 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c08eed0 con 0x7f913c1604e0 2026-02-22T20:52:13.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 1 --2- 10.20.193.7:0/725749626 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f912c0090a0 tx=0x7f912c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ae5356790ab8fd server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 1 -- 10.20.193.7:0/725749626 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0ab610 con 0x7f913c1604e0 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: dump: 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.498 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 1 -- 10.20.193.7:0/725749626 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c0b0070 con 0x7f913c1604e0 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 1 -- 10.20.193.7:0/725749626 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0ab9d0 con 0x7f913c1604e0 2026-02-22T20:52:13.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913affd640 10 monclient: dump: 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.500 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 5 monclient: authenticate success, global_id 4205 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 4 set_mon_vals no callback set 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: shutdown 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/725749626 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 msgr2=0x7f913c1808c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- 10.20.193.7:0/725749626 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f912c0090a0 tx=0x7f912c01c500 comp rx=0 tx=0).stop 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/725749626 shutdown_connections 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- 10.20.193.7:0/725749626 >> v2:10.20.193.7:3300/0 conn(0x7f913c180e00 0x7f913c1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- 10.20.193.7:0/725749626 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c1604e0 0x7f913c1808c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/725749626 >> 10.20.193.7:0/725749626 conn(0x7f913c093d80 msgr2=0x7f913c090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/725749626 shutdown_connections 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/725749626 wait complete. 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: monmap: 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.502 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 Processor -- start 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- start start 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: init 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): picked mon.noname-c con 0x7f913c091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f913c1604e0 0x7f913c17fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): picked mon.noname-b con 0x7f913c1604e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f913c180e00 0x7f913c180150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): picked mon.noname-a con 0x7f913c180e00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f913c1a42d0 con 0x7f913c180e00 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f913c1a4150 con 0x7f913c1604e0 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f913c1a4450 con 0x7f913c091c70 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient(hunting): authenticate will time out at 545.962472s 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46344/0 (socket says 10.20.193.7:46344) 2026-02-22T20:52:13.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 -- 10.20.193.7:0/924709994 learned_addr learned my addr 10.20.193.7:0/924709994 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): get_auth_request con 0x7f913c091c70 auth_method 0 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f913c180e00 0x7f913c180150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): get_auth_request con 0x7f913c180e00 auth_method 0 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9140890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f913c1604e0 0x7f913c17fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 10 monclient(hunting): get_auth_request con 0x7f913c1604e0 auth_method 0 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient(hunting): handle_auth_done global_id 4208 payload 824 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 -- 10.20.193.7:0/924709994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f913c1604e0 msgr2=0x7f913c17fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f913c1604e0 0x7f913c17fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 -- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f913c180e00 msgr2=0x7f913c180150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f913c180e00 0x7f913c180150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 monclient: found mon.noname-c 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 -- 10.20.193.7:0/924709994 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c162cc0 con 0x7f913c091c70 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913bfff640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f912800c4f0 tx=0x7f912800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128016020 con 0x7f913c091c70 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:13.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: dump: 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9128005220 con 0x7f913c091c70 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91280068d0 con 0x7f913c091c70 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 10 monclient: dump: 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.509 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f913a7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 5 monclient: authenticate success, global_id 4208 2026-02-22T20:52:13.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _renew_subs 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c08a970 con 0x7f913c091c70 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _renew_subs 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c160c40 con 0x7f913c091c70 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c092040 con 0x7f913c091c70 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9128006a70 con 0x7f913c091c70 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 --2- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 0x7f910c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.486+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f912804e130 con 0x7f913c091c70 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f913b7fe640 1 --2- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 0x7f910c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f913b7fe640 10 monclient: get_auth_request con 0x7f910c03ab20 auth_method 0 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f913b7fe640 1 --2- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 0x7f910c05afd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f912c01a130 tx=0x7f912c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f9128020020 con 0x7f913c091c70 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f9138ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.490+0000 7f9138ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:13.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-22T20:52:13.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-22T20:52:13.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f913c092890 con 0x7f913c091c70 2026-02-22T20:52:13.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f9138ff9640 1 -- 10.20.193.7:0/924709994 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92700 (secure 0 0 0) 0x7f9128013070 con 0x7f913c091c70 2026-02-22T20:52:13.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f9138ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-22T20:52:13.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f9138ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:13.598 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 msgr2=0x7f910c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 0x7f910c05afd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f912c01a130 tx=0x7f912c0a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 10 monclient: shutdown 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 msgr2=0x7f913c17f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f912800c4f0 tx=0x7f912800c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 shutdown_connections 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f913c180e00 0x7f913c180150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> v2:10.20.193.61:6800/2336688312 conn(0x7f910c03ab20 0x7f910c05afd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f913c1604e0 0x7f913c17fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 --2- 10.20.193.7:0/924709994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f913c091c70 0x7f913c17f6d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 >> 10.20.193.7:0/924709994 conn(0x7f913c093d80 msgr2=0x7f913c056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 shutdown_connections 2026-02-22T20:52:13.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.594+0000 7f914231a640 1 -- 10.20.193.7:0/924709994 wait complete. 2026-02-22T20:52:13.608 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6800","nonce":2336688312}]},"active_addr":"10.20.193.61:6800/2336688312","active_change":"2026-02-22T20:52:01.913601+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.61:0","nonce":2690697108}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.61:0","nonce":1387718487}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.61:0","nonce":971121123}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.61:0","nonce":1831100774}]}]} 2026-02-22T20:52:13.612 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T20:52:13.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T20:52:13.613 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:13.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: get_monmap_and_config 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: monmap: 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:13.685452+0000 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:13.685452+0000 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.695 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 Processor -- start 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 -- start start 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: init 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-22T20:52:13.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-b con 0x7fbf6013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbf6013fba0 0x7fbf6013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-c con 0x7fbf6013fba0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 0x7fbf6013c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-a con 0x7fbf6013c4b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbf6008e1f0 con 0x7fbf6013c4b0 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fbf6008ec90 con 0x7fbf6013fba0 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6008fd70 con 0x7fbf6013f290 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf65e91640 10 monclient(hunting): authenticate will time out at 546.158678s 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46346/0 (socket says 10.20.193.7:46346) 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 -- 10.20.193.7:0/884815875 learned_addr learned my addr 10.20.193.7:0/884815875 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): get_auth_request con 0x7fbf6013f290 auth_method 0 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 0x7fbf6013c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): get_auth_request con 0x7fbf6013c4b0 auth_method 0 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5effd640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.61:3300/0 conn(0x7fbf6013fba0 0x7fbf6013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5effd640 10 monclient(hunting): get_auth_request con 0x7fbf6013fba0 auth_method 0 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_done global_id 4211 payload 274 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 -- 10.20.193.7:0/884815875 >> v2:10.20.193.61:3300/0 conn(0x7fbf6013fba0 msgr2=0x7fbf6013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.61:3300/0 conn(0x7fbf6013fba0 0x7fbf6013bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 -- 10.20.193.7:0/884815875 >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 msgr2=0x7fbf6013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 0x7fbf6013c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5f7fe640 1 -- 10.20.193.7:0/884815875 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf60092bc0 con 0x7fbf6013f290 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.682+0000 7fbf5ffff640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 0x7fbf6013c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:13.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/884815875 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbf600873f0 tx=0x7fbf4c01c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b575d57d4051b61a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 1 -- 10.20.193.7:0/884815875 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0ab620 con 0x7fbf6013f290 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: dump: 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.701 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 1 -- 10.20.193.7:0/884815875 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4c0b0070 con 0x7fbf6013f290 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 1 -- 10.20.193.7:0/884815875 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0ab9e0 con 0x7fbf6013f290 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5e7fc640 10 monclient: dump: 2026-02-22T20:52:13.702 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 5 monclient: authenticate success, global_id 4211 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 4 set_mon_vals no callback set 2026-02-22T20:52:13.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: shutdown 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/884815875 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 msgr2=0x7fbf6013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- 10.20.193.7:0/884815875 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbf600873f0 tx=0x7fbf4c01c570 comp rx=0 tx=0).stop 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/884815875 shutdown_connections 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.7:3300/0 conn(0x7fbf6013c4b0 0x7fbf6013c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- 10.20.193.7:0/884815875 >> v2:10.20.193.61:3300/0 conn(0x7fbf6013fba0 0x7fbf6013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- 10.20.193.7:0/884815875 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6013f660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/884815875 >> 10.20.193.7:0/884815875 conn(0x7fbf60093df0 msgr2=0x7fbf600902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/884815875 shutdown_connections 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/884815875 wait complete. 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: monmap: 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 Processor -- start 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- start start 2026-02-22T20:52:13.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: init 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-a con 0x7fbf6013c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6012bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-c con 0x7fbf6013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf6013fba0 0x7fbf60150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): picked mon.noname-b con 0x7fbf6013fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60090de0 con 0x7fbf6013c4b0 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60090c60 con 0x7fbf6013fba0 2026-02-22T20:52:13.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf601a2ff0 con 0x7fbf6013f290 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient(hunting): authenticate will time out at 546.162351s 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6012bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46072/0 (socket says 10.20.193.7:46072) 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 1 -- 10.20.193.7:0/1721089178 learned_addr learned my addr 10.20.193.7:0/1721089178 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): get_auth_request con 0x7fbf6013c4b0 auth_method 0 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): get_auth_request con 0x7fbf6013f290 auth_method 0 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5ffff640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf6013fba0 0x7fbf60150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5ffff640 10 monclient(hunting): get_auth_request con 0x7fbf6013fba0 auth_method 0 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient(hunting): handle_auth_done global_id 4214 payload 824 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 -- 10.20.193.7:0/1721089178 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf6013fba0 msgr2=0x7fbf60150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf6013fba0 0x7fbf60150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 -- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 msgr2=0x7fbf6014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 monclient: found mon.noname-c 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 -- 10.20.193.7:0/1721089178 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6012ccc0 con 0x7fbf6013f290 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5effd640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6012bd60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000e810 tx=0x7fbf5000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50017070 con 0x7fbf6013f290 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: dump: 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.710 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5000c6d0 con 0x7fbf6013f290 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 5 monclient: authenticate success, global_id 4214 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _renew_subs 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6008a9e0 con 0x7fbf6013f290 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000f040 con 0x7fbf6013f290 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf5dffb640 4 set_mon_vals no callback set 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 10 monclient: dump: 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _renew_subs 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6013c1a0 con 0x7fbf6013f290 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbf50012050 con 0x7fbf6013f290 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6013f660 con 0x7fbf6013f290 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 --2- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 0x7fbf3005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.686+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fbf5004e2e0 con 0x7fbf6013f290 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 0x7fbf3005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf5f7fe640 10 monclient: get_auth_request con 0x7fbf3003ab20 auth_method 0 2026-02-22T20:52:13.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf5f7fe640 1 --2- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 0x7fbf3005afd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c01c5b0 tx=0x7fbf4c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fbf6012ccc0 con 0x7fbf6013f290 2026-02-22T20:52:13.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf3bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.690+0000 7fbf3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf6005fb50 con 0x7fbf6013f290 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf3bfff640 1 -- 10.20.193.7:0/1721089178 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10807 (secure 0 0 0) 0x7fbf50015db0 con 0x7fbf6013f290 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf3bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:13.777 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:13.777 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":17,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:13.210204+0000","last_up_change":"2026-02-22T20:52:06.185700+0000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T20:52:07.953655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T20:52:10.131782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6800","nonce":2743492886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6801","nonce":2743492886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6805","nonce":2743492886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6803","nonce":2743492886}]},"public_addr":"10.20.193.7:6800/2743492886","cluster_addr":"10.20.193.7:6801/2743492886","heartbeat_back_addr":"10.20.193.7:6805/2743492886","heartbeat_front_addr":"10.20.193.7:6803/2743492886","state":["exists","up"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6802","nonce":2057498835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6804","nonce":2057498835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6807","nonce":2057498835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6806","nonce":2057498835}]},"public_addr":"10.20.193.7:6802/2057498835","cluster_addr":"10.20.193.7:6804/2057498835","heartbeat_back_addr":"10.20.193.7:6807/2057498835","heartbeat_front_addr":"10.20.193.7:6806/2057498835","state":["exists","up"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6808","nonce":1121527665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6809","nonce":1121527665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6811","nonce":1121527665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6810","nonce":1121527665}]},"public_addr":"10.20.193.7:6808/1121527665","cluster_addr":"10.20.193.7:6809/1121527665","heartbeat_back_addr":"10.20.193.7:6811/1121527665","heartbeat_front_addr":"10.20.193.7:6810/1121527665","state":["exists","up"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":3528802164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":3528802164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":3528802164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":3528802164}]},"public_addr":"10.20.193.61:6802/3528802164","cluster_addr":"10.20.193.61:6804/3528802164","heartbeat_back_addr":"10.20.193.61:6808/3528802164","heartbeat_front_addr":"10.20.193.61:6806/3528802164","state":["exists","up"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6801","nonce":461213399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6803","nonce":461213399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6807","nonce":461213399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6805","nonce":461213399}]},"public_addr":"10.20.193.61:6801/461213399","cluster_addr":"10.20.193.61:6803/461213399","heartbeat_back_addr":"10.20.193.61:6807/461213399","heartbeat_front_addr":"10.20.193.61:6805/461213399","state":["exists","up"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6809","nonce":837853154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":837853154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":837853154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6811","nonce":837853154}]},"public_addr":"10.20.193.61:6809/837853154","cluster_addr":"10.20.193.61:6810/837853154","heartbeat_back_addr":"10.20.193.61:6812/837853154","heartbeat_front_addr":"10.20.193.61:6811/837853154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:13.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 msgr2=0x7fbf3005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 0x7fbf3005afd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c01c5b0 tx=0x7fbf4c0a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:13.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 10 monclient: shutdown 2026-02-22T20:52:13.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 msgr2=0x7fbf6012bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6012bd60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000e810 tx=0x7fbf5000ecd0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 shutdown_connections 2026-02-22T20:52:13.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf3003ab20 0x7fbf3005afd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf6013fba0 0x7fbf60150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf6013f290 0x7fbf6012bd60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 --2- 10.20.193.7:0/1721089178 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf6013c4b0 0x7fbf6014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 >> 10.20.193.7:0/1721089178 conn(0x7fbf60093df0 msgr2=0x7fbf60089e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 shutdown_connections 2026-02-22T20:52:13.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.774+0000 7fbf65e91640 1 -- 10.20.193.7:0/1721089178 wait complete. 2026-02-22T20:52:13.787 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T20:52:13.787 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:13.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: get_monmap_and_config 2026-02-22T20:52:13.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: monmap: 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:13.858825+0000 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:13.858825+0000 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:13.866 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 Processor -- start 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 -- start start 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: init 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd89013f290 0x7fd89013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-a con 0x7fd89013f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd89013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-b con 0x7fd89013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd89013c4b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89008fd70 con 0x7fd89013c4b0 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd89008e1f0 con 0x7fd89013f290 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd89008ec90 con 0x7fd89013fba0 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.854+0000 7fd895b56640 10 monclient(hunting): authenticate will time out at 546.331939s 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd89013f290 0x7fd89013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd89013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd89013f290 0x7fd89013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46084/0 (socket says 10.20.193.7:46084) 2026-02-22T20:52:13.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/91756780 learned_addr learned my addr 10.20.193.7:0/91756780 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd89013c4b0 0x7fd8901a07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39238/0 (socket says 10.20.193.7:39238) 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): get_auth_request con 0x7fd89013f290 auth_method 0 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): get_auth_request con 0x7fd89013fba0 auth_method 0 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_done global_id 4254 payload 274 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 msgr2=0x7fd89013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd89013bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/91756780 >> v1:10.20.193.7:6789/0 conn(0x7fd89013c4b0 legacy=0x7fd8901a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/91756780 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd890092bc0 con 0x7fd89013f290 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013f290 0x7fd89013f660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0090a0 tx=0x7fd87c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b5d41c801d9e5f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 1 -- 10.20.193.7:0/91756780 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0aa600 con 0x7fd89013f290 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: dump: 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.871 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 1 -- 10.20.193.7:0/91756780 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c0af070 con 0x7fd89013f290 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 1 -- 10.20.193.7:0/91756780 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0aa9c0 con 0x7fd89013f290 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 5 monclient: authenticate success, global_id 4254 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 4 set_mon_vals no callback set 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88e7fc640 10 monclient: dump: 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.873 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: shutdown 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013f290 msgr2=0x7fd89013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013f290 0x7fd89013f660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0090a0 tx=0x7fd87c01c590 comp rx=0 tx=0).stop 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/91756780 shutdown_connections 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd89013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- 10.20.193.7:0/91756780 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013f290 0x7fd89013f660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/91756780 >> 10.20.193.7:0/91756780 conn(0x7fd890093df0 msgr2=0x7fd8900902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/91756780 shutdown_connections 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/91756780 wait complete. 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: build_initial_monmap 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: monmap: 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:13.875 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 Processor -- start 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- start start 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: init 2026-02-22T20:52:13.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-a con 0x7fd89013c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 0x7fd890151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-b con 0x7fd89013f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd890129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): picked mon.noname-c con 0x7fd89013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd890090de0 con 0x7fd89013c4b0 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd890090c60 con 0x7fd89013f290 2026-02-22T20:52:13.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd8901a4710 con 0x7fd89013fba0 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient(hunting): authenticate will time out at 546.335360s 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46086/0 (socket says 10.20.193.7:46086) 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/857986397 learned_addr learned my addr 10.20.193.7:0/857986397 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): get_auth_request con 0x7fd89013c4b0 auth_method 0 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd890129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): get_auth_request con 0x7fd89013fba0 auth_method 0 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 0x7fd890151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): get_auth_request con 0x7fd89013f290 auth_method 0 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:13.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient(hunting): handle_auth_done global_id 4260 payload 824 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 msgr2=0x7fd890129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd890129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/857986397 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 msgr2=0x7fd890151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 0x7fd890151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 -- 10.20.193.7:0/857986397 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89012db30 con 0x7fd89013c4b0 2026-02-22T20:52:13.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88effd640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 0x7fd890151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88f7fe640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd87c004780 tx=0x7fd87c01add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c004020 con 0x7fd89013c4b0 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: dump: 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.881 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:13.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c0041c0 con 0x7fd89013c4b0 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 5 monclient: authenticate success, global_id 4260 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c004570 con 0x7fd89013c4b0 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd86bfff640 10 monclient: dump: 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:13.883 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd88dffb640 4 set_mon_vals no callback set 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _renew_subs 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89008a9e0 con 0x7fd89013c4b0 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _renew_subs 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.858+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89013c0e0 con 0x7fd89013c4b0 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd895b56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd895b56640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd895b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89012d4d0 con 0x7fd89013c4b0 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd87c003710 con 0x7fd89013c4b0 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd86bfff640 1 --2- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 0x7fd86005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fd87c0e8d90 con 0x7fd89013c4b0 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd88effd640 1 --2- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 0x7fd86005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd88effd640 10 monclient: get_auth_request con 0x7fd86003ab20 auth_method 0 2026-02-22T20:52:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.862+0000 7fd88effd640 1 --2- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 0x7fd86005afd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd89012c2c0 tx=0x7fd880008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.866+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd89012d4d0 con 0x7fd89013c4b0 2026-02-22T20:52:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.866+0000 7fd86bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.866+0000 7fd86bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:13.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.946+0000 7fd895b56640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.946+0000 7fd895b56640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.946+0000 7fd895b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:13.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.946+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd89013f660 con 0x7fd89013c4b0 2026-02-22T20:52:13.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd86bfff640 1 -- 10.20.193.7:0/857986397 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10807 (secure 0 0 0) 0x7fd87c016210 con 0x7fd89013c4b0 2026-02-22T20:52:13.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd86bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:13.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd86bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:13.952 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:13.952 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":17,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:13.210204+0000","last_up_change":"2026-02-22T20:52:06.185700+0000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T20:52:07.953655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T20:52:10.131782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6800","nonce":2743492886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6801","nonce":2743492886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6805","nonce":2743492886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6803","nonce":2743492886}]},"public_addr":"10.20.193.7:6800/2743492886","cluster_addr":"10.20.193.7:6801/2743492886","heartbeat_back_addr":"10.20.193.7:6805/2743492886","heartbeat_front_addr":"10.20.193.7:6803/2743492886","state":["exists","up"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6802","nonce":2057498835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6804","nonce":2057498835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6807","nonce":2057498835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6806","nonce":2057498835}]},"public_addr":"10.20.193.7:6802/2057498835","cluster_addr":"10.20.193.7:6804/2057498835","heartbeat_back_addr":"10.20.193.7:6807/2057498835","heartbeat_front_addr":"10.20.193.7:6806/2057498835","state":["exists","up"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6808","nonce":1121527665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6809","nonce":1121527665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6811","nonce":1121527665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6810","nonce":1121527665}]},"public_addr":"10.20.193.7:6808/1121527665","cluster_addr":"10.20.193.7:6809/1121527665","heartbeat_back_addr":"10.20.193.7:6811/1121527665","heartbeat_front_addr":"10.20.193.7:6810/1121527665","state":["exists","up"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":3528802164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":3528802164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":3528802164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":3528802164}]},"public_addr":"10.20.193.61:6802/3528802164","cluster_addr":"10.20.193.61:6804/3528802164","heartbeat_back_addr":"10.20.193.61:6808/3528802164","heartbeat_front_addr":"10.20.193.61:6806/3528802164","state":["exists","up"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6801","nonce":461213399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6803","nonce":461213399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6807","nonce":461213399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6805","nonce":461213399}]},"public_addr":"10.20.193.61:6801/461213399","cluster_addr":"10.20.193.61:6803/461213399","heartbeat_back_addr":"10.20.193.61:6807/461213399","heartbeat_front_addr":"10.20.193.61:6805/461213399","state":["exists","up"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6809","nonce":837853154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":837853154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":837853154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6811","nonce":837853154}]},"public_addr":"10.20.193.61:6809/837853154","cluster_addr":"10.20.193.61:6810/837853154","heartbeat_back_addr":"10.20.193.61:6812/837853154","heartbeat_front_addr":"10.20.193.61:6811/837853154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:13.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 msgr2=0x7fd86005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 0x7fd86005afd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd89012c2c0 tx=0x7fd880008040 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 10 monclient: shutdown 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 msgr2=0x7fd890150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd87c004780 tx=0x7fd87c01add0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 shutdown_connections 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd89013fba0 0x7fd890129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd86003ab20 0x7fd86005afd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd89013f290 0x7fd890151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 --2- 10.20.193.7:0/857986397 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd89013c4b0 0x7fd890150b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:13.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 >> 10.20.193.7:0/857986397 conn(0x7fd890093df0 msgr2=0x7fd890055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:13.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 shutdown_connections 2026-02-22T20:52:13.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:13.950+0000 7fd895b56640 1 -- 10.20.193.7:0/857986397 wait complete. 2026-02-22T20:52:13.963 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T20:52:13.964 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T20:52:13.964 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T20:52:13.965 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T20:52:13.965 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-22T20:52:13.965 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-22T20:52:14.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: monmap: 2026-02-22T20:52:14.027 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.028740+0000 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.028740+0000 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 Processor -- start 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 -- start start 2026-02-22T20:52:14.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: init 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: _add_conns ranks=[4,2,3,0,1] 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc71013c350 0x7fc71013c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-c con 0x7fc71013c350 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-b con 0x7fc71013f130 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc71013fa80 0x7fc7101a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-a con 0x7fc71013fa80 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc7100930f0 con 0x7fc71013fa80 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc71008ffd0 con 0x7fc71013c350 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc71008ec00 con 0x7fc71013f130 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient(hunting): authenticate will time out at 546.502146s 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc71013fa80 0x7fc7101a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc71013fa80 0x7fc7101a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46092/0 (socket says 10.20.193.7:46092) 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46362/0 (socket says 10.20.193.7:46362) 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 -- 10.20.193.7:0/3055926222 learned_addr learned my addr 10.20.193.7:0/3055926222 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): get_auth_request con 0x7fc71013fa80 auth_method 0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 1 --2- 10.20.193.7:0/3055926222 >> v2:10.20.193.61:3300/0 conn(0x7fc71013c350 0x7fc71013c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): get_auth_request con 0x7fc71013f130 auth_method 0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): get_auth_request con 0x7fc71013c350 auth_method 0 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715d84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient(hunting): handle_auth_done global_id 4263 payload 274 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 -- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 msgr2=0x7fc71013f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 -- 10.20.193.7:0/3055926222 >> v2:10.20.193.61:3300/0 conn(0x7fc71013c350 msgr2=0x7fc71013c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 --2- 10.20.193.7:0/3055926222 >> v2:10.20.193.61:3300/0 conn(0x7fc71013c350 0x7fc71013c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 -- 10.20.193.7:0/3055926222 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71008eee0 con 0x7fc71013fa80 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc715583640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: monmap: 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.030631+0000 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.030631+0000 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 Processor -- start 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 -- start start 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: init 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd9f813f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-b con 0x7fd9f813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd9f8180d00 0x7fd9f81a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-a con 0x7fd9f8180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f808fd70 con 0x7fd9f813f290 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd9f808e1f0 con 0x7fd9f8180d00 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f808ec90 con 0x7fd9f813fd70 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9fdcb1640 10 monclient(hunting): authenticate will time out at 546.503499s 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd9f8180d00 0x7fd9f81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46366/0 (socket says 10.20.193.7:46366) 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/915796206 learned_addr learned my addr 10.20.193.7:0/915796206 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): get_auth_request con 0x7fd9f813fd70 auth_method 0 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): get_auth_request con 0x7fd9f8180d00 auth_method 0 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc716585640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013fa80 0x7fc7101a04c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009580 tx=0x7fc70c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c013c3cfa2ed1dfe server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_done global_id 4226 payload 274 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/915796206 >> v2:10.20.193.7:3300/0 conn(0x7fd9f8180d00 msgr2=0x7fd9f81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 --2- 10.20.193.7:0/915796206 >> v2:10.20.193.7:3300/0 conn(0x7fd9f8180d00 0x7fd9f81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/915796206 >> v1:10.20.193.61:6789/0 conn(0x7fd9f813f290 legacy=0x7fd9f813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7f55469c4640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7f55469c4640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7f55469c4640 10 monclient: monmap: 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.031482+0000 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.031482+0000 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/915796206 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f8092bc0 con 0x7fd9f813fd70 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 1 -- 10.20.193.7:0/3055926222 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0b2070 con 0x7fc71013fa80 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: dump: 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 1 -- 10.20.193.7:0/3055926222 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c0a5900 con 0x7fc71013fa80 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 1 -- 10.20.193.7:0/3055926222 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0a5cf0 con 0x7fc71013fa80 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc714d82640 10 monclient: dump: 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.035 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 5 monclient: authenticate success, global_id 4263 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.026+0000 7fc71800f640 4 set_mon_vals no callback set 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 Processor -- start 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: shutdown 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013fa80 msgr2=0x7fc7101a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013fa80 0x7fc7101a04c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009580 tx=0x7fc70c01c880 comp rx=0 tx=0).stop 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- start start 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: init 2026-02-22T20:52:14.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/3055926222 shutdown_connections 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013fa80 0x7fc7101a04c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- 10.20.193.7:0/3055926222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013f130 0x7fc71013f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- 10.20.193.7:0/3055926222 >> v2:10.20.193.61:3300/0 conn(0x7fc71013c350 0x7fc71013c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/3055926222 >> 10.20.193.7:0/3055926222 conn(0x7fc7100941c0 msgr2=0x7fc710090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/3055926222 shutdown_connections 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/3055926222 wait complete. 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f554013f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f554013fd70 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f55401a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-b con 0x7f5540181ee0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554008fd70 con 0x7f554013fd70 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5540092bc0 con 0x7f554013f290 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: monmap: 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f554008e1f0 con 0x7f5540181ee0 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): authenticate will time out at 546.504730s 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f554013fd70 0x7f55401807c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39248/0 (socket says 10.20.193.7:39248) 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 1 -- 10.20.193.7:0/350501542 learned_addr learned my addr 10.20.193.7:0/350501542 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- 10.20.193.7:0/350501542 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f55401a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- 10.20.193.7:0/915796206 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9f808e370 tx=0x7fd9e801c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c233f22ab808e3a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): get_auth_request con 0x7f5540181ee0 auth_method 0 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 Processor -- start 2026-02-22T20:52:14.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- start start 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: init 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_done global_id 4229 payload 274 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/350501542 >> v1:10.20.193.61:6789/0 conn(0x7f554013f290 legacy=0x7f554013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 1 -- 10.20.193.7:0/915796206 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80b0070 con 0x7fd9f813fd70 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/350501542 >> v1:10.20.193.7:6789/0 conn(0x7f554013fd70 legacy=0x7f55401807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/350501542 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554008e6d0 con 0x7f5540181ee0 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: dump: 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 1 -- 10.20.193.7:0/915796206 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e80ab600 con 0x7fd9f813fd70 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 1 -- 10.20.193.7:0/915796206 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80ab9d0 con 0x7fd9f813fd70 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 5 monclient: authenticate success, global_id 4226 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 4 set_mon_vals no callback set 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f67fc640 10 monclient: dump: 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.042 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc71013c350 0x7fc7101507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-b con 0x7fc71013c350 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 0x7fc710150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-a con 0x7fc71013f130 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: shutdown 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/915796206 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 msgr2=0x7fd9f81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013fa80 0x7fc710129de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): picked mon.noname-c con 0x7fc71013fa80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc710090bf0 con 0x7fc71013f130 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/915796206 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9f808e370 tx=0x7fd9e801c2f0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc71013cc60 con 0x7fc71013c350 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc710090d70 con 0x7fc71013fa80 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient(hunting): authenticate will time out at 546.505311s 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/915796206 shutdown_connections 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/915796206 >> v2:10.20.193.7:3300/0 conn(0x7fd9f8180d00 0x7fd9f81a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/915796206 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/915796206 >> 10.20.193.7:0/915796206 conn(0x7fd9f8093df0 msgr2=0x7fd9f80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 0x7fc710150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 0x7fc710150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46104/0 (socket says 10.20.193.7:46104) 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/915796206 shutdown_connections 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 -- 10.20.193.7:0/573167887 learned_addr learned my addr 10.20.193.7:0/573167887 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): get_auth_request con 0x7fc71013f130 auth_method 0 2026-02-22T20:52:14.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/915796206 wait complete. 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013fa80 0x7fc710129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc71013c350 0x7fc7101507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 10 monclient(hunting): get_auth_request con 0x7fc71013fa80 auth_method 0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 10 monclient(hunting): get_auth_request con 0x7fc71013c350 auth_method 0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient(hunting): handle_auth_done global_id 4272 payload 824 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 -- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013fa80 msgr2=0x7fc710129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc71013fa80 0x7fc710129de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 -- 10.20.193.7:0/573167887 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc71013c350 msgr2=0x7fc7101507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc71013c350 0x7fc7101507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 -- 10.20.193.7:0/573167887 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71008a970 con 0x7fc71013f130 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715583640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 0x7fc710150d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc70400ebb0 tx=0x7fc70400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704017070 con 0x7fc71013f130 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: dump: 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.046 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70400cc30 con 0x7fc71013f130 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704013470 con 0x7fc71013f130 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 5 monclient: authenticate success, global_id 4272 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _renew_subs 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fffff640 4 set_mon_vals no callback set 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71012d670 con 0x7fc71013f130 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: dump: 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _renew_subs 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71013d0a0 con 0x7fc71013f130 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: monmap: 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 Processor -- start 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- 10.20.193.7:0/350501542 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f55401a22c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5534009d40 tx=0x7f553401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420a3c5d53da5438 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc71013c720 con 0x7fc71013f130 2026-02-22T20:52:14.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- start start 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: init 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc704005a80 con 0x7fc71013f130 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 1 -- 10.20.193.7:0/350501542 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340b2070 con 0x7f5540181ee0 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: dump: 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.049 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 1 -- 10.20.193.7:0/350501542 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55340a57e0 con 0x7f5540181ee0 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 1 -- 10.20.193.7:0/350501542 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340a5bd0 con 0x7f5540181ee0 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553effd640 10 monclient: dump: 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 5 monclient: authenticate success, global_id 4229 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 4 set_mon_vals no callback set 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc6e003ab20 0x7fc6e005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd9f813f290 0x7fd9f812bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-a con 0x7fd9f813f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-c con 0x7fd9f813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fc70404e6a0 con 0x7fc71013f130 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd9f8180d00 0x7fd9f8128790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): picked mon.noname-b con 0x7fd9f8180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81a4050 con 0x7fd9f813f290 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8090da0 con 0x7fd9f8180d00 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f81a41d0 con 0x7fd9f813fd70 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient(hunting): authenticate will time out at 546.506576s 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.7:6800/2743492886 conn(0x7fc6e005e660 0x7fc6e007ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 --> v2:10.20.193.7:6800/2743492886 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6e007f120 con 0x7fc6e005e660 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc704055050 con 0x7fc71013f130 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd9f813f290 0x7fd9f812bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46382/0 (socket says 10.20.193.7:46382) 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd9f813f290 0x7fd9f812bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46112/0 (socket says 10.20.193.7:46112) 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/3267594825 learned_addr learned my addr 10.20.193.7:0/3267594825 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): get_auth_request con 0x7fd9f813fd70 auth_method 0 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): get_auth_request con 0x7fd9f813f290 auth_method 0 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: shutdown 2026-02-22T20:52:14.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- 10.20.193.7:0/350501542 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 msgr2=0x7f55401a22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- 10.20.193.7:0/350501542 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f55401a22c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5534009d40 tx=0x7f553401c850 comp rx=0 tx=0).stop 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc6e003ab20 0x7fc6e005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- 10.20.193.7:0/350501542 shutdown_connections 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- 10.20.193.7:0/350501542 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f55401a22c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- 10.20.193.7:0/350501542 >> 10.20.193.7:0/350501542 conn(0x7f5540093df0 msgr2=0x7f55400902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 10 monclient: get_auth_request con 0x7fc6e003ab20 auth_method 0 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.7:6800/2743492886 conn(0x7fc6e005e660 0x7fc6e007ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 10 monclient: get_auth_request con 0x7fc6e005e660 auth_method 0 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f7fff640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd9f8180d00 0x7fd9f8128790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- 10.20.193.7:0/350501542 shutdown_connections 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient(hunting): handle_auth_done global_id 4235 payload 824 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/3267594825 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd9f8180d00 msgr2=0x7fd9f8128790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd9f8180d00 0x7fd9f8128790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/3267594825 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd9f813f290 msgr2=0x7fd9f812bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd9f813f290 0x7fd9f812bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- 10.20.193.7:0/350501542 wait complete. 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 -- 10.20.193.7:0/3267594825 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f808a9e0 con 0x7fd9f813fd70 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f7fff640 10 monclient: get_auth_request con 0x7fd9f8180d00 auth_method 0 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f7fff640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd9f8180d00 0x7fd9f8128790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f6ffd640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8004780 tx=0x7fd9e8019090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc716585640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.7:6800/2743492886 conn(0x7fc6e005e660 0x7fc6e007ea90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80b0050 con 0x7fd9f813fd70 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: dump: 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e80b1040 con 0x7fd9f813fd70 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 5 monclient: authenticate success, global_id 4235 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _renew_subs 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f810d680 con 0x7fd9f813fd70 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8004020 con 0x7fd9f813fd70 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: dump: 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9f5ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _renew_subs 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f810cde0 con 0x7fd9f813fd70 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc715d84640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc6e003ab20 0x7fc6e005afd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc700004780 tx=0x7fc700008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: monmap: 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.057 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9f813f660 con 0x7fd9f813fd70 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== osd.0 v2:10.20.193.7:6800/2743492886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fc6e007f120 con 0x7fc6e005e660 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 Processor -- start 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 10 monclient: monmap: 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.035229+0000 2026-02-22T20:52:14.058 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.035229+0000 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- start start 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: init 2026-02-22T20:52:14.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd9e80041c0 con 0x7fd9f813fd70 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554013f290 0x7f554019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-b con 0x7f554013f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554013fd70 0x7f554019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-a con 0x7f554013fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f554019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): picked mon.noname-c con 0x7f5540181ee0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55401a5880 con 0x7f554013fd70 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f55401a5700 con 0x7f554013f290 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f55401a5a00 con 0x7f5540181ee0 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f55469c4640 10 monclient(hunting): authenticate will time out at 546.507735s 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f554019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554013fd70 0x7f554019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f554019bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46384/0 (socket says 10.20.193.7:46384) 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/4282708310 learned_addr learned my addr 10.20.193.7:0/4282708310 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): get_auth_request con 0x7f5540181ee0 auth_method 0 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd9c803ab20 0x7fd9c805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): get_auth_request con 0x7f554013fd70 auth_method 0 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 1 Processor -- start 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fd9e80e8350 con 0x7fd9f813fd70 2026-02-22T20:52:14.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553ffff640 1 --2- 10.20.193.7:0/4282708310 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554013f290 0x7f554019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553ffff640 10 monclient(hunting): get_auth_request con 0x7f554013f290 auth_method 0 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f553ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 1 -- start start 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fc25e2ef640 10 monclient: init 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6802/3528802164 conn(0x7fd9c805e660 0x7fd9c807ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 --> v2:10.20.193.61:6802/3528802164 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e80baec0 con 0x7fd9c805e660 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd9e80ef050 con 0x7fd9f813fd70 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7fd9d3fff640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient(hunting): handle_auth_done global_id 4238 payload 824 2026-02-22T20:52:14.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/4282708310 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554013f290 msgr2=0x7f554019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- 10.20.193.7:0/4282708310 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554013f290 0x7f554019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 -- 10.20.193.7:0/4282708310 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554013fd70 msgr2=0x7f554019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 --2- 10.20.193.7:0/4282708310 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554013fd70 0x7f554019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.030+0000 7f5544f3a640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f5544f3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f5544f3a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f5544f3a640 1 -- 10.20.193.7:0/4282708310 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5540056d70 con 0x7f5540181ee0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f77fe640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd9c803ab20 0x7fd9c805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f77fe640 10 monclient: get_auth_request con 0x7fd9c803ab20 auth_method 0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f5544f3a640 1 --2- 10.20.193.7:0/4282708310 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f554019bf60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f553401cdc0 tx=0x7f55340195f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340bb070 con 0x7f5540181ee0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: dump: 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.063 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f7fff640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6802/3528802164 conn(0x7fd9c805e660 0x7fd9c807ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55340a6c20 con 0x7f5540181ee0 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 5 monclient: authenticate success, global_id 4238 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340b2040 con 0x7f5540181ee0 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f7fff640 10 monclient: get_auth_request con 0x7fd9c805e660 auth_method 0 2026-02-22T20:52:14.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: dump: 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 10 monclient: _renew_subs 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553e7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc2580880c0 0x7fc25813ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55401a2430 con 0x7f5540181ee0 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-a con 0x7fc2580880c0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc258087520 0x7fc258087930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-b con 0x7fc258087520 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 10 monclient: _renew_subs 2026-02-22T20:52:14.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f554019f5f0 con 0x7f5540181ee0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc25808f890 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc25813d500 con 0x7fc25808f890 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc258086080 con 0x7fc2580880c0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc25808c780 con 0x7fc258087520 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): authenticate will time out at 546.508302s 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc2580880c0 0x7fc25813ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc258087520 0x7fc258087930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc25808f890 0x7fc25808fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39256/0 (socket says 10.20.193.7:39256) 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 1 -- 10.20.193.7:0/783755719 learned_addr learned my addr 10.20.193.7:0/783755719 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): get_auth_request con 0x7fc2580880c0 auth_method 0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): get_auth_request con 0x7fc258087520 auth_method 0 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 -- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc258087520 msgr2=0x7fc258087930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 --2- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc258087520 0x7fc258087930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 -- 10.20.193.7:0/783755719 >> v1:10.20.193.7:6789/0 conn(0x7fc25808f890 legacy=0x7fc25808fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f554013ef20 con 0x7f5540181ee0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 1 -- 10.20.193.7:0/783755719 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218724554 0 0) 0x7fc25813d500 con 0x7fc25808f890 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 -- 10.20.193.7:0/783755719 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc258087e70 con 0x7fc2580880c0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: monmap: 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.036369+0000 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.036369+0000 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.068 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f77fe640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd9c803ab20 0x7fd9c805afd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40037b0 tx=0x7fd9e40037e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5534004040 con 0x7f5540181ee0 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9f7fff640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6802/3528802164 conn(0x7fd9c805e660 0x7fd9c807ea90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551003ab20 0x7f551005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f55340e96b0 con 0x7f5540181ee0 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 Processor -- start 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- start start 2026-02-22T20:52:14.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: init 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6801/461213399 conn(0x7f551005e5f0 0x7f551007ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 --> v2:10.20.193.61:6801/461213399 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f551007f0b0 con 0x7f551005e5f0 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f55340f0050 con 0x7f5540181ee0 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553ffff640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551003ab20 0x7f551005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553ffff640 10 monclient: get_auth_request con 0x7f551003ab20 auth_method 0 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553f7fe640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6801/461213399 conn(0x7f551005e5f0 0x7f551007ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-22T20:52:14.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553f7fe640 10 monclient: get_auth_request con 0x7f551005e5f0 auth_method 0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fa56c13f290 0x7fa56c13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-c con 0x7fa56c13f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 0x7fa56c13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-b con 0x7fa56c13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa56c13c4b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56c08fd70 con 0x7fa56c13c4b0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c08e1f0 con 0x7fa56c13f290 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c08ec90 con 0x7fa56c13fba0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient(hunting): authenticate will time out at 546.509293s 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 0x7fa56c13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa57084a640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fa56c13c4b0 0x7fa56c1a07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39268/0 (socket says 10.20.193.7:39268) 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa57084a640 1 -- 10.20.193.7:0/4108788564 learned_addr learned my addr 10.20.193.7:0/4108788564 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): get_auth_request con 0x7fa56c13fba0 auth_method 0 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56bfff640 1 --2- 10.20.193.7:0/4108788564 >> v2:10.20.193.61:3300/0 conn(0x7fa56c13f290 0x7fa56c13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56bfff640 10 monclient(hunting): get_auth_request con 0x7fa56c13f290 auth_method 0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 1 -- 10.20.193.7:0/4108788564 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823981001 0 0) 0x7fa560002ca0 con 0x7fa56c13c4b0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_done global_id 4244 payload 274 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 -- 10.20.193.7:0/4108788564 >> v2:10.20.193.61:3300/0 conn(0x7fa56c13f290 msgr2=0x7fa56c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 --2- 10.20.193.7:0/4108788564 >> v2:10.20.193.61:3300/0 conn(0x7fa56c13f290 0x7fa56c13f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 -- 10.20.193.7:0/4108788564 >> v1:10.20.193.7:6789/0 conn(0x7fa56c13c4b0 legacy=0x7fa56c1a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 -- 10.20.193.7:0/4108788564 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c092bc0 con 0x7fa56c13fba0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== osd.3 v2:10.20.193.61:6802/3528802164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fd9e80baec0 con 0x7fd9c805e660 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553f7fe640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6801/461213399 conn(0x7f551005e5f0 0x7f551007ea20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553ffff640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551003ab20 0x7f551005afd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f552c0037b0 tx=0x7f552c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: monmap: 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.072 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.037554+0000 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.037554+0000 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 --2- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2580880c0 0x7fc25813ce50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc244004780 tx=0x7fc24401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bca5bf995ba327 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 1 -- 10.20.193.7:0/783755719 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2440b0070 con 0x7fc2580880c0 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: dump: 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 Processor -- start 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 1 -- 10.20.193.7:0/783755719 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2440ab600 con 0x7fc2580880c0 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 1 -- 10.20.193.7:0/783755719 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2440ab9b0 con 0x7fc2580880c0 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 5 monclient: authenticate success, global_id 4281 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 4 set_mon_vals no callback set 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc256ffd640 10 monclient: dump: 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 -- start start 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: init 2026-02-22T20:52:14.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== osd.4 v2:10.20.193.61:6801/461213399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f551007f0b0 con 0x7f551005e5f0 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdaa813f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: shutdown 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fdaa8180d00 0x7fdaa81a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-c con 0x7fdaa8180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa808fd70 con 0x7fdaa813f290 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa808e1f0 con 0x7fdaa8180d00 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2580880c0 msgr2=0x7fc25813ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2580880c0 0x7fc25813ce50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc244004780 tx=0x7fc24401c440 comp rx=0 tx=0).stop 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa808ec90 con 0x7fdaa813fd70 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaadc63640 10 monclient(hunting): authenticate will time out at 546.510423s 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/783755719 shutdown_connections 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc258087520 0x7fc258087930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/783755719 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2580880c0 0x7fc25813ce50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/783755719 >> 10.20.193.7:0/783755719 conn(0x7fc258091690 msgr2=0x7fc258091a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/783755719 shutdown_connections 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/783755719 wait complete. 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46422/0 (socket says 10.20.193.7:46422) 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2133292522 learned_addr learned my addr 10.20.193.7:0/2133292522 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): get_auth_request con 0x7fdaa813fd70 auth_method 0 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa7fff640 1 --2- 10.20.193.7:0/2133292522 >> v2:10.20.193.61:3300/0 conn(0x7fdaa8180d00 0x7fdaa81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa7fff640 10 monclient(hunting): get_auth_request con 0x7fdaa8180d00 auth_method 0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_done global_id 4247 payload 274 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2133292522 >> v2:10.20.193.61:3300/0 conn(0x7fdaa8180d00 msgr2=0x7fdaa81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 --2- 10.20.193.7:0/2133292522 >> v2:10.20.193.61:3300/0 conn(0x7fdaa8180d00 0x7fdaa81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2133292522 >> v1:10.20.193.61:6789/0 conn(0x7fdaa813f290 legacy=0x7fdaa813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2133292522 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa8092bc0 con 0x7fdaa813fd70 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56b7fe640 1 --2- 10.20.193.7:0/4108788564 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 0x7fa56c13bf70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa55c004780 tx=0x7fa55c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261e888ca4b40883 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: monmap: 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.077 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 1 -- 10.20.193.7:0/4108788564 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0b1070 con 0x7fa56c13fba0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: dump: 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 1 -- 10.20.193.7:0/4108788564 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a8050 con 0x7fa56c13fba0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 1 -- 10.20.193.7:0/4108788564 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ac860 con 0x7fa56c13fba0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 5 monclient: authenticate success, global_id 4244 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 4 set_mon_vals no callback set 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa56affd640 10 monclient: dump: 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.078 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 Processor -- start 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- start start 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: init 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: shutdown 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- 10.20.193.7:0/4108788564 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 msgr2=0x7fa56c13bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 --2- 10.20.193.7:0/4108788564 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 0x7fa56c13bf70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa55c004780 tx=0x7fa55c01c4d0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc258087520 0x7fc25810c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-b con 0x7fc258087520 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 0x7fc25810c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-c con 0x7fc2580880c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc25808f890 0x7fc25810caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): picked mon.noname-a con 0x7fc25808f890 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581a1de0 con 0x7fc25808f890 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581a1c60 con 0x7fc258087520 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc2581a1f60 con 0x7fc2580880c0 2026-02-22T20:52:14.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient(hunting): authenticate will time out at 546.511251s 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- 10.20.193.7:0/4108788564 shutdown_connections 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 --2- 10.20.193.7:0/4108788564 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13fba0 0x7fa56c13bf70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 --2- 10.20.193.7:0/4108788564 >> v2:10.20.193.61:3300/0 conn(0x7fa56c13f290 0x7fa56c13f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- 10.20.193.7:0/4108788564 >> 10.20.193.7:0/4108788564 conn(0x7fa56c093df0 msgr2=0x7fa56c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- 10.20.193.7:0/4108788564 shutdown_connections 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc25808f890 0x7fc25810caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- 10.20.193.7:0/4108788564 wait complete. 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 0x7fc25810c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 0x7fc25810c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46438/0 (socket says 10.20.193.7:46438) 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 -- 10.20.193.7:0/2192885112 learned_addr learned my addr 10.20.193.7:0/2192885112 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): get_auth_request con 0x7fc2580880c0 auth_method 0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): get_auth_request con 0x7fc25808f890 auth_method 0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc258087520 0x7fc25810c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): get_auth_request con 0x7fc258087520 auth_method 0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc257fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient(hunting): handle_auth_done global_id 4250 payload 824 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 -- 10.20.193.7:0/2192885112 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc258087520 msgr2=0x7fc25810c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc258087520 0x7fc25810c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 -- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc25808f890 msgr2=0x7fc25810caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc25808f890 0x7fc25810caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 -- 10.20.193.7:0/2192885112 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25810d310 con 0x7fc2580880c0 2026-02-22T20:52:14.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25c865640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc25808f890 0x7fc25810caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2577fe640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 0x7fc25810c560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc248006b80 tx=0x7fc24800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: monmap: 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248017070 con 0x7fc2580880c0 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: dump: 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.082 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24800c8e0 con 0x7fc2580880c0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800ccb0 con 0x7fc2580880c0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 5 monclient: authenticate success, global_id 4250 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc2567fc640 4 set_mon_vals no callback set 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _renew_subs 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25810f370 con 0x7fc2580880c0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc254ff9640 10 monclient: dump: 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _renew_subs 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc258089dc0 con 0x7fc2580880c0 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 Processor -- start 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 1 -- start start 2026-02-22T20:52:14.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fa5722d4640 10 monclient: init 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.034+0000 7fdaa6ffd640 1 --2- 10.20.193.7:0/2133292522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdaa808e370 tx=0x7fda9401c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c3dbc1b011bf87d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 0x7fa56c129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 1 -- 10.20.193.7:0/2133292522 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940b0070 con 0x7fdaa813fd70 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-c con 0x7fa56c13c4b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 0x7fa56c12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-a con 0x7fa56c13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa56c13fba0 0x7fa56c12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): picked mon.noname-b con 0x7fa56c13fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: dump: 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.084 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 1 -- 10.20.193.7:0/2133292522 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940ab600 con 0x7fdaa813fd70 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 5 monclient: authenticate success, global_id 4247 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c090e20 con 0x7fa56c13f290 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c090ca0 con 0x7fa56c13fba0 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c1a4710 con 0x7fa56c13c4b0 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 1 -- 10.20.193.7:0/2133292522 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940ab9d0 con 0x7fdaa813fd70 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 4 set_mon_vals no callback set 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient(hunting): authenticate will time out at 546.512148s 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa67fc640 10 monclient: dump: 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.085 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 0x7fa56c12a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 0x7fa56c129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc25e2ef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc25810e0b0 con 0x7fc2580880c0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 0x7fa56c129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46446/0 (socket says 10.20.193.7:46446) 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 -- 10.20.193.7:0/951873524 learned_addr learned my addr 10.20.193.7:0/951873524 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 0x7fa56c12a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46140/0 (socket says 10.20.193.7:46140) 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): get_auth_request con 0x7fa56c13c4b0 auth_method 0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): get_auth_request con 0x7fa56c13f290 auth_method 0 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa56c13fba0 0x7fa56c12a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient(hunting): handle_auth_done global_id 4253 payload 824 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 -- 10.20.193.7:0/951873524 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa56c13fba0 msgr2=0x7fa56c12a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa56c13fba0 0x7fa56c12a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 -- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 msgr2=0x7fa56c12a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 0x7fa56c12a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: shutdown 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 -- 10.20.193.7:0/951873524 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c08a9e0 con 0x7fa56c13c4b0 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2133292522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 msgr2=0x7fdaa81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2133292522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdaa808e370 tx=0x7fda9401c2f0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56b7fe640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa56c13f290 0x7fa56c12a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 10 monclient: get_auth_request con 0x7fa56c13fba0 auth_method 0 2026-02-22T20:52:14.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa56c13fba0 0x7fa56c12a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc248013470 con 0x7fc2580880c0 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2133292522 shutdown_connections 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2133292522 >> v2:10.20.193.61:3300/0 conn(0x7fdaa8180d00 0x7fdaa81a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2133292522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2133292522 >> 10.20.193.7:0/2133292522 conn(0x7fdaa8093df0 msgr2=0x7fdaa80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2133292522 shutdown_connections 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2133292522 wait complete. 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56bfff640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 0x7fa56c129e50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa55800e770 tx=0x7fa55800ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558017070 con 0x7fa56c13c4b0 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc22803ab20 0x7fc22805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: dump: 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.088 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55800c8d0 con 0x7fa56c13c4b0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fc24804ed80 con 0x7fc2580880c0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55800f040 con 0x7fa56c13c4b0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa56a7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: dump: 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 5 monclient: authenticate success, global_id 4253 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _renew_subs 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c12da50 con 0x7fa56c13c4b0 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _renew_subs 2026-02-22T20:52:14.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c12d490 con 0x7fa56c13c4b0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.7:6808/1121527665 conn(0x7fc22805e660 0x7fc22807ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 --> v2:10.20.193.7:6808/1121527665 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc24800ce50 con 0x7fc22805e660 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc248051450 con 0x7fc2580880c0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc257fff640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc22803ab20 0x7fc22805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc25c865640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.7:6808/1121527665 conn(0x7fc22805e660 0x7fc22807ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc257fff640 10 monclient: get_auth_request con 0x7fc22803ab20 auth_method 0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: monmap: 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc25c865640 10 monclient: get_auth_request con 0x7fc22805e660 auth_method 0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 Processor -- start 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc25c865640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.7:6808/1121527665 conn(0x7fc22805e660 0x7fc22807ea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- start start 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: init 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa56c13f660 con 0x7fa56c13c4b0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa558012050 con 0x7fa56c13c4b0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc257fff640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc22803ab20 0x7fc22805afd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc24401c480 tx=0x7fc244008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaa813f290 0x7fdaa810bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa813f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-c con 0x7fdaa813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 0x7fdaa8128bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): picked mon.noname-a con 0x7fdaa8180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa81a4050 con 0x7fdaa8180d00 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8090da0 con 0x7fdaa813f290 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa53c03ab20 0x7fa53c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa81a41d0 con 0x7fdaa813fd70 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient(hunting): authenticate will time out at 546.513343s 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fa55804e410 con 0x7fa56c13c4b0 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 0x7fdaa8128bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 0x7fdaa8128bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46148/0 (socket says 10.20.193.7:46148) 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 -- 10.20.193.7:0/2384579731 learned_addr learned my addr 10.20.193.7:0/2384579731 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6809/837853154 conn(0x7fa53c05e660 0x7fa53c07ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): get_auth_request con 0x7fdaa8180d00 auth_method 0 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): get_auth_request con 0x7fdaa813fd70 auth_method 0 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 --> v2:10.20.193.61:6809/837853154 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa558019ec0 con 0x7fa53c05e660 2026-02-22T20:52:14.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa558055050 con 0x7fa56c13c4b0 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa77fe640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaa813f290 0x7fdaa810bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa77fe640 10 monclient(hunting): get_auth_request con 0x7fdaa813f290 auth_method 0 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient(hunting): handle_auth_done global_id 4256 payload 824 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2384579731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaa813f290 msgr2=0x7fdaa810bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaa813f290 0x7fdaa810bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 msgr2=0x7fdaa8128bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 0x7fdaa8128bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 -- 10.20.193.7:0/2384579731 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa810cce0 con 0x7fdaa813fd70 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaa8180d00 0x7fdaa8128bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6809/837853154 conn(0x7fa53c05e660 0x7fa53c07ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== osd.2 v2:10.20.193.7:6808/1121527665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fc24800ce50 con 0x7fc22805e660 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 10 monclient: get_auth_request con 0x7fa53c05e660 auth_method 0 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa6ffd640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdaa808e370 tx=0x7fda94019090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940b9020 con 0x7fdaa813fd70 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: dump: 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940b1040 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940b0050 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: dump: 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa5ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 5 monclient: authenticate success, global_id 4256 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _renew_subs 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa813d2d0 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _renew_subs 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa810d580 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa57084a640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6809/837853154 conn(0x7fa53c05e660 0x7fa53c07ea90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdaa813f660 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fda94004220 con 0x7fdaa813fd70 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fda7803ab20 0x7fda7805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fda940e7f20 con 0x7fdaa813fd70 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.7:6802/2057498835 conn(0x7fda7805e660 0x7fda7807ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 --> v2:10.20.193.7:6802/2057498835 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda940ab600 con 0x7fda7805e660 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fda940ea580 con 0x7fdaa813fd70 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.7:6802/2057498835 conn(0x7fda7805e660 0x7fda7807ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 10 monclient: get_auth_request con 0x7fda7805e660 auth_method 0 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== osd.5 v2:10.20.193.61:6809/837853154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fa558019ec0 con 0x7fa53c05e660 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fdaa7fff640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.7:6802/2057498835 conn(0x7fda7805e660 0x7fda7807ea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== osd.1 v2:10.20.193.7:6802/2057498835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fda940ab600 con 0x7fda7805e660 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 --> v2:10.20.193.7:6800/2743492886 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc710058880 con 0x7fc6e005e660 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.038+0000 7fc6fe7fc640 1 -- 10.20.193.7:0/573167887 <== osd.0 v2:10.20.193.7:6800/2743492886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc710058880 con 0x7fc6e005e660 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 >> v2:10.20.193.7:6800/2743492886 conn(0x7fc6e005e660 msgr2=0x7fc6e007ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.7:6800/2743492886 conn(0x7fc6e005e660 0x7fc6e007ea90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc6e003ab20 msgr2=0x7fc6e005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 --2- 10.20.193.7:0/573167887 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc6e003ab20 0x7fc6e005afd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc700004780 tx=0x7fc700008040 comp rx=0 tx=0).stop 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 10 monclient: shutdown 2026-02-22T20:52:14.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 msgr2=0x7fc710150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 --2- 10.20.193.7:0/573167887 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc71013f130 0x7fc710150d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc70400ebb0 tx=0x7fc70400c520 comp rx=0 tx=0).stop 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc716585640 1 -- 10.20.193.7:0/573167887 reap_dead start 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 shutdown_connections 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 >> 10.20.193.7:0/573167887 conn(0x7fc7100941c0 msgr2=0x7fc7100561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 shutdown_connections 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fc71800f640 1 -- 10.20.193.7:0/573167887 wait complete. 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 --> v2:10.20.193.61:6802/3528802164 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9f810be80 con 0x7fd9c805e660 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9d3fff640 1 -- 10.20.193.7:0/3267594825 <== osd.3 v2:10.20.193.61:6802/3528802164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd9f810be80 con 0x7fd9c805e660 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6802/3528802164 conn(0x7fd9c805e660 msgr2=0x7fd9c807ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6802/3528802164 conn(0x7fd9c805e660 0x7fd9c807ea90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd9c803ab20 msgr2=0x7fd9c805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/3267594825 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd9c803ab20 0x7fd9c805afd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40037b0 tx=0x7fd9e40037e0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 10 monclient: shutdown 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 msgr2=0x7fd9f81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 --2- 10.20.193.7:0/3267594825 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd9f813fd70 0x7fd9f81807c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8004780 tx=0x7fd9e8019090 comp rx=0 tx=0).stop 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9f7fff640 1 -- 10.20.193.7:0/3267594825 reap_dead start 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 shutdown_connections 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 >> 10.20.193.7:0/3267594825 conn(0x7fd9f8093df0 msgr2=0x7fd9f8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 shutdown_connections 2026-02-22T20:52:14.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.042+0000 7fd9fdcb1640 1 -- 10.20.193.7:0/3267594825 wait complete. 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 --> v2:10.20.193.61:6801/461213399 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f554013f660 con 0x7f551005e5f0 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f553cff9640 1 -- 10.20.193.7:0/4282708310 <== osd.4 v2:10.20.193.61:6801/461213399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f554013f660 con 0x7f551005e5f0 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6801/461213399 conn(0x7f551005e5f0 msgr2=0x7f551007ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6801/461213399 conn(0x7f551005e5f0 0x7f551007ea20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 --> v2:10.20.193.7:6802/2057498835 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdaa8056180 con 0x7fda7805e660 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551003ab20 msgr2=0x7f551005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 --2- 10.20.193.7:0/4282708310 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551003ab20 0x7f551005afd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f552c0037b0 tx=0x7f552c009040 comp rx=0 tx=0).stop 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 10 monclient: shutdown 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 msgr2=0x7f554019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 --2- 10.20.193.7:0/4282708310 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5540181ee0 0x7f554019bf60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f553401cdc0 tx=0x7f55340195f0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f5544f3a640 1 -- 10.20.193.7:0/4282708310 reap_dead start 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 shutdown_connections 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 >> 10.20.193.7:0/4282708310 conn(0x7f5540093df0 msgr2=0x7f554013d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 shutdown_connections 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7f55469c4640 1 -- 10.20.193.7:0/4282708310 wait complete. 2026-02-22T20:52:14.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fda83fff640 1 -- 10.20.193.7:0/2384579731 <== osd.1 v2:10.20.193.7:6802/2057498835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdaa8056180 con 0x7fda7805e660 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 >> v2:10.20.193.7:6802/2057498835 conn(0x7fda7805e660 msgr2=0x7fda7807ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.7:6802/2057498835 conn(0x7fda7805e660 0x7fda7807ea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fda7803ab20 msgr2=0x7fda7805afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2384579731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fda7803ab20 0x7fda7805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 10 monclient: shutdown 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 msgr2=0x7fdaa81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 --2- 10.20.193.7:0/2384579731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaa813fd70 0x7fdaa81807c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdaa808e370 tx=0x7fda94019090 comp rx=0 tx=0).stop 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaa7fff640 1 -- 10.20.193.7:0/2384579731 reap_dead start 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 shutdown_connections 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 >> 10.20.193.7:0/2384579731 conn(0x7fdaa8093df0 msgr2=0x7fdaa8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 shutdown_connections 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.046+0000 7fdaadc63640 1 -- 10.20.193.7:0/2384579731 wait complete. 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 --> v2:10.20.193.7:6808/1121527665 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc258056ca0 con 0x7fc22805e660 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc254ff9640 1 -- 10.20.193.7:0/2192885112 <== osd.2 v2:10.20.193.7:6808/1121527665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc258056ca0 con 0x7fc22805e660 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 --> v2:10.20.193.61:6809/837853154 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa56c12c4b0 con 0x7fa53c05e660 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 >> v2:10.20.193.7:6808/1121527665 conn(0x7fc22805e660 msgr2=0x7fc22807ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.7:6808/1121527665 conn(0x7fc22805e660 0x7fc22807ea90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa568ff9640 1 -- 10.20.193.7:0/951873524 <== osd.5 v2:10.20.193.61:6809/837853154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa56c12c4b0 con 0x7fa53c05e660 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc22803ab20 msgr2=0x7fc22805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/2192885112 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc22803ab20 0x7fc22805afd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc24401c480 tx=0x7fc244008040 comp rx=0 tx=0).stop 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 10 monclient: shutdown 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 msgr2=0x7fc25810c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 --2- 10.20.193.7:0/2192885112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2580880c0 0x7fc25810c560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc248006b80 tx=0x7fc24800ed40 comp rx=0 tx=0).stop 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25c865640 1 -- 10.20.193.7:0/2192885112 reap_dead start 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 shutdown_connections 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 >> 10.20.193.7:0/2192885112 conn(0x7fc258091690 msgr2=0x7fc258121380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 shutdown_connections 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fc25e2ef640 1 -- 10.20.193.7:0/2192885112 wait complete. 2026-02-22T20:52:14.100 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.101 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6809/837853154 conn(0x7fa53c05e660 msgr2=0x7fa53c07ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6809/837853154 conn(0x7fa53c05e660 0x7fa53c07ea90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa53c03ab20 msgr2=0x7fa53c05afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 --2- 10.20.193.7:0/951873524 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa53c03ab20 0x7fa53c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 10 monclient: shutdown 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 msgr2=0x7fa56c129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 --2- 10.20.193.7:0/951873524 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa56c13c4b0 0x7fa56c129e50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa55800e770 tx=0x7fa55800ec30 comp rx=0 tx=0).stop 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa57084a640 1 -- 10.20.193.7:0/951873524 reap_dead start 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 shutdown_connections 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 >> 10.20.193.7:0/951873524 conn(0x7fa56c093df0 msgr2=0x7fa56c13e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 shutdown_connections 2026-02-22T20:52:14.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.050+0000 7fa5722d4640 1 -- 10.20.193.7:0/951873524 wait complete. 2026-02-22T20:52:14.102 INFO:teuthology.orchestra.run.trial007.stdout:47244640260 2026-02-22T20:52:14.102 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T20:52:14.102 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.102 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T20:52:14.102 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.102 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T20:52:14.103 INFO:teuthology.orchestra.run.trial007.stdout:47244640260 2026-02-22T20:52:14.103 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T20:52:14.103 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.103 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.198+0000 7f5980d91640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.198+0000 7f5980d91640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.198+0000 7f5980d91640 10 monclient: monmap: 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.203382+0000 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.203382+0000 2026-02-22T20:52:14.202 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.198+0000 7f5980d91640 1 Processor -- start 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- start start 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: init 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: monmap: 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.203 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.204127+0000 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.204127+0000 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f597c13f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-b con 0x7f597c13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f597c180d00 0x7f597c1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-c con 0x7f597c180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 Processor -- start 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597c08fd70 con 0x7f597c13f290 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f597c08e1f0 con 0x7f597c180d00 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f597c08ec90 con 0x7f597c13fd70 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): authenticate will time out at 546.676691s 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- start start 2026-02-22T20:52:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: init 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46466/0 (socket says 10.20.193.7:46466) 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 -- 10.20.193.7:0/3278698514 learned_addr learned my addr 10.20.193.7:0/3278698514 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): get_auth_request con 0x7f597c13fd70 auth_method 0 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- 10.20.193.7:0/3278698514 >> v2:10.20.193.61:3300/0 conn(0x7f597c180d00 0x7f597c1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): get_auth_request con 0x7f597c180d00 auth_method 0 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): handle_auth_done global_id 4259 payload 274 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 -- 10.20.193.7:0/3278698514 >> v2:10.20.193.61:3300/0 conn(0x7f597c180d00 msgr2=0x7f597c1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- 10.20.193.7:0/3278698514 >> v2:10.20.193.61:3300/0 conn(0x7f597c180d00 0x7f597c1a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 -- 10.20.193.7:0/3278698514 >> v1:10.20.193.61:6789/0 conn(0x7f597c13f290 legacy=0x7f597c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 -- 10.20.193.7:0/3278698514 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c092bc0 con 0x7f597c13fd70 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fab6413f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-c con 0x7fab6413fd70 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fab64180d00 0x7fab641a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-a con 0x7fab64180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6408fd70 con 0x7fab6413f290 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: monmap: 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.205014+0000 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.205014+0000 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.208 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fab6408e1f0 con 0x7fab64180d00 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fab6408ec90 con 0x7fab6413fd70 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient(hunting): authenticate will time out at 546.677228s 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fab64180d00 0x7fab641a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: monmap: 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.205144+0000 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.205144+0000 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.209 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab637fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fab6413f290 0x7fab6413f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39270/0 (socket says 10.20.193.7:39270) 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fab64180d00 0x7fab641a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46152/0 (socket says 10.20.193.7:46152) 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab637fe640 1 -- 10.20.193.7:0/3528446681 learned_addr learned my addr 10.20.193.7:0/3528446681 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): get_auth_request con 0x7fab64180d00 auth_method 0 2026-02-22T20:52:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 1 --2- 10.20.193.7:0/3528446681 >> v2:10.20.193.61:3300/0 conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): get_auth_request con 0x7fab6413fd70 auth_method 0 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient(hunting): handle_auth_done global_id 4299 payload 274 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 -- 10.20.193.7:0/3528446681 >> v2:10.20.193.61:3300/0 conn(0x7fab6413fd70 msgr2=0x7fab641807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 --2- 10.20.193.7:0/3528446681 >> v2:10.20.193.61:3300/0 conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 -- 10.20.193.7:0/3528446681 >> v1:10.20.193.7:6789/0 conn(0x7fab6413f290 legacy=0x7fab6413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 -- 10.20.193.7:0/3528446681 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab64092bc0 con 0x7fab64180d00 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 1 -- 10.20.193.7:0/3528446681 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227221947 0 0) 0x7fab50002920 con 0x7fab6413f290 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 Processor -- start 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 Processor -- start 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 -- start start 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: init 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 -- start start 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: init 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f40e008fa30 0x7f40e0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-a con 0x7f40e008fa30 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f40e0055fb0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f40e00563b0 0x7f40e013a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-c con 0x7f40e00563b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e008e370 con 0x7f40e0055fb0 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f40e0086e60 con 0x7f40e008fa30 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f40e0087060 con 0x7f40e00563b0 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40e55b5640 10 monclient(hunting): authenticate will time out at 546.678146s 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f40e008fa30 0x7f40e0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-b con 0x7f846c08fd90 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f40e008fa30 0x7f40e0055a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46166/0 (socket says 10.20.193.7:46166) 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 -- 10.20.193.7:0/2483893117 learned_addr learned my addr 10.20.193.7:0/2483893117 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): get_auth_request con 0x7f40e008fa30 auth_method 0 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f846c13c480 0x7f846c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-c con 0x7f846c13c480 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 0x7f846c0563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-a con 0x7f846c055fb0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40de7fc640 1 --1- 10.20.193.7:0/2483893117 >> v1:10.20.193.7:6789/0 conn(0x7f40e0055fb0 0x7f40e0139b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39278/0 (socket says 10.20.193.7:39278) 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f846c08e1d0 con 0x7f846c055fb0 2026-02-22T20:52:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f846c08e6d0 con 0x7f846c13c480 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f846c08e9b0 con 0x7f846c08fd90 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient(hunting): authenticate will time out at 546.678282s 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 0x7f846c0563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 0x7f846c0563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46178/0 (socket says 10.20.193.7:46178) 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46468/0 (socket says 10.20.193.7:46468) 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 1 -- 10.20.193.7:0/1136532083 learned_addr learned my addr 10.20.193.7:0/1136532083 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40df7fe640 1 --2- 10.20.193.7:0/2483893117 >> v2:10.20.193.61:3300/0 conn(0x7f40e00563b0 0x7f40e013a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): get_auth_request con 0x7f846c055fb0 auth_method 0 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): get_auth_request con 0x7f846c08fd90 auth_method 0 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40df7fe640 10 monclient(hunting): get_auth_request con 0x7f40e00563b0 auth_method 0 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- 10.20.193.7:0/3278698514 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f597c08e370 tx=0x7f596401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c2052820bd213 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469d74640 1 --2- 10.20.193.7:0/1136532083 >> v2:10.20.193.61:3300/0 conn(0x7f846c13c480 0x7f846c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469d74640 10 monclient(hunting): get_auth_request con 0x7f846c13c480 auth_method 0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient(hunting): handle_auth_done global_id 4305 payload 274 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40ddffb640 1 -- 10.20.193.7:0/2483893117 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008765877 0 0) 0x7f40c8002920 con 0x7f40e0055fb0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 -- 10.20.193.7:0/2483893117 >> v2:10.20.193.61:3300/0 conn(0x7f40e00563b0 msgr2=0x7f40e013a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 --2- 10.20.193.7:0/2483893117 >> v2:10.20.193.61:3300/0 conn(0x7f40e00563b0 0x7f40e013a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 -- 10.20.193.7:0/2483893117 >> v1:10.20.193.7:6789/0 conn(0x7f40e0055fb0 legacy=0x7f40e0139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 -- 10.20.193.7:0/2483893117 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e0089f70 con 0x7f40e008fa30 2026-02-22T20:52:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40ddffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient(hunting): handle_auth_done global_id 4262 payload 274 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 -- 10.20.193.7:0/1136532083 >> v2:10.20.193.61:3300/0 conn(0x7f846c13c480 msgr2=0x7f846c055a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 --2- 10.20.193.7:0/1136532083 >> v2:10.20.193.61:3300/0 conn(0x7f846c13c480 0x7f846c055a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 -- 10.20.193.7:0/1136532083 >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 msgr2=0x7f846c0563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 1 -- 10.20.193.7:0/3278698514 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640aa430 con 0x7f597c13fd70 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 --2- 10.20.193.7:0/1136532083 >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 0x7f846c0563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: dump: 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 -- 10.20.193.7:0/1136532083 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c08ec90 con 0x7f846c08fd90 2026-02-22T20:52:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 1 -- 10.20.193.7:0/3278698514 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640af070 con 0x7f597c13fd70 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 5 monclient: authenticate success, global_id 4259 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 1 -- 10.20.193.7:0/3278698514 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640aa7f0 con 0x7f597c13fd70 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 4 set_mon_vals no callback set 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979573640 10 monclient: dump: 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: shutdown 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- 10.20.193.7:0/3278698514 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 msgr2=0x7f597c1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- 10.20.193.7:0/3278698514 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f597c08e370 tx=0x7f596401c4d0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- 10.20.193.7:0/3278698514 shutdown_connections 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- 10.20.193.7:0/3278698514 >> v2:10.20.193.61:3300/0 conn(0x7f597c180d00 0x7f597c1a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- 10.20.193.7:0/3278698514 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- 10.20.193.7:0/3278698514 >> 10.20.193.7:0/3278698514 conn(0x7f597c093df0 msgr2=0x7f597c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: monmap: 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.206597+0000 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.206597+0000 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- 10.20.193.7:0/3278698514 shutdown_connections 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- 10.20.193.7:0/3278698514 wait complete. 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab63fff640 1 --2- 10.20.193.7:0/3528446681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab64180d00 0x7fab641a10e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fab64092f70 tx=0x7fab5801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d72f028f4201f5d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 1 -- 10.20.193.7:0/3528446681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580b2070 con 0x7fab64180d00 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: dump: 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 1 -- 10.20.193.7:0/3528446681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab580a5910 con 0x7fab64180d00 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 1 -- 10.20.193.7:0/3528446681 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580a5d00 con 0x7fab64180d00 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 5 monclient: authenticate success, global_id 4299 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 4 set_mon_vals no callback set 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab627fc640 10 monclient: dump: 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 Processor -- start 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: monmap: 2026-02-22T20:52:14.223 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: shutdown 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- 10.20.193.7:0/3528446681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab64180d00 msgr2=0x7fab641a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 --2- 10.20.193.7:0/3528446681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab64180d00 0x7fab641a10e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fab64092f70 tx=0x7fab5801c850 comp rx=0 tx=0).stop 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 -- start start 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: init 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- 10.20.193.7:0/3528446681 shutdown_connections 2026-02-22T20:52:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 --2- 10.20.193.7:0/3528446681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab64180d00 0x7fab641a10e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 --2- 10.20.193.7:0/3528446681 >> v2:10.20.193.61:3300/0 conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- 10.20.193.7:0/3528446681 >> 10.20.193.7:0/3528446681 conn(0x7fab64093df0 msgr2=0x7fab640902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- 10.20.193.7:0/3528446681 shutdown_connections 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 Processor -- start 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 1 -- 10.20.193.7:0/3528446681 wait complete. 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- start start 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: init 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-b con 0x7fcadc08b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fcadc13a4d0 0x7fcadc13cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-a con 0x7fcadc13a4d0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 0x7fcadc13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-c con 0x7fcadc13d530 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fcadc08ab40 con 0x7fcadc13a4d0 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fcadc089920 con 0x7fcadc13d530 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcadc08a860 con 0x7fcadc08b590 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcae1d13640 10 monclient(hunting): authenticate will time out at 546.679554s 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f597c13f290 0x7f597c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-a con 0x7f597c13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-b con 0x7f597c13fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): picked mon.noname-c con 0x7f597c180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f597c1a4050 con 0x7f597c13f290 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46476/0 (socket says 10.20.193.7:46476) 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 -- 10.20.193.7:0/1165569910 learned_addr learned my addr 10.20.193.7:0/1165569910 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): get_auth_request con 0x7fcadc08b590 auth_method 0 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f597c090da0 con 0x7f597c13fd70 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f597c1a41d0 con 0x7f597c180d00 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5980d91640 10 monclient(hunting): authenticate will time out at 546.679631s 2026-02-22T20:52:14.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fcadc13a4d0 0x7fcadc13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): get_auth_request con 0x7fcadc13a4d0 auth_method 0 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46480/0 (socket says 10.20.193.7:46480) 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 -- 10.20.193.7:0/1893637706 learned_addr learned my addr 10.20.193.7:0/1893637706 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f597c13f290 0x7f597c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): get_auth_request con 0x7f597c180d00 auth_method 0 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f846a575640 1 --2- 10.20.193.7:0/1136532083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f846c03a370 tx=0x7f846001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa698c034546f33 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): get_auth_request con 0x7f597c13f290 auth_method 0 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadbfff640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 0x7fcadc13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_done global_id 4265 payload 274 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 -- 10.20.193.7:0/1165569910 >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 msgr2=0x7fcadc13d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 0x7fcadc13d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 -- 10.20.193.7:0/1165569910 >> v2:10.20.193.7:3300/0 conn(0x7fcadc13a4d0 msgr2=0x7fcadc13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.7:3300/0 conn(0x7fcadc13a4d0 0x7fcadc13cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 monclient: found mon.noname-b 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): get_auth_request con 0x7f597c13fd70 auth_method 0 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadb7fe640 1 -- 10.20.193.7:0/1165569910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc089170 con 0x7fcadc08b590 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadbfff640 10 monclient: get_auth_request con 0x7fcadc13d530 auth_method 0 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fcadbfff640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 0x7fcadc13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 1 -- 10.20.193.7:0/1136532083 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600b2070 con 0x7f846c08fd90 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: dump: 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.231 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 1 -- 10.20.193.7:0/1136532083 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84600a5810 con 0x7f846c08fd90 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 1 -- 10.20.193.7:0/1136532083 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600a5c00 con 0x7f846c08fd90 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f8469573640 10 monclient: dump: 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 5 monclient: authenticate success, global_id 4262 2026-02-22T20:52:14.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f84709f3640 4 set_mon_vals no callback set 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f40deffd640 1 --2- 10.20.193.7:0/2483893117 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e008fa30 0x7f40e0055a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40e0054f20 tx=0x7f40d401c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f97fc6548183e15 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7fab69e23640 10 monclient: monmap: 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.233 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient(hunting): handle_auth_done global_id 4268 payload 824 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 -- 10.20.193.7:0/1893637706 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 msgr2=0x7f597c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 -- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f597c13f290 msgr2=0x7f597c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f597c13f290 0x7f597c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 -- 10.20.193.7:0/1893637706 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c056de0 con 0x7f597c180d00 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f5979d74640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.202+0000 7f597ad76640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f596c0094c0 tx=0x7f596c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 1 -- 10.20.193.7:0/2483893117 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d40ab680 con 0x7f40e008fa30 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: dump: 2026-02-22T20:52:14.234 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 1 -- 10.20.193.7:0/2483893117 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d40b0070 con 0x7f40e008fa30 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 1 -- 10.20.193.7:0/2483893117 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d40aba40 con 0x7f40e008fa30 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 5 monclient: authenticate success, global_id 4305 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 4 set_mon_vals no callback set 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40ddffb640 10 monclient: dump: 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.235 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 Processor -- start 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c014620 con 0x7f597c180d00 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: dump: 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596c019070 con 0x7f597c180d00 2026-02-22T20:52:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c014a00 con 0x7f597c180d00 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- start start 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: init 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: dump: 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5978d72640 4 set_mon_vals no callback set 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: shutdown 2026-02-22T20:52:14.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/1136532083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 msgr2=0x7f846c13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- 10.20.193.7:0/1136532083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f846c03a370 tx=0x7f846001c880 comp rx=0 tx=0).stop 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: shutdown 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- 10.20.193.7:0/2483893117 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e008fa30 msgr2=0x7f40e0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- 10.20.193.7:0/2483893117 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e008fa30 0x7f40e0055a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40e0054f20 tx=0x7f40d401c570 comp rx=0 tx=0).stop 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 0x7fab641894b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-b con 0x7fab6413f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/1136532083 shutdown_connections 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- 10.20.193.7:0/1136532083 >> v2:10.20.193.7:3300/0 conn(0x7f846c055fb0 0x7f846c0563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- 10.20.193.7:0/1136532083 >> v2:10.20.193.61:3300/0 conn(0x7f846c13c480 0x7f846c055a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- 10.20.193.7:0/1136532083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c08fd90 0x7f846c13bf40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/1136532083 >> 10.20.193.7:0/1136532083 conn(0x7f846c08ced0 msgr2=0x7f846c08d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-a con 0x7fab6413fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 0x7fab641899f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): picked mon.noname-c con 0x7fab64180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab641a3fc0 con 0x7fab6413fd70 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fab641a3e40 con 0x7fab6413f290 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 5 monclient: authenticate success, global_id 4268 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _renew_subs 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fab641a4140 con 0x7fab64180d00 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient(hunting): authenticate will time out at 546.680366s 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c19de20 con 0x7f597c180d00 2026-02-22T20:52:14.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/1136532083 shutdown_connections 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- 10.20.193.7:0/2483893117 shutdown_connections 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- 10.20.193.7:0/2483893117 >> v2:10.20.193.61:3300/0 conn(0x7f40e00563b0 0x7f40e013a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- 10.20.193.7:0/2483893117 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e008fa30 0x7f40e0055a70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- 10.20.193.7:0/2483893117 >> 10.20.193.7:0/2483893117 conn(0x7f40e008ced0 msgr2=0x7f40e008d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _renew_subs 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/1136532083 wait complete. 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c13eed0 con 0x7f597c180d00 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- 10.20.193.7:0/2483893117 shutdown_connections 2026-02-22T20:52:14.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- 10.20.193.7:0/2483893117 wait complete. 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 0x7fab641899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46210/0 (socket says 10.20.193.7:46210) 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 -- 10.20.193.7:0/2716212789 learned_addr learned my addr 10.20.193.7:0/2716212789 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): get_auth_request con 0x7fab6413fd70 auth_method 0 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): get_auth_request con 0x7fab64180d00 auth_method 0 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 0x7fab641894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 -- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 msgr2=0x7fab641899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 0x7fab641899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 -- 10.20.193.7:0/2716212789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 msgr2=0x7fab641894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 0x7fab641894b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 -- 10.20.193.7:0/2716212789 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6408a9e0 con 0x7fab6413fd70 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 10 monclient: get_auth_request con 0x7fab6413f290 auth_method 0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 0x7fab641894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab63fff640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 0x7fab641899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab62ffd640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab54009430 tx=0x7fab5400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: monmap: 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.242 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54017070 con 0x7fab6413fd70 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: dump: 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5400c940 con 0x7fab6413fd70 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5400cd30 con 0x7fab6413fd70 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 10 monclient: dump: 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.243 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab61ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 5 monclient: authenticate success, global_id 4320 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _renew_subs 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6419d700 con 0x7fab6413fd70 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f596c014ba0 con 0x7f597c180d00 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: monmap: 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.244 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _renew_subs 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6419c7a0 con 0x7fab6413fd70 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 Processor -- start 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/1165569910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0573b0 tx=0x7fcac801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5115442c5209d422 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- start start 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: init 2026-02-22T20:52:14.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597c13d2d0 con 0x7f597c180d00 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 Processor -- start 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 --2- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 0x7f594805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- start start 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: init 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f596c04ef40 con 0x7f597c180d00 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 1 -- 10.20.193.7:0/1165569910 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80b1070 con 0x7fcadc08b590 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: dump: 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.246 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 1 -- 10.20.193.7:0/1165569910 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac80ac450 con 0x7fcadc08b590 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 1 -- 10.20.193.7:0/1165569910 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc13aab0 con 0x7fcadc08b590 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 5 monclient: authenticate success, global_id 4265 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 4 set_mon_vals no callback set 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcada7fc640 10 monclient: dump: 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 0x7f846c125ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-a con 0x7f846c055fb0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f846c08fd90 0x7f846c126430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-b con 0x7f846c08fd90 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): picked mon.noname-c con 0x7f846c13c480 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f846c1a2db0 con 0x7f846c055fb0 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f846c13ca60 con 0x7f846c08fd90 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f846c1a2f30 con 0x7f846c13c480 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient(hunting): authenticate will time out at 546.681279s 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-a con 0x7f40e0055fb0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f40e00563b0 0x7f40e0087e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-b con 0x7f40e00563b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f40e0088380 0x7f40e019e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): picked mon.noname-c con 0x7f40e0088380 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01a1b80 con 0x7f40e0055fb0 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f40e013a9c0 con 0x7f40e00563b0 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f40e01a1d00 con 0x7f40e0088380 2026-02-22T20:52:14.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40e55b5640 10 monclient(hunting): authenticate will time out at 546.681345s 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f597a575640 1 --2- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 0x7f594805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 0x7f846c125ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6413f660 con 0x7fab6413fd70 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46500/0 (socket says 10.20.193.7:46500) 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 -- 10.20.193.7:0/2585901090 learned_addr learned my addr 10.20.193.7:0/2585901090 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): get_auth_request con 0x7f846c13c480 auth_method 0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 0x7f846c125ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46218/0 (socket says 10.20.193.7:46218) 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46228/0 (socket says 10.20.193.7:46228) 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 -- 10.20.193.7:0/3655005148 learned_addr learned my addr 10.20.193.7:0/3655005148 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): get_auth_request con 0x7f40e0055fb0 auth_method 0 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): get_auth_request con 0x7f846c055fb0 auth_method 0 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8469d74640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f846c08fd90 0x7f846c126430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: shutdown 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8469d74640 10 monclient(hunting): get_auth_request con 0x7f846c08fd90 auth_method 0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f40e0088380 0x7f40e019e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/1165569910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 msgr2=0x7fcadc139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- 10.20.193.7:0/1165569910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0573b0 tx=0x7fcac801c4e0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f597a575640 10 monclient: get_auth_request con 0x7f594803ab20 auth_method 0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8469d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8469d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8469d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): get_auth_request con 0x7f40e0088380 auth_method 0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40de7fc640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f40e00563b0 0x7f40e0087e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40de7fc640 10 monclient(hunting): get_auth_request con 0x7f40e00563b0 auth_method 0 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/1165569910 shutdown_connections 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.61:3300/0 conn(0x7fcadc13d530 0x7fcadc13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- 10.20.193.7:0/1165569910 >> v2:10.20.193.7:3300/0 conn(0x7fcadc13a4d0 0x7fcadc13cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- 10.20.193.7:0/1165569910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc139f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/1165569910 >> 10.20.193.7:0/1165569910 conn(0x7fcadc08faa0 msgr2=0x7fcadc08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient(hunting): handle_auth_done global_id 4274 payload 824 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/1165569910 shutdown_connections 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 -- 10.20.193.7:0/2585901090 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f846c08fd90 msgr2=0x7f846c126430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f846c08fd90 0x7f846c126430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 -- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 msgr2=0x7f846c125ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 0x7f846c125ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 -- 10.20.193.7:0/2585901090 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c13b1b0 con 0x7f846c13c480 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient(hunting): handle_auth_done global_id 4323 payload 824 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/1165569910 wait complete. 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 -- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f40e0088380 msgr2=0x7f40e019e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f40e0088380 0x7f40e019e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 -- 10.20.193.7:0/3655005148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f40e00563b0 msgr2=0x7f40e0087e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f40e00563b0 0x7f40e0087e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 -- 10.20.193.7:0/3655005148 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e013b600 con 0x7f40e0055fb0 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fab54013470 con 0x7fab6413fd70 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f846ad76640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f845c004780 tx=0x7f845c00ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f40deffd640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40d4004780 tx=0x7f40d401adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 --2- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 0x7fab3405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fab5404ede0 con 0x7fab6413fd70 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: monmap: 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 1 --2- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 0x7fab3405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 10 monclient: get_auth_request con 0x7fab3403ab20 auth_method 0 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 Processor -- start 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- start start 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: init 2026-02-22T20:52:14.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f597a575640 1 --2- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 0x7f594805afd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f597c19d570 tx=0x7f59700026e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-c con 0x7fcadc08b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 0x7fcadc122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-a con 0x7fcadc13a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcadc13d530 0x7fcadc123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): picked mon.noname-b con 0x7fcadc13d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a0f30 con 0x7fcadc13a4d0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a0db0 con 0x7fcadc13d530 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcadc1a10b0 con 0x7fcadc08b590 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient(hunting): authenticate will time out at 546.682369s 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 0x7fcadc122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46516/0 (socket says 10.20.193.7:46516) 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 -- 10.20.193.7:0/3502074593 learned_addr learned my addr 10.20.193.7:0/3502074593 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): get_auth_request con 0x7fcadc13a4d0 auth_method 0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): get_auth_request con 0x7fcadc08b590 auth_method 0 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadbfff640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcadc13d530 0x7fcadc123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadbfff640 10 monclient(hunting): get_auth_request con 0x7fcadc13d530 auth_method 0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient(hunting): handle_auth_done global_id 4280 payload 824 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fab637fe640 1 --2- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 0x7fab3405afd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab50002770 tx=0x7fab50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 -- 10.20.193.7:0/3502074593 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcadc13d530 msgr2=0x7fcadc123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcadc13d530 0x7fcadc123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 -- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 msgr2=0x7fcadc122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 0x7fcadc122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 monclient: found mon.noname-c 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 -- 10.20.193.7:0/3502074593 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc08eee0 con 0x7fcadc08b590 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadaffd640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 0x7fcadc122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcadb7fe640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009070 tx=0x7fcac8019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80b1050 con 0x7fcadc08b590 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: dump: 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c017070 con 0x7f846c13c480 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: dump: 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c004020 con 0x7f846c13c480 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 5 monclient: authenticate success, global_id 4274 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _renew_subs 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac80b2040 con 0x7fcadc08b590 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 5 monclient: authenticate success, global_id 4280 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _renew_subs 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc126280 con 0x7fcadc08b590 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c127870 con 0x7f846c13c480 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c0043d0 con 0x7f846c13c480 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8452ffd640 10 monclient: dump: 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f8468d72640 4 set_mon_vals no callback set 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8004020 con 0x7fcadc08b590 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcad9ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcab7fff640 10 monclient: dump: 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _renew_subs 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c129330 con 0x7f846c13c480 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _renew_subs 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc08eb20 con 0x7fcadc08b590 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f596c04de40 con 0x7f597c180d00 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.206+0000 7f5962ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f84709f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f84709f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f84709f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c13bf40 con 0x7f846c13c480 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fcac80041c0 con 0x7fcadc08b590 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcae1d13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcae1d13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcae1d13640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcadc0382a0 con 0x7fcadc08b590 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f845c023060 con 0x7f846c13c480 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 1 --2- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 0x7fcaac05afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fcac80e8190 con 0x7fcadc08b590 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8452ffd640 1 --2- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 0x7f843805afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcadaffd640 1 --2- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 0x7fcaac05afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcadaffd640 10 monclient: get_auth_request con 0x7fcaac03ab10 auth_method 0 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f845c04e380 con 0x7f846c13c480 2026-02-22T20:52:14.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f846a575640 1 --2- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 0x7f843805afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4004220 con 0x7f40e0055fb0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: dump: 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 5 monclient: authenticate success, global_id 4323 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d40a7070 con 0x7f40e0055fb0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d40045c0 con 0x7f40e0055fb0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _renew_subs 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40dd7fa640 4 set_mon_vals no callback set 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e0126e00 con 0x7f40e0055fb0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 10 monclient: dump: 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _renew_subs 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e00875c0 con 0x7f40e0055fb0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fab5404dd20 con 0x7fab6413fd70 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fab3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fab3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f846a575640 10 monclient: get_auth_request con 0x7f843803ab10 auth_method 0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcadaffd640 1 --2- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 0x7fcaac05afc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcadc089b60 tx=0x7fcacc009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e0055a70 con 0x7f40e0055fb0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f846a575640 1 --2- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 0x7f843805afc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f846001c8c0 tx=0x7f84600a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f40d4003710 con 0x7f40e0055fb0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 --2- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 0x7f40ac05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f40d40e9180 con 0x7f40e0055fb0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40de7fc640 1 --2- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 0x7f40ac05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40de7fc640 10 monclient: get_auth_request con 0x7f40ac03ab20 auth_method 0 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: get_monmap_and_config 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: monmap: 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:14.213701+0000 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:14.213701+0000 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 Processor -- start 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 -- start start 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: init 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f40de7fc640 1 --2- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 0x7f40ac05afd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002770 tx=0x7f40c8007ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-22T20:52:14.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f833008f8f0 0x7f833013c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): picked mon.noname-a con 0x7f833008f8f0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f833008fcc0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 0x7f8330056180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): picked mon.noname-c con 0x7f833013c5f0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833013ca10 con 0x7f833008fcc0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f833005d6b0 con 0x7f833008f8f0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f833008e660 con 0x7f833013c5f0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8336775640 10 monclient(hunting): authenticate will time out at 546.686770s 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f833008f8f0 0x7f833013c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f833008fcc0 0x7f8330055a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39280/0 (socket says 10.20.193.7:39280) 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832f7fe640 1 -- 10.20.193.7:0/751721381 learned_addr learned my addr 10.20.193.7:0/751721381 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f833008f8f0 0x7f833013c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46244/0 (socket says 10.20.193.7:46244) 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): get_auth_request con 0x7f833008f8f0 auth_method 0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fcadc08eee0 con 0x7fcadc08b590 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7fcab7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient(hunting): handle_auth_done global_id 4332 payload 274 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 -- 10.20.193.7:0/751721381 >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 msgr2=0x7f8330056180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:14.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8334ceb640 1 --2- 10.20.193.7:0/751721381 >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 0x7f8330056180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 --2- 10.20.193.7:0/751721381 >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 0x7f8330056180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 -- 10.20.193.7:0/751721381 >> v1:10.20.193.7:6789/0 conn(0x7f833008fcc0 legacy=0x7f8330055a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f832ffff640 1 -- 10.20.193.7:0/751721381 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833008dc10 con 0x7f833008f8f0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8334ceb640 10 monclient: get_auth_request con 0x7f833013c5f0 auth_method 0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.210+0000 7f8334ceb640 1 --2- 10.20.193.7:0/751721381 >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 0x7f8330056180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832ffff640 1 --2- 10.20.193.7:0/751721381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833008f8f0 0x7f833013c0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f833008e350 tx=0x7f831c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd818508ae87313e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f40e013b600 con 0x7f40e0055fb0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f40bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f40bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f845c0167a0 con 0x7f846c13c480 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8452ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8452ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 1 -- 10.20.193.7:0/751721381 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0ab620 con 0x7f833008f8f0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: dump: 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 1 -- 10.20.193.7:0/751721381 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c0b0070 con 0x7f833008f8f0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 1 -- 10.20.193.7:0/751721381 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c0ab9e0 con 0x7f833008f8f0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 5 monclient: authenticate success, global_id 4332 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 4 set_mon_vals no callback set 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832effd640 10 monclient: dump: 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: shutdown 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/751721381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833008f8f0 msgr2=0x7f833013c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- 10.20.193.7:0/751721381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833008f8f0 0x7f833013c0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f833008e350 tx=0x7f831c01c400 comp rx=0 tx=0).stop 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/751721381 shutdown_connections 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- 10.20.193.7:0/751721381 >> v2:10.20.193.61:3300/0 conn(0x7f833013c5f0 0x7f8330056180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- 10.20.193.7:0/751721381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833008f8f0 0x7f833013c0b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/751721381 >> 10.20.193.7:0/751721381 conn(0x7f833008ced0 msgr2=0x7f833008d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/751721381 shutdown_connections 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/751721381 wait complete. 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: build_initial_monmap 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: monmap: 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 Processor -- start 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- start start 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: init 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 0x7f833012e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): picked mon.noname-b con 0x7f833008f8f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 0x7f833012e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): picked mon.noname-c con 0x7f833008fcc0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): picked mon.noname-a con 0x7f833013c5f0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83301a3f00 con 0x7f833013c5f0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f83301a3d80 con 0x7f833008f8f0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f83301a4080 con 0x7f833008fcc0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient(hunting): authenticate will time out at 546.690846s 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 0x7f833012e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 0x7f833012e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46524/0 (socket says 10.20.193.7:46524) 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 1 -- 10.20.193.7:0/3249945318 learned_addr learned my addr 10.20.193.7:0/3249945318 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): get_auth_request con 0x7f833008fcc0 auth_method 0 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46260/0 (socket says 10.20.193.7:46260) 2026-02-22T20:52:14.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): get_auth_request con 0x7f833013c5f0 auth_method 0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient(hunting): handle_auth_done global_id 4335 payload 824 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 -- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 msgr2=0x7f833012e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 0x7f833012e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 -- 10.20.193.7:0/3249945318 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 msgr2=0x7f833012e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832ffff640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 0x7f833012e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 0x7f833012e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient: _finish_hunting 0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 monclient: found mon.noname-a 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 -- 10.20.193.7:0/3249945318 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833010bec0 con 0x7f833013c5f0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832ffff640 10 monclient: get_auth_request con 0x7f833008f8f0 auth_method 0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832ffff640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 0x7f833012e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8334ceb640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f832400cda0 tx=0x7f832400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832400ae20 con 0x7f833013c5f0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: dump: 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:14.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324004030 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240043e0 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832cff9640 10 monclient: dump: 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f832e7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 5 monclient: authenticate success, global_id 4335 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: _renew_subs 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.214+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833010c1a0 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 10 monclient: _renew_subs 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8330109e40 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833013c0b0 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8324004580 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 1 --2- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 0x7f830005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f832404f060 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832ffff640 1 --2- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 0x7f830005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832ffff640 10 monclient: get_auth_request con 0x7f830003ab20 auth_method 0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832ffff640 1 --2- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 0x7f830005afd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f831c019010 tx=0x7f831c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f832401d360 con 0x7f833013c5f0 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:14.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.218+0000 7f832cff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:14.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:14.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:14.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f597c13f660 con 0x7f597c180d00 2026-02-22T20:52:14.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5962ffd640 1 -- 10.20.193.7:0/1893637706 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f596c012d60 con 0x7f597c180d00 2026-02-22T20:52:14.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5962ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:14.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5962ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.296 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 msgr2=0x7f594805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 0x7f594805afd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f597c19d570 tx=0x7f59700026e0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 10 monclient: shutdown 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 msgr2=0x7f597c19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f596c0094c0 tx=0x7f596c00e4b0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 shutdown_connections 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f597c180d00 0x7f597c19a470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> v2:10.20.193.61:6800/2336688312 conn(0x7f594803ab20 0x7f594805afd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f597c13fd70 0x7f597c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 --2- 10.20.193.7:0/1893637706 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f597c13f290 0x7f597c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 >> 10.20.193.7:0/1893637706 conn(0x7f597c093df0 msgr2=0x7f597c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 shutdown_connections 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7f5980d91640 1 -- 10.20.193.7:0/1893637706 wait complete. 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab69e23640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:14.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab69e23640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab69e23640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fab641a1400 con 0x7fab6413fd70 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab3ffff640 1 -- 10.20.193.7:0/2716212789 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab54011c70 con 0x7fab6413fd70 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.294+0000 7fab3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.298 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 msgr2=0x7fab3405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 0x7fab3405afd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab50002770 tx=0x7fab50009040 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 10 monclient: shutdown 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 msgr2=0x7fab641807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fab54009430 tx=0x7fab5400ee10 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 shutdown_connections 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fab64180d00 0x7fab641899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fab6413fd70 0x7fab641807c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> v2:10.20.193.61:6800/2336688312 conn(0x7fab3403ab20 0x7fab3405afd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 --2- 10.20.193.7:0/2716212789 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fab6413f290 0x7fab641894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 >> 10.20.193.7:0/2716212789 conn(0x7fab64093df0 msgr2=0x7fab64055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 shutdown_connections 2026-02-22T20:52:14.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fab69e23640 1 -- 10.20.193.7:0/2716212789 wait complete. 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcadc0008e0 con 0x7fcadc08b590 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcab7fff640 1 -- 10.20.193.7:0/3502074593 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcac80161f0 con 0x7fcadc08b590 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcab7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcab7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f40e00008e0 con 0x7f40e0055fb0 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40bf7fe640 1 -- 10.20.193.7:0/3655005148 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40d40e7070 con 0x7f40e0055fb0 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 msgr2=0x7fcaac05afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 0x7fcaac05afc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcadc089b60 tx=0x7fcacc009290 comp rx=0 tx=0).stop 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 10 monclient: shutdown 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 msgr2=0x7fcadc1226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009070 tx=0x7fcac8019280 comp rx=0 tx=0).stop 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 shutdown_connections 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcaac03ab10 0x7fcaac05afc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcadc13d530 0x7fcadc123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcadc13a4d0 0x7fcadc122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 --2- 10.20.193.7:0/3502074593 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcadc08b590 0x7fcadc1226d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 >> 10.20.193.7:0/3502074593 conn(0x7fcadc08faa0 msgr2=0x7fcadc121120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 shutdown_connections 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7fcae1d13640 1 -- 10.20.193.7:0/3502074593 wait complete. 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 msgr2=0x7f40ac05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 0x7f40ac05afd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002770 tx=0x7f40c8007ad0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 10 monclient: shutdown 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 msgr2=0x7f40e0087900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.298+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40d4004780 tx=0x7f40d401adb0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 shutdown_connections 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f40e0088380 0x7f40e019e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f40ac03ab20 0x7f40ac05afd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f40e00563b0 0x7f40e0087e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 --2- 10.20.193.7:0/3655005148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f40e0055fb0 0x7f40e0087900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 >> 10.20.193.7:0/3655005148 conn(0x7f40e008ced0 msgr2=0x7f40e008bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 shutdown_connections 2026-02-22T20:52:14.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f40e55b5640 1 -- 10.20.193.7:0/3655005148 wait complete. 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f846c054c20 con 0x7f846c13c480 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8452ffd640 1 -- 10.20.193.7:0/2585901090 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f845c004570 con 0x7f846c13c480 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8452ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8452ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.304 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:14.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8336775640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:14.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8336775640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:14.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8336775640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:14.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f833010a9a0 con 0x7f833013c5f0 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 msgr2=0x7f843805afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 0x7f843805afc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f846001c8c0 tx=0x7f84600a7070 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 10 monclient: shutdown 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 msgr2=0x7f846c126970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f845c004780 tx=0x7f845c00ed90 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 shutdown_connections 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f846c13c480 0x7f846c126970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> v2:10.20.193.61:6800/2336688312 conn(0x7f843803ab10 0x7f843805afc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f846c08fd90 0x7f846c126430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 --2- 10.20.193.7:0/2585901090 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f846c055fb0 0x7f846c125ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 >> 10.20.193.7:0/2585901090 conn(0x7f846c08ced0 msgr2=0x7f846c123490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f832cff9640 1 -- 10.20.193.7:0/3249945318 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83240093c0 con 0x7f833013c5f0 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f832cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:14.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 shutdown_connections 2026-02-22T20:52:14.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f832cff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:14.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.302+0000 7f84709f3640 1 -- 10.20.193.7:0/2585901090 wait complete. 2026-02-22T20:52:14.307 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:14.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-22T20:52:14.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 msgr2=0x7f830005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 0x7f830005afd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f831c019010 tx=0x7f831c0a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 10 monclient: shutdown 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 msgr2=0x7f83301084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f832400cda0 tx=0x7f832400a710 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 shutdown_connections 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f833013c5f0 0x7f83301084b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f833008fcc0 0x7f833012e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> v2:10.20.193.61:6800/2336688312 conn(0x7f830003ab20 0x7f830005afd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 --2- 10.20.193.7:0/3249945318 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f833008f8f0 0x7f833012e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 >> 10.20.193.7:0/3249945318 conn(0x7f833008ced0 msgr2=0x7f833011edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 shutdown_connections 2026-02-22T20:52:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:14.306+0000 7f8336775640 1 -- 10.20.193.7:0/3249945318 wait complete. 2026-02-22T20:52:14.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-22T20:52:14.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2026-02-22T20:52:14.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.5 2026-02-22T20:52:14.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-22T20:52:14.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-22T20:52:15.309 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T20:52:15.313 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T20:52:15.313 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T20:52:15.315 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T20:52:15.317 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T20:52:15.319 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T20:52:15.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: monmap: 2026-02-22T20:52:15.371 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.372032+0000 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.372032+0000 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.372 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.373 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 Processor -- start 2026-02-22T20:52:15.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- start start 2026-02-22T20:52:15.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: init 2026-02-22T20:52:15.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0d7813f3d0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78092600 0x7f0d78180230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-b con 0x7f0d78092600 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0d78180770 0x7f0d781a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-a con 0x7f0d78180770 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d78056560 con 0x7f0d7813f3d0 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0d78056840 con 0x7f0d78180770 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d78056b20 con 0x7f0d78092600 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient(hunting): authenticate will time out at 547.845310s 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0d78180770 0x7f0d781a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78092600 0x7f0d78180230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0d78180770 0x7f0d781a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46262/0 (socket says 10.20.193.7:46262) 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 -- 10.20.193.7:0/3901611575 learned_addr learned my addr 10.20.193.7:0/3901611575 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): get_auth_request con 0x7f0d78180770 auth_method 0 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): get_auth_request con 0x7f0d78092600 auth_method 0 2026-02-22T20:52:15.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 -- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78092600 msgr2=0x7f0d78180230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 --2- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78092600 0x7f0d78180230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 -- 10.20.193.7:0/3901611575 >> v1:10.20.193.7:6789/0 conn(0x7f0d7813f3d0 legacy=0x7f0d78058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 -- 10.20.193.7:0/3901611575 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7808a150 con 0x7f0d78180770 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7dc8a640 1 --2- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d78180770 0x7f0d781a0b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d78056fa0 tx=0x7f0d7401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad1185c5feb1ca5 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 1 -- 10.20.193.7:0/3901611575 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740b1070 con 0x7f0d78180770 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: dump: 2026-02-22T20:52:15.385 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 1 -- 10.20.193.7:0/3901611575 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740a4dc0 con 0x7f0d78180770 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 5 monclient: authenticate success, global_id 4338 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 1 -- 10.20.193.7:0/3901611575 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740ac680 con 0x7f0d78180770 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 4 set_mon_vals no callback set 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d67fff640 10 monclient: dump: 2026-02-22T20:52:15.387 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 10 monclient: shutdown 2026-02-22T20:52:15.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d78180770 msgr2=0x7f0d781a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d78180770 0x7f0d781a0b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d78056fa0 tx=0x7f0d7401c530 comp rx=0 tx=0).stop 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- 10.20.193.7:0/3901611575 shutdown_connections 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d78180770 0x7f0d781a0b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/3901611575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78092600 0x7f0d78180230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- 10.20.193.7:0/3901611575 >> 10.20.193.7:0/3901611575 conn(0x7f0d78094110 msgr2=0x7f0d780901f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- 10.20.193.7:0/3901611575 shutdown_connections 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.369+0000 7f0d7e48b640 1 -- 10.20.193.7:0/3901611575 wait complete. 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: monmap: 2026-02-22T20:52:15.389 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 Processor -- start 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- start start 2026-02-22T20:52:15.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: init 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d78092600 0x7f0d7810dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-b con 0x7f0d78092600 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-a con 0x7f0d7813f3d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78180770 0x7f0d78180020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): picked mon.noname-c con 0x7f0d78180770 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781a4540 con 0x7f0d7813f3d0 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781a43c0 con 0x7f0d78092600 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d781a46c0 con 0x7f0d78180770 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient(hunting): authenticate will time out at 547.848595s 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46270/0 (socket says 10.20.193.7:46270) 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 -- 10.20.193.7:0/2020631962 learned_addr learned my addr 10.20.193.7:0/2020631962 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): get_auth_request con 0x7f0d7813f3d0 auth_method 0 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78180770 0x7f0d78180020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): get_auth_request con 0x7f0d78180770 auth_method 0 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7dc8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7d489640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d78092600 0x7f0d7810dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 -- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78180770 msgr2=0x7f0d78180020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78180770 0x7f0d78180020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 -- 10.20.193.7:0/2020631962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d78092600 msgr2=0x7f0d7810dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d78092600 0x7f0d7810dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 -- 10.20.193.7:0/2020631962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7810e5f0 con 0x7f0d7813f3d0 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7cc88640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009430 tx=0x7f0d6c00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c017070 con 0x7f0d7813f3d0 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: dump: 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.395 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00c940 con 0x7f0d7813f3d0 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 5 monclient: authenticate success, global_id 4344 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _renew_subs 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7812b510 con 0x7f0d7813f3d0 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00cd30 con 0x7f0d7813f3d0 2026-02-22T20:52:15.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d677fe640 4 set_mon_vals no callback set 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 10 monclient: dump: 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.397 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _renew_subs 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d78180560 con 0x7f0d7813f3d0 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78058050 con 0x7f0d7813f3d0 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0d6c013470 con 0x7f0d7813f3d0 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 --2- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 0x7f0d4805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f0d6c04ee20 con 0x7f0d7813f3d0 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7d489640 1 --2- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 0x7f0d4805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7d489640 10 monclient: get_auth_request con 0x7f0d4803ab20 auth_method 0 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.373+0000 7f0d7d489640 1 --2- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 0x7f0d4805afd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d68002920 tx=0x7f0d68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.377+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f0d7812b510 con 0x7f0d7813f3d0 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.377+0000 7f0d65ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.377+0000 7f0d65ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: monmap: 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.417419+0000 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.417419+0000 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.417 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.418 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.418 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.418 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.418 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.418 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 Processor -- start 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 -- start start 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: init 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-22T20:52:15.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa86c13f290 0x7fa86c13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-a con 0x7fa86c13f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa86c13fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 0x7fa86c1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-c con 0x7fa86c13c680 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa86c08fd70 con 0x7fa86c13fba0 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa86c08e1f0 con 0x7fa86c13f290 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fa86c08ec90 con 0x7fa86c13c680 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa872a56640 10 monclient(hunting): authenticate will time out at 547.890863s 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa86c13f290 0x7fa86c13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa86c13f290 0x7fa86c13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46274/0 (socket says 10.20.193.7:46274) 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 -- 10.20.193.7:0/4294428963 learned_addr learned my addr 10.20.193.7:0/4294428963 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): get_auth_request con 0x7fa86c13f290 auth_method 0 2026-02-22T20:52:15.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 1 --2- 10.20.193.7:0/4294428963 >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 0x7fa86c1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 10 monclient(hunting): get_auth_request con 0x7fa86c13c680 auth_method 0 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient(hunting): handle_auth_done global_id 4347 payload 274 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 -- 10.20.193.7:0/4294428963 >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 msgr2=0x7fa86c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 --2- 10.20.193.7:0/4294428963 >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 0x7fa86c1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 -- 10.20.193.7:0/4294428963 >> v1:10.20.193.61:6789/0 conn(0x7fa86c13fba0 legacy=0x7fa86c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa86bfff640 1 -- 10.20.193.7:0/4294428963 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c092bc0 con 0x7fa86c13f290 2026-02-22T20:52:15.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7fa870fcc640 1 --2- 10.20.193.7:0/4294428963 >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 0x7fa86c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:15.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7ff512610640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7ff512610640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.413+0000 7ff512610640 10 monclient: monmap: 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.419380+0000 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.419380+0000 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 Processor -- start 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- start start 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: init 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff50c13c350 0x7ff50c13c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): picked mon.noname-a con 0x7ff50c13c350 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff50c13f130 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13fc80 0x7ff50c1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): picked mon.noname-b con 0x7ff50c13fc80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c08ffd0 con 0x7ff50c13f130 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0930f0 con 0x7ff50c13c350 2026-02-22T20:52:15.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c08ec00 con 0x7ff50c13fc80 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient(hunting): authenticate will time out at 547.892441s 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff50c13c350 0x7ff50c13c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50b7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff50c13f130 0x7ff50c13f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39300/0 (socket says 10.20.193.7:39300) 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50b7fe640 1 -- 10.20.193.7:0/1624210872 learned_addr learned my addr 10.20.193.7:0/1624210872 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:15.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): get_auth_request con 0x7ff50c13c350 auth_method 0 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13fc80 0x7ff50c1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): get_auth_request con 0x7ff50c13fc80 auth_method 0 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 1 --2- 10.20.193.7:0/4294428963 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13f290 0x7fa86c13f660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa86c08f390 tx=0x7fa85801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a63f3c7e6a58530 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff510b86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 1 -- 10.20.193.7:0/4294428963 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580b0070 con 0x7fa86c13f290 2026-02-22T20:52:15.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient(hunting): handle_auth_done global_id 4350 payload 274 2026-02-22T20:52:15.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 -- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13fc80 msgr2=0x7ff50c1a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13fc80 0x7ff50c1a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 -- 10.20.193.7:0/1624210872 >> v1:10.20.193.7:6789/0 conn(0x7ff50c13f130 legacy=0x7ff50c13f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: dump: 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.438 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 1 -- 10.20.193.7:0/4294428963 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8580ab600 con 0x7fa86c13f290 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 5 monclient: authenticate success, global_id 4347 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 1 -- 10.20.193.7:0/4294428963 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580ab9d0 con 0x7fa86c13f290 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86affd640 10 monclient: dump: 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.440 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 -- 10.20.193.7:0/1624210872 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c08eee0 con 0x7ff50c13c350 2026-02-22T20:52:15.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 4 set_mon_vals no callback set 2026-02-22T20:52:15.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: shutdown 2026-02-22T20:52:15.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/4294428963 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13f290 msgr2=0x7fa86c13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- 10.20.193.7:0/4294428963 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13f290 0x7fa86c13f660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa86c08f390 tx=0x7fa85801c2d0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/4294428963 shutdown_connections 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- 10.20.193.7:0/4294428963 >> v2:10.20.193.61:3300/0 conn(0x7fa86c13c680 0x7fa86c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- 10.20.193.7:0/4294428963 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13f290 0x7fa86c13f660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/4294428963 >> 10.20.193.7:0/4294428963 conn(0x7fa86c093df0 msgr2=0x7fa86c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/4294428963 shutdown_connections 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/4294428963 wait complete. 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: monmap: 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.444 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 Processor -- start 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- start start 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: init 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa86c13c680 0x7fa86c12a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-b con 0x7fa86c13c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa86c13f290 0x7fa86c12a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-c con 0x7fa86c13f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): picked mon.noname-a con 0x7fa86c13fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c090de0 con 0x7fa86c13fba0 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c090c60 con 0x7fa86c13c680 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa86c1a4540 con 0x7fa86c13f290 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient(hunting): authenticate will time out at 547.894527s 2026-02-22T20:52:15.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50bfff640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c13c720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8004780 tx=0x7ff4f801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee1c67735d348d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46292/0 (socket says 10.20.193.7:46292) 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 -- 10.20.193.7:0/2499743048 learned_addr learned my addr 10.20.193.7:0/2499743048 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): get_auth_request con 0x7fa86c13fba0 auth_method 0 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa86c13f290 0x7fa86c12a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): get_auth_request con 0x7fa86c13f290 auth_method 0 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 1 -- 10.20.193.7:0/1624210872 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80b1070 con 0x7ff50c13c350 2026-02-22T20:52:15.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa86c13c680 0x7fa86c12a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: dump: 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.449 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 10 monclient(hunting): get_auth_request con 0x7fa86c13c680 auth_method 0 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 1 -- 10.20.193.7:0/1624210872 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f80ac600 con 0x7ff50c13c350 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 1 -- 10.20.193.7:0/1624210872 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80ac9d0 con 0x7ff50c13c350 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff50affd640 10 monclient: dump: 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.452 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 5 monclient: authenticate success, global_id 4350 2026-02-22T20:52:15.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 4 set_mon_vals no callback set 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient(hunting): handle_auth_done global_id 4356 payload 824 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 -- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa86c13f290 msgr2=0x7fa86c12a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa86c13f290 0x7fa86c12a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 -- 10.20.193.7:0/2499743048 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa86c13c680 msgr2=0x7fa86c12a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa86c13c680 0x7fa86c12a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 -- 10.20.193.7:0/2499743048 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c12c510 con 0x7fa86c13fba0 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa870fcc640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa860007eb0 tx=0x7fa86000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86001a070 con 0x7fa86c13fba0 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: dump: 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa860003cb0 con 0x7fa86c13fba0 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860003e60 con 0x7fa86c13fba0 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 10 monclient: dump: 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa86a7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 5 monclient: authenticate success, global_id 4356 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _renew_subs 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86c12da40 con 0x7fa86c13fba0 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _renew_subs 2026-02-22T20:52:15.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86c12d760 con 0x7fa86c13fba0 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: shutdown 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 msgr2=0x7ff50c13c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c13c720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8004780 tx=0x7ff4f801c410 comp rx=0 tx=0).stop 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- 10.20.193.7:0/1624210872 shutdown_connections 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13fc80 0x7ff50c1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 --2- 10.20.193.7:0/1624210872 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c13c720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- 10.20.193.7:0/1624210872 >> 10.20.193.7:0/1624210872 conn(0x7ff50c0941c0 msgr2=0x7ff50c090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- 10.20.193.7:0/1624210872 shutdown_connections 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- 10.20.193.7:0/1624210872 wait complete. 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86c13f660 con 0x7fa86c13fba0 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa860004270 con 0x7fa86c13fba0 2026-02-22T20:52:15.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: monmap: 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 --2- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 0x7fa83c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fa86004edd0 con 0x7fa86c13fba0 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 Processor -- start 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 1 -- start start 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.417+0000 7ff512610640 10 monclient: init 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7fa86bfff640 1 --2- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 0x7fa83c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7fa86bfff640 10 monclient: get_auth_request con 0x7fa83c03ab20 auth_method 0 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: monmap: 2026-02-22T20:52:15.460 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.424039+0000 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.424039+0000 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.461 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): picked mon.noname-a con 0x7ff50c13c350 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13f130 0x7ff50c129de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): picked mon.noname-c con 0x7ff50c13f130 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7fa86bfff640 1 --2- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 0x7fa83c05afd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa85801cb70 tx=0x7fa8580a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 0x7ff50c12a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): picked mon.noname-b con 0x7ff50c13fc80 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c090d70 con 0x7ff50c13c350 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c090bf0 con 0x7ff50c13fc80 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c1a4230 con 0x7ff50c13f130 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 10 monclient(hunting): authenticate will time out at 547.896537s 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13f130 0x7ff50c129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 Processor -- start 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46300/0 (socket says 10.20.193.7:46300) 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 -- 10.20.193.7:0/2111878167 learned_addr learned my addr 10.20.193.7:0/2111878167 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): get_auth_request con 0x7ff50c13c350 auth_method 0 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): get_auth_request con 0x7ff50c13f130 auth_method 0 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- start start 2026-02-22T20:52:15.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: init 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff510b86640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 0x7ff50c12a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient(hunting): handle_auth_done global_id 4359 payload 824 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 -- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13f130 msgr2=0x7ff50c129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13f130 0x7ff50c129de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 -- 10.20.193.7:0/2111878167 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 msgr2=0x7ff50c12a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 0x7ff50c12a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 -- 10.20.193.7:0/2111878167 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c057a70 con 0x7ff50c13c350 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff510b86640 10 monclient: get_auth_request con 0x7ff50c13fc80 auth_method 0 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff510b86640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 0x7ff50c12a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:15.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff50bfff640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4f801c980 tx=0x7ff4f80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f59c813f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f59c813fd70 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 0x7f59c81a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-b con 0x7f59c8181ee0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c808fd70 con 0x7f59c813f290 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c8092bc0 con 0x7f59c813fd70 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f59c808e1f0 con 0x7f59c8181ee0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient(hunting): authenticate will time out at 547.896920s 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59cdda2640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f59c813f290 0x7f59c813f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39314/0 (socket says 10.20.193.7:39314) 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59cdda2640 1 -- 10.20.193.7:0/2874053165 learned_addr learned my addr 10.20.193.7:0/2874053165 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 --2- 10.20.193.7:0/2874053165 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 0x7f59c81a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): get_auth_request con 0x7f59c8181ee0 auth_method 0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_done global_id 4301 payload 274 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 -- 10.20.193.7:0/2874053165 >> v1:10.20.193.61:6789/0 conn(0x7f59c813fd70 legacy=0x7f59c81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 -- 10.20.193.7:0/2874053165 >> v1:10.20.193.7:6789/0 conn(0x7f59c813f290 legacy=0x7f59c813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 monclient: found mon.noname-b 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 -- 10.20.193.7:0/2874053165 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c808e6d0 con 0x7f59c8181ee0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ce5a3640 1 --2- 10.20.193.7:0/2874053165 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 0x7f59c81a22c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009d40 tx=0x7f59c401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e24c8383916e08c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 1 -- 10.20.193.7:0/2874053165 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c40b2070 con 0x7f59c8181ee0 2026-02-22T20:52:15.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: dump: 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 5 monclient: authenticate success, global_id 4301 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 1 -- 10.20.193.7:0/2874053165 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c40a5820 con 0x7f59c8181ee0 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 1 -- 10.20.193.7:0/2874053165 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c40a5c10 con 0x7f59c8181ee0 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: monmap: 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.426388+0000 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.426388+0000 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59ccda0640 10 monclient: dump: 2026-02-22T20:52:15.469 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 4 set_mon_vals no callback set 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 Processor -- start 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: shutdown 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- 10.20.193.7:0/2874053165 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 msgr2=0x7f59c81a22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 --2- 10.20.193.7:0/2874053165 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 0x7f59c81a22c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009d40 tx=0x7f59c401c850 comp rx=0 tx=0).stop 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 -- start start 2026-02-22T20:52:15.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: init 2026-02-22T20:52:15.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- 10.20.193.7:0/2874053165 shutdown_connections 2026-02-22T20:52:15.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 --2- 10.20.193.7:0/2874053165 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c8181ee0 0x7f59c81a22c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- 10.20.193.7:0/2874053165 >> 10.20.193.7:0/2874053165 conn(0x7f59c8093df0 msgr2=0x7f59c80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- 10.20.193.7:0/2874053165 shutdown_connections 2026-02-22T20:52:15.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 1 -- 10.20.193.7:0/2874053165 wait complete. 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 0x7f2b54092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-a con 0x7f2b54091c70 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-b con 0x7f2b5413f1b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2b5413fb10 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5408e6a0 con 0x7f2b5413fb10 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5408e910 con 0x7f2b54091c70 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5408ebf0 con 0x7f2b5413f1b0 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5bde7640 10 monclient(hunting): authenticate will time out at 547.899352s 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 0x7f2b54092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46578/0 (socket says 10.20.193.7:46578) 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): get_auth_request con 0x7f2b54091c70 auth_method 0 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 -- 10.20.193.7:0/3849664313 learned_addr learned my addr 10.20.193.7:0/3849664313 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): get_auth_request con 0x7f2b5413f1b0 auth_method 0 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 -- 10.20.193.7:0/3849664313 >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 msgr2=0x7f2b54092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 --2- 10.20.193.7:0/3849664313 >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 0x7f2b54092040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 -- 10.20.193.7:0/3849664313 >> v1:10.20.193.61:6789/0 conn(0x7f2b5413fb10 legacy=0x7f2b541a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 monclient: found mon.noname-b 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b5935b640 1 -- 10.20.193.7:0/3849664313 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5408eed0 con 0x7f2b5413f1b0 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f2b59b5c640 1 --2- 10.20.193.7:0/3849664313 >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 0x7f2b54092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7f59d002d640 10 monclient: monmap: 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80ba070 con 0x7ff50c13c350 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: dump: 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.474 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f80ac9b0 con 0x7ff50c13c350 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80b1040 con 0x7ff50c13c350 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff50a7fc640 4 set_mon_vals no callback set 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.421+0000 7ff512610640 5 monclient: authenticate success, global_id 4359 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _renew_subs 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c08a970 con 0x7ff50c13c350 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 10 monclient: dump: 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.475 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 Processor -- start 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _renew_subs 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c12d5f0 con 0x7ff50c13c350 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- start start 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: init 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: get_monmap_and_config 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: monmap: 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:15.428012+0000 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:15.428012+0000 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.476 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa860052030 con 0x7fa86c13fba0 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7fa868ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7fa868ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c13c720 con 0x7ff50c13c350 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-c con 0x7f59c813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 0x7f59c8199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-a con 0x7f59c813fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f59c8181ee0 0x7f59c819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): picked mon.noname-b con 0x7f59c8181ee0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81a5880 con 0x7f59c813fd70 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81a5700 con 0x7f59c8181ee0 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff4f8003710 con 0x7ff50c13c350 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f59c81a5a00 con 0x7f59c813f290 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient(hunting): authenticate will time out at 547.900574s 2026-02-22T20:52:15.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46586/0 (socket says 10.20.193.7:46586) 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 -- 10.20.193.7:0/883475123 learned_addr learned my addr 10.20.193.7:0/883475123 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): get_auth_request con 0x7f59c813f290 auth_method 0 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 0x7f59c8199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 Processor -- start 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): get_auth_request con 0x7f59c813fd70 auth_method 0 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 1 --2- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 0x7ff4dc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f59c8181ee0 0x7f59c819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): get_auth_request con 0x7f59c8181ee0 auth_method 0 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7ff4f80e7d30 con 0x7ff50c13c350 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- start start 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: init 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59ce5a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient(hunting): handle_auth_done global_id 4307 payload 824 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 -- 10.20.193.7:0/883475123 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f59c8181ee0 msgr2=0x7f59c819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f59c8181ee0 0x7f59c819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 -- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 msgr2=0x7f59c8199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 0x7f59c8199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 monclient: found mon.noname-c 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 -- 10.20.193.7:0/883475123 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c81a2330 con 0x7f59c813f290 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 0x7f59c8199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff50b7fe640 1 --2- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 0x7ff4dc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff50b7fe640 10 monclient: get_auth_request con 0x7ff4dc03ab20 auth_method 0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cdda2640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c4d0 tx=0x7f59b800c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 1 --2- 10.20.193.7:0/3849664313 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b480090a0 tx=0x7f2b4801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5f0e92b5f2e51b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8017070 con 0x7f59c813f290 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: dump: 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1ee013c350 0x7f1ee013c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 5 monclient: authenticate success, global_id 4307 2026-02-22T20:52:15.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b8005de0 con 0x7f59c813f290 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8007270 con 0x7f59c813f290 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-a con 0x7f1ee013c350 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ee013f130 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 10 monclient: dump: 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b7fff640 4 set_mon_vals no callback set 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _renew_subs 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c819e090 con 0x7f59c813f290 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1ee013fc80 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee008ffd0 con 0x7f1ee013f130 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee008ec00 con 0x7f1ee013fc80 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee00930f0 con 0x7f1ee013c350 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): authenticate will time out at 547.901175s 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _renew_subs 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c819cb70 con 0x7f59c813f290 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 1 -- 10.20.193.7:0/3849664313 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b480ab610 con 0x7f2b5413f1b0 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: dump: 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 1 -- 10.20.193.7:0/3849664313 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b480b0070 con 0x7f2b5413f1b0 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 1 -- 10.20.193.7:0/3849664313 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b480ab9d0 con 0x7f2b5413f1b0 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 5 monclient: authenticate success, global_id 4304 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 4 set_mon_vals no callback set 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b58b5a640 10 monclient: dump: 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1ee013c350 0x7f1ee013c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee4b50640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1ee013f130 0x7f1ee013f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39316/0 (socket says 10.20.193.7:39316) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1ee013c350 0x7f1ee013c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46330/0 (socket says 10.20.193.7:46330) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee4b50640 1 -- 10.20.193.7:0/292812278 learned_addr learned my addr 10.20.193.7:0/292812278 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): get_auth_request con 0x7f1ee013c350 auth_method 0 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff50b7fe640 1 --2- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 0x7ff4dc05afd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff50c12c3c0 tx=0x7ff4fc007f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_done global_id 4368 payload 274 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 -- 10.20.193.7:0/292812278 >> v1:10.20.193.61:6789/0 conn(0x7f1ee013fc80 legacy=0x7f1ee01a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 -- 10.20.193.7:0/292812278 >> v1:10.20.193.7:6789/0 conn(0x7f1ee013f130 legacy=0x7f1ee013f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 -- 10.20.193.7:0/292812278 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee008eee0 con 0x7f1ee013c350 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c813f660 con 0x7f59c813f290 2026-02-22T20:52:15.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: shutdown 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/3849664313 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 msgr2=0x7f2b5413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/3849664313 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b480090a0 tx=0x7f2b4801c4c0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/3849664313 shutdown_connections 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/3849664313 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b5413f5d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/3849664313 >> v2:10.20.193.7:3300/0 conn(0x7f2b54091c70 0x7f2b54092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f59b8007410 con 0x7f59c813f290 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/3849664313 >> 10.20.193.7:0/3849664313 conn(0x7f2b54093d80 msgr2=0x7f2b54090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/3849664313 shutdown_connections 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/3849664313 wait complete. 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 --2- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 0x7f599805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f59b804de00 con 0x7f59c813f290 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 1 --2- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 0x7f599805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 10 monclient: get_auth_request con 0x7f599803ab20 auth_method 0 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: monmap: 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 Processor -- start 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- start start 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: init 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 --2- 10.20.193.7:0/292812278 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013c350 0x7f1ee013c720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1edc004b00 tx=0x7f1edc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebffed142e4f87fe server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 0x7f2b541504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 1 -- 10.20.193.7:0/292812278 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0b2070 con 0x7f1ee013c350 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-b con 0x7f2b54091c70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b54150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: dump: 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-c con 0x7f2b5413f1b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): picked mon.noname-a con 0x7f2b5413fb10 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 1 -- 10.20.193.7:0/292812278 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0a5850 con 0x7f1ee013c350 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 1 -- 10.20.193.7:0/292812278 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0a5c40 con 0x7f1ee013c350 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 5 monclient: authenticate success, global_id 4368 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54091700 con 0x7f2b5413fb10 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54091580 con 0x7f2b54091c70 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 4 set_mon_vals no callback set 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ecffff640 10 monclient: dump: 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.490 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2b541a4440 con 0x7f2b5413f1b0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient(hunting): authenticate will time out at 547.902789s 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b54150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46340/0 (socket says 10.20.193.7:46340) 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b54150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46598/0 (socket says 10.20.193.7:46598) 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 -- 10.20.193.7:0/4016132387 learned_addr learned my addr 10.20.193.7:0/4016132387 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): get_auth_request con 0x7f2b5413fb10 auth_method 0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f59cd5a1640 1 --2- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 0x7f599805afd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59c808dc60 tx=0x7f59bc007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): get_auth_request con 0x7f2b5413f1b0 auth_method 0 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7ff4f8016150 con 0x7ff50c13c350 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7ff508ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5935b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: shutdown 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b59b5c640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 0x7f2b541504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- 10.20.193.7:0/292812278 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013c350 msgr2=0x7f1ee013c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/292812278 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013c350 0x7f1ee013c720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1edc004b00 tx=0x7f1edc01c800 comp rx=0 tx=0).stop 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient(hunting): handle_auth_done global_id 4371 payload 824 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 -- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 msgr2=0x7f2b54150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b54150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- 10.20.193.7:0/292812278 shutdown_connections 2026-02-22T20:52:15.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/292812278 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013c350 0x7f1ee013c720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 -- 10.20.193.7:0/4016132387 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 msgr2=0x7f2b541504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 0x7f2b541504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- 10.20.193.7:0/292812278 >> 10.20.193.7:0/292812278 conn(0x7f1ee00941c0 msgr2=0x7f1ee0090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 monclient: found mon.noname-a 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 -- 10.20.193.7:0/4016132387 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5412c770 con 0x7f2b5413fb10 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b59b5c640 10 monclient: get_auth_request con 0x7f2b54091c70 auth_method 0 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- 10.20.193.7:0/292812278 shutdown_connections 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b59b5c640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 0x7f2b541504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:15.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- 10.20.193.7:0/292812278 wait complete. 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5a35d640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000cc30 tx=0x7f2b5000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000ace0 con 0x7f2b5413fb10 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: dump: 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50004a60 con 0x7f2b5413fb10 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50004e50 con 0x7f2b5413fb10 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 10 monclient: dump: 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b43fff640 4 set_mon_vals no callback set 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 5 monclient: authenticate success, global_id 4371 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _renew_subs 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5413db90 con 0x7f2b5413fb10 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _renew_subs 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5412ead0 con 0x7f2b5413fb10 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: build_initial_monmap 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: monmap: 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 Processor -- start 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- start start 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: init 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b54092040 con 0x7f2b5413fb10 2026-02-22T20:52:15.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2b50023060 con 0x7f2b5413fb10 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-c con 0x7f1ee013c350 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 0x7f1ee0129de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-b con 0x7f1ee013f130 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013fc80 0x7f1ee012a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): picked mon.noname-a con 0x7f1ee013fc80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee01a5410 con 0x7f1ee013fc80 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee013cd50 con 0x7f1ee013f130 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee01a5590 con 0x7f1ee013c350 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee75dc640 10 monclient(hunting): authenticate will time out at 547.903824s 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46612/0 (socket says 10.20.193.7:46612) 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 1 -- 10.20.193.7:0/701737126 learned_addr learned my addr 10.20.193.7:0/701737126 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): get_auth_request con 0x7f1ee013c350 auth_method 0 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013fc80 0x7f1ee012a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): get_auth_request con 0x7f1ee013fc80 auth_method 0 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f2b427fc640 1 --2- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 0x7f2b2405b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5351640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee5b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.425+0000 7f1ee4b50640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 0x7f1ee0129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 10 monclient(hunting): handle_auth_done global_id 4313 payload 824 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f2b5004ed80 con 0x7f2b5413fb10 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 -- 10.20.193.7:0/701737126 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 msgr2=0x7f1ee0129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 0x7f1ee0129de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 -- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013fc80 msgr2=0x7f1ee012a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013fc80 0x7f1ee012a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 10 monclient: _finish_hunting 0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 monclient: found mon.noname-c 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 -- 10.20.193.7:0/701737126 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee0057aa0 con 0x7f1ee013c350 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee4b50640 10 monclient: get_auth_request con 0x7f1ee013f130 auth_method 0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee4b50640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 0x7f1ee0129de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b59b5c640 1 --2- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 0x7f2b2405b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b59b5c640 10 monclient: get_auth_request con 0x7f2b2403acc0 auth_method 0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee5351640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1edc01cd70 tx=0x7f1edc0195a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0bb070 con 0x7f1ee013c350 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: dump: 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:15.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0a6c90 con 0x7f1ee013c350 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 5 monclient: authenticate success, global_id 4313 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _renew_subs 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee0057e60 con 0x7f1ee013c350 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0b2040 con 0x7f1ee013c350 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecf7fe640 4 set_mon_vals no callback set 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 10 monclient: dump: 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b59b5c640 1 --2- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 0x7f2b2405b170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b44004780 tx=0x7f2b44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _renew_subs 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee012d850 con 0x7f1ee013c350 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f59c808fd70 con 0x7f59c813f290 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f59b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f59b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1edc004240 con 0x7f1ee013c350 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee013c720 con 0x7f1ee013c350 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 --2- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 0x7f1eb005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f1edc0e9690 con 0x7f1ee013c350 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee4b50640 1 --2- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 0x7f1eb005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee4b50640 10 monclient: get_auth_request con 0x7f1eb003ab20 auth_method 0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f1ee4b50640 1 --2- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 0x7f1eb005afd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ee012cd50 tx=0x7f1ed0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f2b500161c0 con 0x7f2b5413fb10 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.429+0000 7f2b427fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.433+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1edc016540 con 0x7f1ee013c350 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.433+0000 7f1ecdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.433+0000 7f1ecdffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:15.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.457+0000 7f0d7e48b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.457+0000 7f0d7e48b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.457+0000 7f0d7e48b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.457+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0d780551f0 con 0x7f0d7813f3d0 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d65ffb640 1 -- 10.20.193.7:0/2020631962 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d6c04dd20 con 0x7f0d7813f3d0 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d65ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d65ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 msgr2=0x7f0d4805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 0x7f0d4805afd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d68002920 tx=0x7f0d68009040 comp rx=0 tx=0).stop 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 10 monclient: shutdown 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 msgr2=0x7f0d7812aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009430 tx=0x7f0d6c00ee10 comp rx=0 tx=0).stop 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 shutdown_connections 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d78180770 0x7f0d78180020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d7813f3d0 0x7f0d7812aaa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d4803ab20 0x7f0d4805afd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 --2- 10.20.193.7:0/2020631962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d78092600 0x7f0d7810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 >> 10.20.193.7:0/2020631962 conn(0x7f0d78094110 msgr2=0x7f0d7808caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 shutdown_connections 2026-02-22T20:52:15.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.461+0000 7f0d7e48b640 1 -- 10.20.193.7:0/2020631962 wait complete. 2026-02-22T20:52:15.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f59c805fb50 con 0x7f59c813f290 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59b67fc640 1 -- 10.20.193.7:0/883475123 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59b801a360 con 0x7f59c813f290 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59b67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:15.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff50c055280 con 0x7ff50c13c350 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff508ff9640 1 -- 10.20.193.7:0/2111878167 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4f8008db0 con 0x7ff50c13c350 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff508ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff508ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b5bde7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b5bde7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b5bde7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2b5412e610 con 0x7f2b5413fb10 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b427fc640 1 -- 10.20.193.7:0/4016132387 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b50014110 con 0x7f2b5413fb10 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:15.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f2b427fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 msgr2=0x7f599805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 0x7f599805afd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59c808dc60 tx=0x7f59bc007f20 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 10 monclient: shutdown 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 msgr2=0x7f59c81998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c4d0 tx=0x7f59b800c990 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 shutdown_connections 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> v2:10.20.193.61:6800/2336688312 conn(0x7f599803ab20 0x7f599805afd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f59c8181ee0 0x7f59c819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f59c813fd70 0x7f59c8199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 --2- 10.20.193.7:0/883475123 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f59c813f290 0x7f59c81998f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 >> 10.20.193.7:0/883475123 conn(0x7f59c8093df0 msgr2=0x7f59c813d420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 shutdown_connections 2026-02-22T20:52:15.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7f59d002d640 1 -- 10.20.193.7:0/883475123 wait complete. 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 msgr2=0x7ff4dc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 0x7ff4dc05afd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff50c12c3c0 tx=0x7ff4fc007f90 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 10 monclient: shutdown 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 msgr2=0x7ff50c1508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4f801c980 tx=0x7ff4f80191b0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 shutdown_connections 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff4dc03ab20 0x7ff4dc05afd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff50c13fc80 0x7ff50c12a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff50c13f130 0x7ff50c129de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 --2- 10.20.193.7:0/2111878167 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff50c13c350 0x7ff50c1508f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.513+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 >> 10.20.193.7:0/2111878167 conn(0x7ff50c0941c0 msgr2=0x7ff50c0561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 shutdown_connections 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7ff512610640 1 -- 10.20.193.7:0/2111878167 wait complete. 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 msgr2=0x7f2b2405b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 0x7f2b2405b170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b44004780 tx=0x7f2b44008040 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 10 monclient: shutdown 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 msgr2=0x7f2b5412acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000cc30 tx=0x7f2b5000a430 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 shutdown_connections 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2b5413fb10 0x7f2b5412acb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2b5413f1b0 0x7f2b54150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2b2403acc0 0x7f2b2405b170 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 --2- 10.20.193.7:0/4016132387 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2b54091c70 0x7f2b541504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 >> 10.20.193.7:0/4016132387 conn(0x7f2b54093d80 msgr2=0x7f2b5408ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 shutdown_connections 2026-02-22T20:52:15.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.517+0000 7f2b5bde7640 1 -- 10.20.193.7:0/4016132387 wait complete. 2026-02-22T20:52:15.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-22T20:52:15.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa872a56640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa872a56640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa872a56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa86c08a5c0 con 0x7fa86c13fba0 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa868ff9640 1 -- 10.20.193.7:0/2499743048 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa860010070 con 0x7fa86c13fba0 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa868ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:15.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.525+0000 7fa868ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.5 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 msgr2=0x7fa83c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 0x7fa83c05afd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa85801cb70 tx=0x7fa8580a6000 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 10 monclient: shutdown 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 msgr2=0x7fa86c12ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa860007eb0 tx=0x7fa86000d4a0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 shutdown_connections 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa86c13fba0 0x7fa86c12ab30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa86c13f290 0x7fa86c12a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa83c03ab20 0x7fa83c05afd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 --2- 10.20.193.7:0/2499743048 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa86c13c680 0x7fa86c12a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 >> 10.20.193.7:0/2499743048 conn(0x7fa86c093df0 msgr2=0x7fa86c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 shutdown_connections 2026-02-22T20:52:15.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.529+0000 7fa872a56640 1 -- 10.20.193.7:0/2499743048 wait complete. 2026-02-22T20:52:15.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:15.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:15.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:15.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ee012d630 con 0x7f1ee013c350 2026-02-22T20:52:15.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ecdffb640 1 -- 10.20.193.7:0/701737126 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1edc0c5210 con 0x7f1ee013c350 2026-02-22T20:52:15.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ecdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:15.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ecdffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:15.537 INFO:teuthology.orchestra.run.trial007.stdout:47244640258 2026-02-22T20:52:15.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 msgr2=0x7f1eb005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 0x7f1eb005afd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ee012cd50 tx=0x7f1ed0009040 comp rx=0 tx=0).stop 2026-02-22T20:52:15.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 10 monclient: shutdown 2026-02-22T20:52:15.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 msgr2=0x7f1ee01507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1edc01cd70 tx=0x7f1edc0195a0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 shutdown_connections 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ee013fc80 0x7f1ee012a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1eb003ab20 0x7f1eb005afd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ee013f130 0x7f1ee0129de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 --2- 10.20.193.7:0/701737126 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ee013c350 0x7f1ee01507d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.533+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 >> 10.20.193.7:0/701737126 conn(0x7f1ee00941c0 msgr2=0x7f1ee00561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.537+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 shutdown_connections 2026-02-22T20:52:15.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:15.537+0000 7f1ee75dc640 1 -- 10.20.193.7:0/701737126 wait complete. 2026-02-22T20:52:15.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2026-02-22T20:52:15.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-22T20:52:16.502 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T20:52:16.530 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T20:52:16.530 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T20:52:16.532 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T20:52:16.542 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T20:52:16.551 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T20:52:16.572 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: monmap: 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.571893+0000 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.571893+0000 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.573 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 Processor -- start 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- start start 2026-02-22T20:52:16.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: init 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-a con 0x7f811c08b590 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f811c13a4d0 0x7f811c13cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-c con 0x7f811c13a4d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-b con 0x7f811c13d530 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f811c08ab40 con 0x7f811c08b590 2026-02-22T20:52:16.575 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f811c089920 con 0x7f811c13a4d0 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f811c08a860 con 0x7f811c13d530 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): authenticate will time out at 549.044792s 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46364/0 (socket says 10.20.193.7:46364) 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 1 -- 10.20.193.7:0/2281603666 learned_addr learned my addr 10.20.193.7:0/2281603666 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.576 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46624/0 (socket says 10.20.193.7:46624) 2026-02-22T20:52:16.577 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): get_auth_request con 0x7f811c13d530 auth_method 0 2026-02-22T20:52:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): get_auth_request con 0x7f811c08b590 auth_method 0 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.61:3300/0 conn(0x7f811c13a4d0 0x7f811c13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): get_auth_request con 0x7f811c13a4d0 auth_method 0 2026-02-22T20:52:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient(hunting): handle_auth_done global_id 4316 payload 274 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 -- 10.20.193.7:0/2281603666 >> v2:10.20.193.61:3300/0 conn(0x7f811c13a4d0 msgr2=0x7f811c13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.61:3300/0 conn(0x7f811c13a4d0 0x7f811c13cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 -- 10.20.193.7:0/2281603666 >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 msgr2=0x7f811c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 monclient: found mon.noname-b 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 -- 10.20.193.7:0/2281603666 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c089170 con 0x7f811c13d530 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811bfff640 1 --2- 10.20.193.7:0/2281603666 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f811c08a350 tx=0x7f811001c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ac0d03fa668e0d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 1 -- 10.20.193.7:0/2281603666 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100b2070 con 0x7f811c13d530 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: dump: 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.587 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 1 -- 10.20.193.7:0/2281603666 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81100a5780 con 0x7f811c13d530 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 5 monclient: authenticate success, global_id 4316 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 1 -- 10.20.193.7:0/2281603666 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c13aab0 con 0x7f811c13d530 2026-02-22T20:52:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 4 set_mon_vals no callback set 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811a7fc640 10 monclient: dump: 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: shutdown 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- 10.20.193.7:0/2281603666 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 msgr2=0x7f811c13d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- 10.20.193.7:0/2281603666 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f811c08a350 tx=0x7f811001c7f0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- 10.20.193.7:0/2281603666 shutdown_connections 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- 10.20.193.7:0/2281603666 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13d530 0x7f811c13d9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.61:3300/0 conn(0x7f811c13a4d0 0x7f811c13cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- 10.20.193.7:0/2281603666 >> v2:10.20.193.7:3300/0 conn(0x7f811c08b590 0x7f811c139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- 10.20.193.7:0/2281603666 >> 10.20.193.7:0/2281603666 conn(0x7f811c08faa0 msgr2=0x7f811c08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- 10.20.193.7:0/2281603666 shutdown_connections 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- 10.20.193.7:0/2281603666 wait complete. 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: monmap: 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.591 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 Processor -- start 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- start start 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: init 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f811c08b590 0x7f811c1285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-a con 0x7f811c08b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-c con 0x7f811c13a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f811c13d530 0x7f811c12b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): picked mon.noname-b con 0x7f811c13d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f811c1a0f30 con 0x7f811c08b590 2026-02-22T20:52:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f811c1a0db0 con 0x7f811c13d530 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f811c1a10b0 con 0x7f811c13a4d0 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f8121b6e640 10 monclient(hunting): authenticate will time out at 549.047905s 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f811c08b590 0x7f811c1285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46634/0 (socket says 10.20.193.7:46634) 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 1 -- 10.20.193.7:0/3416269531 learned_addr learned my addr 10.20.193.7:0/3416269531 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): get_auth_request con 0x7f811c08b590 auth_method 0 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): get_auth_request con 0x7f811c13a4d0 auth_method 0 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.569+0000 7f811affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811bfff640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f811c13d530 0x7f811c12b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811bfff640 10 monclient(hunting): get_auth_request con 0x7f811c13d530 auth_method 0 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient(hunting): handle_auth_done global_id 4319 payload 824 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 -- 10.20.193.7:0/3416269531 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f811c13d530 msgr2=0x7f811c12b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f811c13d530 0x7f811c12b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 -- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f811c08b590 msgr2=0x7f811c1285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f811c08b590 0x7f811c1285f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 monclient: found mon.noname-c 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 -- 10.20.193.7:0/3416269531 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c10c090 con 0x7f811c13a4d0 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811affd640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f810c009430 tx=0x7f810c00ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c017070 con 0x7f811c13a4d0 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: dump: 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c00c940 con 0x7f811c13a4d0 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c00cd30 con 0x7f811c13a4d0 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: dump: 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.597 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8119ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 5 monclient: authenticate success, global_id 4319 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _renew_subs 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c086690 con 0x7f811c13a4d0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _renew_subs 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c10cf70 con 0x7f811c13a4d0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c139f90 con 0x7f811c13a4d0 2026-02-22T20:52:16.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f810c013470 con 0x7f811c13a4d0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 --2- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 0x7f80ec05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f810c04ece0 con 0x7f811c13a4d0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 1 --2- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 0x7f80ec05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 10 monclient: get_auth_request con 0x7f80ec03ab20 auth_method 0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f811b7fe640 1 --2- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 0x7f80ec05afd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8108006d60 tx=0x7f8108009300 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f810c04dbe0 con 0x7f811c13a4d0 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.573+0000 7f80f7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: monmap: 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.607 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.607990+0000 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.607990+0000 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.608 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: monmap: 2026-02-22T20:52:16.609 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.608211+0000 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.608211+0000 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.610 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.611 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 Processor -- start 2026-02-22T20:52:16.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- start start 2026-02-22T20:52:16.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: init 2026-02-22T20:52:16.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 Processor -- start 2026-02-22T20:52:16.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- start start 2026-02-22T20:52:16.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: init 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc38413f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-b con 0x7fc38413fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc384180d00 0x7fc3841a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-a con 0x7fc384180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38408fd70 con 0x7fc38413f290 2026-02-22T20:52:16.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc38408e1f0 con 0x7fc384180d00 2026-02-22T20:52:16.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc38408ec90 con 0x7fc38413fd70 2026-02-22T20:52:16.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient(hunting): authenticate will time out at 549.081239s 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fe55c05c490 0x7fe55c08ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): picked mon.noname-a con 0x7fe55c05c490 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe55c08f480 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe55c13fbf0 0x7fe55c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): picked mon.noname-c con 0x7fe55c13fbf0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c08abd0 con 0x7fe55c08f480 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c08aeb0 con 0x7fe55c05c490 2026-02-22T20:52:16.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46650/0 (socket says 10.20.193.7:46650) 2026-02-22T20:52:16.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 1 -- 10.20.193.7:0/3151388021 learned_addr learned my addr 10.20.193.7:0/3151388021 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c05c1e0 con 0x7fe55c13fbf0 2026-02-22T20:52:16.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient(hunting): authenticate will time out at 549.081361s 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): get_auth_request con 0x7fc38413fd70 auth_method 0 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 --2- 10.20.193.7:0/3151388021 >> v2:10.20.193.7:3300/0 conn(0x7fc384180d00 0x7fc3841a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): get_auth_request con 0x7fc384180d00 auth_method 0 2026-02-22T20:52:16.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fe55c05c490 0x7fe55c08ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55a7fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fe55c08f480 0x7fe55c13f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39338/0 (socket says 10.20.193.7:39338) 2026-02-22T20:52:16.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55a7fc640 1 -- 10.20.193.7:0/3980411225 learned_addr learned my addr 10.20.193.7:0/3980411225 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): get_auth_request con 0x7fe55c05c490 auth_method 0 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 1 --2- 10.20.193.7:0/3980411225 >> v2:10.20.193.61:3300/0 conn(0x7fe55c13fbf0 0x7fe55c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): get_auth_request con 0x7fe55c13fbf0 auth_method 0 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 -- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 msgr2=0x7fc3841807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 --2- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 -- 10.20.193.7:0/3151388021 >> v1:10.20.193.7:6789/0 conn(0x7fc38413f290 legacy=0x7fc38413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 -- 10.20.193.7:0/3151388021 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384092bc0 con 0x7fc384180d00 2026-02-22T20:52:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: monmap: 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.609463+0000 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.609463+0000 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.625 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient(hunting): handle_auth_done global_id 4386 payload 274 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 -- 10.20.193.7:0/3980411225 >> v2:10.20.193.61:3300/0 conn(0x7fe55c13fbf0 msgr2=0x7fe55c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 --2- 10.20.193.7:0/3980411225 >> v2:10.20.193.61:3300/0 conn(0x7fe55c13fbf0 0x7fe55c1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 -- 10.20.193.7:0/3980411225 >> v1:10.20.193.7:6789/0 conn(0x7fe55c08f480 legacy=0x7fe55c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 -- 10.20.193.7:0/3980411225 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c08f880 con 0x7fe55c05c490 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 Processor -- start 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 -- start start 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: init 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fdaf4091c70 0x7fdaf4092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-c con 0x7fdaf4091c70 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdaf413f1b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-b con 0x7fdaf413fce0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf408e6a0 con 0x7fdaf413f1b0 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf408e910 con 0x7fdaf4091c70 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf408ebf0 con 0x7fdaf413fce0 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient(hunting): authenticate will time out at 549.082409s 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46662/0 (socket says 10.20.193.7:46662) 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 -- 10.20.193.7:0/1997777786 learned_addr learned my addr 10.20.193.7:0/1997777786 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): get_auth_request con 0x7fdaf413fce0 auth_method 0 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf92b7640 1 --2- 10.20.193.7:0/1997777786 >> v2:10.20.193.61:3300/0 conn(0x7fdaf4091c70 0x7fdaf4092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf92b7640 10 monclient(hunting): get_auth_request con 0x7fdaf4091c70 auth_method 0 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf92b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf92b7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf92b7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient(hunting): handle_auth_done global_id 4325 payload 274 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 -- 10.20.193.7:0/1997777786 >> v2:10.20.193.61:3300/0 conn(0x7fdaf4091c70 msgr2=0x7fdaf4092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 --2- 10.20.193.7:0/1997777786 >> v2:10.20.193.61:3300/0 conn(0x7fdaf4091c70 0x7fdaf4092040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 -- 10.20.193.7:0/1997777786 >> v1:10.20.193.61:6789/0 conn(0x7fdaf413f1b0 legacy=0x7fdaf413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 monclient: found mon.noname-b 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 -- 10.20.193.7:0/1997777786 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf408eed0 con 0x7fdaf413fce0 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: monmap: 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.610636+0000 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.610636+0000 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.632 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.633 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe55affd640 1 --2- 10.20.193.7:0/3980411225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c05c490 0x7fe55c08ef40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe55c08aa50 tx=0x7fe55001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec8930ac93cf9a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 1 -- 10.20.193.7:0/3980411225 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500ab620 con 0x7fe55c05c490 2026-02-22T20:52:16.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: dump: 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 1 -- 10.20.193.7:0/3980411225 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5500b0070 con 0x7fe55c05c490 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 1 -- 10.20.193.7:0/3980411225 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500ab9e0 con 0x7fe55c05c490 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 5 monclient: authenticate success, global_id 4386 2026-02-22T20:52:16.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 4 set_mon_vals no callback set 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe559ffb640 10 monclient: dump: 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc383fff640 1 --2- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc384180d00 0x7fc3841a10e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc38408e370 tx=0x7fc37801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b528357470fcd830 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 Processor -- start 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 1 -- 10.20.193.7:0/3151388021 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780b2070 con 0x7fc384180d00 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: dump: 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.636 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 1 -- 10.20.193.7:0/3151388021 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3780a58a0 con 0x7fc384180d00 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 5 monclient: authenticate success, global_id 4383 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 1 -- 10.20.193.7:0/3151388021 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780a5c90 con 0x7fc384180d00 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 -- start start 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: init 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc3827fc640 10 monclient: dump: 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 4 set_mon_vals no callback set 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: shutdown 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- 10.20.193.7:0/3980411225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c05c490 msgr2=0x7fe55c08ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 --2- 10.20.193.7:0/3980411225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c05c490 0x7fe55c08ef40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe55c08aa50 tx=0x7fe55001c400 comp rx=0 tx=0).stop 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- 10.20.193.7:0/3980411225 shutdown_connections 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 --2- 10.20.193.7:0/3980411225 >> v2:10.20.193.61:3300/0 conn(0x7fe55c13fbf0 0x7fe55c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 --2- 10.20.193.7:0/3980411225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c05c490 0x7fe55c08ef40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- 10.20.193.7:0/3980411225 >> 10.20.193.7:0/3980411225 conn(0x7fe55c055a70 msgr2=0x7fe55c055e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- 10.20.193.7:0/3980411225 shutdown_connections 2026-02-22T20:52:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 1 -- 10.20.193.7:0/3980411225 wait complete. 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 10 monclient: shutdown 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc384180d00 msgr2=0x7fc3841a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 --2- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc384180d00 0x7fc3841a10e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc38408e370 tx=0x7fc37801c7e0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2026-02-22T20:52:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff72413c350 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- 10.20.193.7:0/3151388021 shutdown_connections 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 --2- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc384180d00 0x7fc3841a10e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 --2- 10.20.193.7:0/3151388021 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- 10.20.193.7:0/3151388021 >> 10.20.193.7:0/3151388021 conn(0x7fc384093df0 msgr2=0x7fc3840902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff7241604a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 0x7ff7241a2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-b con 0x7ff724181fa0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- 10.20.193.7:0/3151388021 shutdown_connections 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72408ffd0 con 0x7ff72413c350 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fc38a08e640 1 -- 10.20.193.7:0/3151388021 wait complete. 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72408ec00 con 0x7ff7241604a0 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff7240930f0 con 0x7ff724181fa0 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72c663640 10 monclient(hunting): authenticate will time out at 549.083704s 2026-02-22T20:52:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72a3d8640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff72413c350 0x7ff72413c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39344/0 (socket says 10.20.193.7:39344) 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72a3d8640 1 -- 10.20.193.7:0/2938041534 learned_addr learned my addr 10.20.193.7:0/2938041534 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 1 --2- 10.20.193.7:0/2938041534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 0x7ff7241a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): get_auth_request con 0x7ff724181fa0 auth_method 0 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdaf9ab8640 1 --2- 10.20.193.7:0/1997777786 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009580 tx=0x7fdaf001c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7997bd17cba1b5e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 1 -- 10.20.193.7:0/2938041534 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494470072 0 0) 0x7ff72408ffd0 con 0x7ff72413c350 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 10 monclient(hunting): _negotiate 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 10 monclient(hunting): my global_id is 4395 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 1 -- 10.20.193.7:0/1997777786 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00b2070 con 0x7fdaf413fce0 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: dump: 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff7293d6640 1 -- 10.20.193.7:0/2938041534 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff70c003620 con 0x7ff72413c350 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 1 -- 10.20.193.7:0/1997777786 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf00a5950 con 0x7fdaf413fce0 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 1 -- 10.20.193.7:0/1997777786 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00a5d40 con 0x7fdaf413fce0 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 5 monclient: authenticate success, global_id 4325 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdafb542640 4 set_mon_vals no callback set 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fdae3fff640 10 monclient: dump: 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient(hunting): handle_auth_done global_id 4328 payload 274 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 1 -- 10.20.193.7:0/2938041534 >> v1:10.20.193.61:6789/0 conn(0x7ff7241604a0 legacy=0x7ff724180880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 1 -- 10.20.193.7:0/2938041534 >> v1:10.20.193.7:6789/0 conn(0x7ff72413c350 legacy=0x7ff72413c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7fe561589640 10 monclient: monmap: 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 1 monclient: found mon.noname-b 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.605+0000 7ff72abd9640 1 -- 10.20.193.7:0/2938041534 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72408eee0 con 0x7ff724181fa0 2026-02-22T20:52:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 Processor -- start 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: monmap: 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- start start 2026-02-22T20:52:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: init 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: shutdown 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/1997777786 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 msgr2=0x7fdaf41a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- 10.20.193.7:0/1997777786 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009580 tx=0x7fdaf001c8f0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/1997777786 shutdown_connections 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- 10.20.193.7:0/1997777786 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf413fce0 0x7fdaf41a1510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- 10.20.193.7:0/1997777786 >> v2:10.20.193.61:3300/0 conn(0x7fdaf4091c70 0x7fdaf4092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/1997777786 >> 10.20.193.7:0/1997777786 conn(0x7fdaf4093d80 msgr2=0x7fdaf4090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 Processor -- start 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/1997777786 shutdown_connections 2026-02-22T20:52:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/1997777786 wait complete. 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe55c05c490 0x7fe55c1264d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): picked mon.noname-b con 0x7fe55c05c490 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe55c08f480 0x7fe55c126a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): picked mon.noname-c con 0x7fe55c08f480 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): picked mon.noname-a con 0x7fe55c13fbf0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- start start 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c038200 con 0x7fe55c13fbf0 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1a48a0 con 0x7fe55c05c490 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: init 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c1a4720 con 0x7fe55c08f480 2026-02-22T20:52:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient(hunting): authenticate will time out at 549.084462s 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe55c08f480 0x7fe55c126a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46408/0 (socket says 10.20.193.7:46408) 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 -- 10.20.193.7:0/2678338836 learned_addr learned my addr 10.20.193.7:0/2678338836 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): get_auth_request con 0x7fe55c13fbf0 auth_method 0 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): get_auth_request con 0x7fe55c08f480 auth_method 0 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55affd640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe55c05c490 0x7fe55c1264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient(hunting): handle_auth_done global_id 4398 payload 824 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 -- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe55c08f480 msgr2=0x7fe55c126a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe55c08f480 0x7fe55c126a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 -- 10.20.193.7:0/2678338836 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe55c05c490 msgr2=0x7fe55c1264d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe55c05c490 0x7fe55c1264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 -- 10.20.193.7:0/2678338836 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c12a250 con 0x7fe55c13fbf0 2026-02-22T20:52:16.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 0x7fc38410c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-b con 0x7fc38413f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-a con 0x7fc38413fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc384180d00 0x7fc384129060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): picked mon.noname-c con 0x7fc384180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841a4050 con 0x7fc38413fd70 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc384090dd0 con 0x7fc38413f290 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc3841a41d0 con 0x7fc384180d00 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient(hunting): authenticate will time out at 549.084762s 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: monmap: 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.654 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55b7fe640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009cc0 tx=0x7fe54c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46416/0 (socket says 10.20.193.7:46416) 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 -- 10.20.193.7:0/839233675 learned_addr learned my addr 10.20.193.7:0/839233675 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): get_auth_request con 0x7fc38413fd70 auth_method 0 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc384180d00 0x7fc384129060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 0x7fc38410c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): get_auth_request con 0x7fc384180d00 auth_method 0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 10 monclient(hunting): get_auth_request con 0x7fc38413f290 auth_method 0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c018030 con 0x7fe55c13fbf0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: dump: 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c00cd30 con 0x7fe55c13fbf0 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c003c90 con 0x7fe55c13fbf0 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 10 monclient: dump: 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe5597fa640 4 set_mon_vals no callback set 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 Processor -- start 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient(hunting): handle_auth_done global_id 4401 payload 824 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 -- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc384180d00 msgr2=0x7fc384129060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc384180d00 0x7fc384129060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 -- 10.20.193.7:0/839233675 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 msgr2=0x7fc38410c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 0x7fc38410c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 -- 10.20.193.7:0/839233675 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384056d70 con 0x7fc38413fd70 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 0x7fc38410c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- start start 2026-02-22T20:52:16.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: init 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc382ffd640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc374006b50 tx=0x7fc37400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 1 --2- 10.20.193.7:0/2938041534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 0x7ff7241a2380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff720009d40 tx=0x7ff72001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b75bc6bef75821a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374017070 con 0x7fc38413fd70 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: dump: 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37400c970 con 0x7fc38413fd70 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 1 -- 10.20.193.7:0/2938041534 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200b2070 con 0x7ff724181fa0 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cd20 con 0x7fc38413fd70 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: dump: 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 1 -- 10.20.193.7:0/2938041534 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7200a5830 con 0x7ff724181fa0 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 10 monclient: dump: 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc381ffb640 4 set_mon_vals no callback set 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 5 monclient: authenticate success, global_id 4401 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _renew_subs 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc384129ab0 con 0x7fc38413fd70 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 5 monclient: authenticate success, global_id 4328 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 1 -- 10.20.193.7:0/2938041534 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200a5c20 con 0x7ff724181fa0 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 4 set_mon_vals no callback set 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff7293d6640 10 monclient: dump: 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.661 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _renew_subs 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38408a9e0 con 0x7fc38413fd70 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 5 monclient: authenticate success, global_id 4398 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _renew_subs 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c127ef0 con 0x7fe55c13fbf0 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _renew_subs 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c129650 con 0x7fe55c13fbf0 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:16.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-c con 0x7fdaf4091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaf413f1b0 0x7fdaf412af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-a con 0x7fdaf413f1b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 0x7fdaf412b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): picked mon.noname-b con 0x7fdaf413fce0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41a43f0 con 0x7fdaf413f1b0 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41a4270 con 0x7fdaf413fce0 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: shutdown 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- 10.20.193.7:0/2938041534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 msgr2=0x7ff7241a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 --2- 10.20.193.7:0/2938041534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 0x7ff7241a2380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff720009d40 tx=0x7ff72001c820 comp rx=0 tx=0).stop 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf41a4570 con 0x7fdaf4091c70 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient(hunting): authenticate will time out at 549.085347s 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaf413f1b0 0x7fdaf412af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46692/0 (socket says 10.20.193.7:46692) 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 -- 10.20.193.7:0/806107147 learned_addr learned my addr 10.20.193.7:0/806107147 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): get_auth_request con 0x7fdaf4091c70 auth_method 0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): get_auth_request con 0x7fdaf413f1b0 auth_method 0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 0x7fdaf412b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 10 monclient(hunting): get_auth_request con 0x7fdaf413fce0 auth_method 0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient(hunting): handle_auth_done global_id 4337 payload 824 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 -- 10.20.193.7:0/806107147 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 msgr2=0x7fdaf412b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 0x7fdaf412b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 -- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaf413f1b0 msgr2=0x7fdaf412af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaf413f1b0 0x7fdaf412af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 monclient: found mon.noname-c 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 -- 10.20.193.7:0/806107147 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf408a970 con 0x7fdaf4091c70 2026-02-22T20:52:16.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf9ab8640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 0x7fdaf412b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- 10.20.193.7:0/2938041534 shutdown_connections 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 --2- 10.20.193.7:0/2938041534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff724181fa0 0x7ff7241a2380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- 10.20.193.7:0/2938041534 >> 10.20.193.7:0/2938041534 conn(0x7ff7240941c0 msgr2=0x7ff724090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- 10.20.193.7:0/2938041534 shutdown_connections 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- 10.20.193.7:0/2938041534 wait complete. 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf92b7640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdae4006b80 tx=0x7fdae400ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4017070 con 0x7fdaf4091c70 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: dump: 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.665 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae400ee50 con 0x7fdaf4091c70 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae400f040 con 0x7fdaf4091c70 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 10 monclient: dump: 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 5 monclient: authenticate success, global_id 4337 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _renew_subs 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf412e500 con 0x7fdaf4091c70 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae37fe640 4 set_mon_vals no callback set 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _renew_subs 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf412e7e0 con 0x7fdaf4091c70 2026-02-22T20:52:16.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc374013470 con 0x7fc38413fd70 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe524005190 con 0x7fe55c13fbf0 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38413f660 con 0x7fc38413fd70 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 --2- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 0x7fc35405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fc37404edf0 con 0x7fc38413fd70 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe54c025060 con 0x7fe55c13fbf0 2026-02-22T20:52:16.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: monmap: 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 1 --2- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 0x7fc35405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 10 monclient: get_auth_request con 0x7fc35403ab10 auth_method 0 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 --2- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 0x7fe52805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fe54c04f040 con 0x7fe55c13fbf0 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 Processor -- start 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf413d9e0 con 0x7fdaf4091c70 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- start start 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: init 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55affd640 1 --2- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 0x7fe52805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55affd640 10 monclient: get_auth_request con 0x7fe52803ab20 auth_method 0 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fdae4012050 con 0x7fdaf4091c70 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fc3837fe640 1 --2- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 0x7fc35405afc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc370002810 tx=0x7fc370009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:16.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 --2- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 0x7fdac405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-a con 0x7ff72413c350 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 0x7ff724180e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-c con 0x7ff7241604a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff724181fa0 0x7ff724162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): picked mon.noname-b con 0x7ff724181fa0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241a5670 con 0x7ff72413c350 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241a54f0 con 0x7ff724181fa0 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff7241a57f0 con 0x7ff7241604a0 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fdae404e450 con 0x7fdaf4091c70 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72c663640 10 monclient(hunting): authenticate will time out at 549.086742s 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46426/0 (socket says 10.20.193.7:46426) 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 -- 10.20.193.7:0/1832224043 learned_addr learned my addr 10.20.193.7:0/1832224043 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): get_auth_request con 0x7ff72413c350 auth_method 0 2026-02-22T20:52:16.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 0x7ff724180e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): get_auth_request con 0x7ff7241604a0 auth_method 0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fe55affd640 1 --2- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 0x7fe52805afd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5500095c0 tx=0x7fe5500a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff724181fa0 0x7ff724162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 10 monclient(hunting): get_auth_request con 0x7ff724181fa0 auth_method 0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72abd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 1 --2- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 0x7fdac405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient(hunting): handle_auth_done global_id 4407 payload 824 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 -- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 msgr2=0x7ff724180e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 10 monclient: get_auth_request con 0x7fdac403ab20 auth_method 0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 0x7ff724180e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 -- 10.20.193.7:0/1832224043 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff724181fa0 msgr2=0x7ff724162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff724181fa0 0x7ff724162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 -- 10.20.193.7:0/1832224043 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff724181380 con 0x7ff72413c350 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff729bd7640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 0x7ff724180e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7ff72a3d8640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7140036c0 tx=0x7ff71400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.609+0000 7fdaf8ab6640 1 --2- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 0x7fdac405afd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdaf412e710 tx=0x7fdae80037e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fc384129ab0 con 0x7fc38413fd70 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fc35ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fc35ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fdaf408a970 con 0x7fdaf4091c70 2026-02-22T20:52:16.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fdae1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fdae1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714018070 con 0x7ff72413c350 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: dump: 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714004cf0 con 0x7ff72413c350 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140072d0 con 0x7ff72413c350 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 5 monclient: authenticate success, global_id 4407 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _renew_subs 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72408a970 con 0x7ff72413c350 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff728bd5640 4 set_mon_vals no callback set 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 10 monclient: dump: 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _renew_subs 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff724166160 con 0x7ff72413c350 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fe54c010040 con 0x7fe55c13fbf0 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fe53b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7fe53b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72417f4c0 con 0x7ff72413c350 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff714007470 con 0x7ff72413c350 2026-02-22T20:52:16.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 --2- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 0x7ff6f405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7ff71404df80 con 0x7ff72413c350 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff729bd7640 1 --2- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 0x7ff6f405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff729bd7640 10 monclient: get_auth_request con 0x7ff6f403ab10 auth_method 0 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.613+0000 7ff729bd7640 1 --2- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 0x7ff6f405afc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff724166370 tx=0x7ff7180026e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.617+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7ff72408a970 con 0x7ff72413c350 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.617+0000 7ff70affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.617+0000 7ff70affd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: monmap: 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.636462+0000 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.636462+0000 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 Processor -- start 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- start start 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: init 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-b con 0x7f4cf008b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f4cf013a4d0 0x7f4cf013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f4cf013a4d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:16.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4cf013d530 0x7f4cf013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-a con 0x7f4cf013d530 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf008ab40 con 0x7f4cf013d530 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf0089920 con 0x7f4cf013a4d0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf008a860 con 0x7f4cf008b590 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): authenticate will time out at 549.109345s 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4cf013d530 0x7f4cf013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46724/0 (socket says 10.20.193.7:46724) 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4cf013d530 0x7f4cf013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46440/0 (socket says 10.20.193.7:46440) 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 -- 10.20.193.7:0/500010548 learned_addr learned my addr 10.20.193.7:0/500010548 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): get_auth_request con 0x7f4cf013d530 auth_method 0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): get_auth_request con 0x7f4cf008b590 auth_method 0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 1 --2- 10.20.193.7:0/500010548 >> v2:10.20.193.61:3300/0 conn(0x7f4cf013a4d0 0x7f4cf013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): get_auth_request con 0x7f4cf013a4d0 auth_method 0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient(hunting): handle_auth_done global_id 4410 payload 274 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 -- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 msgr2=0x7f4cf0139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 -- 10.20.193.7:0/500010548 >> v2:10.20.193.61:3300/0 conn(0x7f4cf013a4d0 msgr2=0x7f4cf013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 --2- 10.20.193.7:0/500010548 >> v2:10.20.193.61:3300/0 conn(0x7f4cf013a4d0 0x7f4cf013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 -- 10.20.193.7:0/500010548 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0089170 con 0x7f4cf013d530 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceffff640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013d530 0x7f4cf013d9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cf008d040 tx=0x7f4ce401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621ca0510251774c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 1 -- 10.20.193.7:0/500010548 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40b2070 con 0x7f4cf013d530 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: dump: 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 1 -- 10.20.193.7:0/500010548 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce40a5780 con 0x7f4cf013d530 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 1 -- 10.20.193.7:0/500010548 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf013aab0 con 0x7f4cf013d530 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 5 monclient: authenticate success, global_id 4410 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 4 set_mon_vals no callback set 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cee7fc640 10 monclient: dump: 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: shutdown 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013d530 msgr2=0x7f4cf013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013d530 0x7f4cf013d9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cf008d040 tx=0x7f4ce401c7f0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/500010548 shutdown_connections 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013d530 0x7f4cf013d9d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/500010548 >> v2:10.20.193.61:3300/0 conn(0x7f4cf013a4d0 0x7f4cf013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/500010548 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/500010548 >> 10.20.193.7:0/500010548 conn(0x7f4cf008faa0 msgr2=0x7f4cf008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/500010548 shutdown_connections 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/500010548 wait complete. 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: monmap: 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 Processor -- start 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- start start 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: init 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f4cf008b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013a4d0 0x7f4cf0122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-a con 0x7f4cf013a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 0x7f4cf0122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): picked mon.noname-b con 0x7f4cf013d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf01a0f30 con 0x7f4cf013a4d0 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf01a0db0 con 0x7f4cf013d530 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf01a10b0 con 0x7f4cf008b590 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cf5e7d640 10 monclient(hunting): authenticate will time out at 549.111904s 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013a4d0 0x7f4cf0122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46730/0 (socket says 10.20.193.7:46730) 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 1 -- 10.20.193.7:0/1382937845 learned_addr learned my addr 10.20.193.7:0/1382937845 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): get_auth_request con 0x7f4cf008b590 auth_method 0 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4cef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): get_auth_request con 0x7f4cf013a4d0 auth_method 0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.633+0000 7f4ceeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceffff640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 0x7f4cf0122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient(hunting): handle_auth_done global_id 4346 payload 824 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 -- 10.20.193.7:0/1382937845 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 msgr2=0x7f4cf0122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 0x7f4cf0122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 -- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013a4d0 msgr2=0x7f4cf0122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013a4d0 0x7f4cf0122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 monclient: found mon.noname-c 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 -- 10.20.193.7:0/1382937845 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0125bb0 con 0x7f4cf008b590 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceffff640 10 monclient: get_auth_request con 0x7f4cf013d530 auth_method 0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceffff640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 0x7f4cf0122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cef7fe640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004780 tx=0x7f4cdc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00cc30 con 0x7f4cf008b590 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: dump: 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00cdd0 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc004270 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 5 monclient: authenticate success, global_id 4346 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _renew_subs 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cedffb640 4 set_mon_vals no callback set 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf0125e90 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: dump: 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _renew_subs 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf0086690 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf0139f90 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4cdc023060 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 --2- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 0x7f4cc005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f4cdc04e5b0 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 1 --2- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 0x7f4cc005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 10 monclient: get_auth_request con 0x7f4cc003ab20 auth_method 0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ceeffd640 1 --2- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 0x7f4cc005afd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0125800 tx=0x7f4ce0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f4cdc017020 con 0x7f4cf008b590 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.637+0000 7f4ccbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f811c0008e0 con 0x7f811c13a4d0 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f80f7fff640 1 -- 10.20.193.7:0/3416269531 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f811c0008e0 con 0x7f811c13a4d0 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f80f7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f80f7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 msgr2=0x7f80ec05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 0x7f80ec05afd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8108006d60 tx=0x7f8108009300 comp rx=0 tx=0).stop 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 10 monclient: shutdown 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 msgr2=0x7f811c128b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.661+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f810c009430 tx=0x7f810c00ed50 comp rx=0 tx=0).stop 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 shutdown_connections 2026-02-22T20:52:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> v2:10.20.193.61:6800/2336688312 conn(0x7f80ec03ab20 0x7f80ec05afd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f811c13d530 0x7f811c12b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f811c13a4d0 0x7f811c128b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 --2- 10.20.193.7:0/3416269531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f811c08b590 0x7f811c1285f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 >> 10.20.193.7:0/3416269531 conn(0x7f811c08faa0 msgr2=0x7f811c13b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 shutdown_connections 2026-02-22T20:52:16.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.665+0000 7f8121b6e640 1 -- 10.20.193.7:0/3416269531 wait complete. 2026-02-22T20:52:16.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-22T20:52:16.684 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc384086a30 con 0x7fc38413fd70 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc35ffff640 1 -- 10.20.193.7:0/839233675 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc374016be0 con 0x7fc38413fd70 2026-02-22T20:52:16.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc35ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc35ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stdout:47244640260 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe561589640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe561589640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe561589640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe524005480 con 0x7fe55c13fbf0 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe53b7fe640 1 -- 10.20.193.7:0/2678338836 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe54c022200 con 0x7fe55c13fbf0 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe53b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fe53b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 msgr2=0x7fc35405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 0x7fc35405afc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc370002810 tx=0x7fc370009040 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 10 monclient: shutdown 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 msgr2=0x7fc3841807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc374006b50 tx=0x7fc37400ee10 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 shutdown_connections 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc384180d00 0x7fc384129060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc38413fd70 0x7fc3841807c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc35403ab10 0x7fc35405afc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 --2- 10.20.193.7:0/839233675 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc38413f290 0x7fc38410c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 >> 10.20.193.7:0/839233675 conn(0x7fc384093df0 msgr2=0x7fc384055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 shutdown_connections 2026-02-22T20:52:16.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.697+0000 7fc38a08e640 1 -- 10.20.193.7:0/839233675 wait complete. 2026-02-22T20:52:16.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 msgr2=0x7fe52805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 0x7fe52805afd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5500095c0 tx=0x7fe5500a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:16.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 10 monclient: shutdown 2026-02-22T20:52:16.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 msgr2=0x7fe55c126f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009cc0 tx=0x7fe54c00c490 comp rx=0 tx=0).stop 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 shutdown_connections 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe55c13fbf0 0x7fe55c126f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe55c08f480 0x7fe55c126a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe52803ab20 0x7fe52805afd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 --2- 10.20.193.7:0/2678338836 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe55c05c490 0x7fe55c1264d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 >> 10.20.193.7:0/2678338836 conn(0x7fe55c055a70 msgr2=0x7fe55c089aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 shutdown_connections 2026-02-22T20:52:16.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7fe561589640 1 -- 10.20.193.7:0/2678338836 wait complete. 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff72c663640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff72c663640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff72c663640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff72408d720 con 0x7ff72413c350 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff70affd640 1 -- 10.20.193.7:0/1832224043 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff71404ce80 con 0x7ff72413c350 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff70affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.701+0000 7ff70affd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.706 INFO:teuthology.orchestra.run.trial007.stdout:47244640260 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 msgr2=0x7ff6f405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 0x7ff6f405afc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff724166370 tx=0x7ff7180026e0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 10 monclient: shutdown 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 msgr2=0x7ff724180900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7140036c0 tx=0x7ff71400c9e0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 shutdown_connections 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff6f403ab10 0x7ff6f405afc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff724181fa0 0x7ff724162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff7241604a0 0x7ff724180e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 --2- 10.20.193.7:0/1832224043 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff72413c350 0x7ff724180900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 >> 10.20.193.7:0/1832224043 conn(0x7ff7240941c0 msgr2=0x7ff72408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 shutdown_connections 2026-02-22T20:52:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.705+0000 7ff72c663640 1 -- 10.20.193.7:0/1832224043 wait complete. 2026-02-22T20:52:16.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2026-02-22T20:52:16.712 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-22T20:52:16.713 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.5 2026-02-22T20:52:16.719 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdaf4092040 con 0x7fdaf4091c70 2026-02-22T20:52:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdae1ffb640 1 -- 10.20.193.7:0/806107147 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdae400a0d0 con 0x7fdaf4091c70 2026-02-22T20:52:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdae1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-22T20:52:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdae1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.721 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 msgr2=0x7fdac405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 0x7fdac405afd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdaf412e710 tx=0x7fdae80037e0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 10 monclient: shutdown 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 msgr2=0x7fdaf412aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.717+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdae4006b80 tx=0x7fdae400ec00 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 shutdown_connections 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdac403ab20 0x7fdac405afd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdaf413fce0 0x7fdaf412b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdaf413f1b0 0x7fdaf412af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 --2- 10.20.193.7:0/806107147 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdaf4091c70 0x7fdaf412aa00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 >> 10.20.193.7:0/806107147 conn(0x7fdaf4093d80 msgr2=0x7fdaf408ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 shutdown_connections 2026-02-22T20:52:16.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.721+0000 7fdafb542640 1 -- 10.20.193.7:0/806107147 wait complete. 2026-02-22T20:52:16.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2026-02-22T20:52:16.735 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:16.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:16.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:16.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4cf005fc70 con 0x7f4cf008b590 2026-02-22T20:52:16.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4ccbfff640 1 -- 10.20.193.7:0/1382937845 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cdc00ad70 con 0x7f4cf008b590 2026-02-22T20:52:16.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4ccbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-22T20:52:16.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4ccbfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:16.737 INFO:teuthology.orchestra.run.trial007.stdout:47244640259 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 msgr2=0x7f4cc005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 0x7f4cc005afd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0125800 tx=0x7f4ce0008040 comp rx=0 tx=0).stop 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 10 monclient: shutdown 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 msgr2=0x7f4cf0122440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004780 tx=0x7f4cdc00c520 comp rx=0 tx=0).stop 2026-02-22T20:52:16.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 shutdown_connections 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4cc003ab20 0x7f4cc005afd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4cf013d530 0x7f4cf0122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4cf013a4d0 0x7f4cf0122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 --2- 10.20.193.7:0/1382937845 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4cf008b590 0x7f4cf0122440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 >> 10.20.193.7:0/1382937845 conn(0x7f4cf008faa0 msgr2=0x7f4cf0088470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 shutdown_connections 2026-02-22T20:52:16.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.733+0000 7f4cf5e7d640 1 -- 10.20.193.7:0/1382937845 wait complete. 2026-02-22T20:52:16.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2026-02-22T20:52:16.749 DEBUG:teuthology.parallel:result is None 2026-02-22T20:52:16.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T20:52:16.749 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T20:52:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.845+0000 7f217ee69640 10 monclient: get_monmap_and_config 2026-02-22T20:52:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.845+0000 7f217ee69640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.845+0000 7f217ee69640 10 monclient: monmap: 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:16.851704+0000 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:16.851704+0000 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:16.851 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 Processor -- start 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- start start 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: init 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f217813f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-a con 0x7f217813fd70 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f2178180d00 0x7f21781a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-c con 0x7f2178180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217808fd70 con 0x7f217813f290 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f217808e1f0 con 0x7f217813fd70 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f217808ec90 con 0x7f2178180d00 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient(hunting): authenticate will time out at 549.324626s 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46448/0 (socket says 10.20.193.7:46448) 2026-02-22T20:52:16.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 -- 10.20.193.7:0/3644787170 learned_addr learned my addr 10.20.193.7:0/3644787170 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): get_auth_request con 0x7f217813fd70 auth_method 0 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 1 --2- 10.20.193.7:0/3644787170 >> v2:10.20.193.61:3300/0 conn(0x7f2178180d00 0x7f21781a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): get_auth_request con 0x7f2178180d00 auth_method 0 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient(hunting): handle_auth_done global_id 4416 payload 274 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 -- 10.20.193.7:0/3644787170 >> v2:10.20.193.61:3300/0 conn(0x7f2178180d00 msgr2=0x7f21781a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 --2- 10.20.193.7:0/3644787170 >> v2:10.20.193.61:3300/0 conn(0x7f2178180d00 0x7f21781a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 -- 10.20.193.7:0/3644787170 >> v1:10.20.193.61:6789/0 conn(0x7f217813f290 legacy=0x7f217813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 -- 10.20.193.7:0/3644787170 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2178092bc0 con 0x7f217813fd70 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216ffff640 1 --2- 10.20.193.7:0/3644787170 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f217813fd70 0x7f21781807c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21781401b0 tx=0x7f216001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58515c3aa9b83b3f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 1 -- 10.20.193.7:0/3644787170 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600a9400 con 0x7f217813fd70 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: dump: 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.865 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 1 -- 10.20.193.7:0/3644787170 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21600a95a0 con 0x7f217813fd70 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 1 -- 10.20.193.7:0/3644787170 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600a9970 con 0x7f217813fd70 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 5 monclient: authenticate success, global_id 4416 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 4 set_mon_vals no callback set 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f216f7fe640 10 monclient: dump: 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.867 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: shutdown 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- 10.20.193.7:0/3644787170 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f217813fd70 msgr2=0x7f21781807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 --2- 10.20.193.7:0/3644787170 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f217813fd70 0x7f21781807c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21781401b0 tx=0x7f216001c540 comp rx=0 tx=0).stop 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- 10.20.193.7:0/3644787170 shutdown_connections 2026-02-22T20:52:16.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 --2- 10.20.193.7:0/3644787170 >> v2:10.20.193.61:3300/0 conn(0x7f2178180d00 0x7f21781a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 --2- 10.20.193.7:0/3644787170 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- 10.20.193.7:0/3644787170 >> 10.20.193.7:0/3644787170 conn(0x7f2178093df0 msgr2=0x7f21780902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- 10.20.193.7:0/3644787170 shutdown_connections 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 1 -- 10.20.193.7:0/3644787170 wait complete. 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: build_initial_monmap 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.849+0000 7f217ee69640 10 monclient: monmap: 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:16.869 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 Processor -- start 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- start start 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: init 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 0x7f217810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-c con 0x7f217813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-b con 0x7f217813fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): picked mon.noname-a con 0x7f2178180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21781a3fc0 con 0x7f2178180d00 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f21781a3e40 con 0x7f217813fd70 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f21781a4140 con 0x7f217813f290 2026-02-22T20:52:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient(hunting): authenticate will time out at 549.328340s 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 0x7f217810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 0x7f217810bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46734/0 (socket says 10.20.193.7:46734) 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 1 -- 10.20.193.7:0/1783459820 learned_addr learned my addr 10.20.193.7:0/1783459820 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): get_auth_request con 0x7f217813f290 auth_method 0 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46452/0 (socket says 10.20.193.7:46452) 2026-02-22T20:52:16.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): get_auth_request con 0x7f2178180d00 auth_method 0 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:16.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 10 monclient(hunting): get_auth_request con 0x7f217813fd70 auth_method 0 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient(hunting): handle_auth_done global_id 4419 payload 824 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 -- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 msgr2=0x7f217810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 0x7f217810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 -- 10.20.193.7:0/1783459820 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 msgr2=0x7f21781807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient: _finish_hunting 0 2026-02-22T20:52:16.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 monclient: found mon.noname-a 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 -- 10.20.193.7:0/1783459820 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217808a9e0 con 0x7f2178180d00 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216ffff640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217d3df640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f217400ec40 tx=0x7f217400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174018030 con 0x7f2178180d00 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: dump: 2026-02-22T20:52:16.875 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:16.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217400cac0 con 0x7f2178180d00 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2174003a90 con 0x7f2178180d00 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 10 monclient: dump: 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:16.877 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216effd640 4 set_mon_vals no callback set 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 5 monclient: authenticate success, global_id 4419 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _renew_subs 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217810c860 con 0x7f2178180d00 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _renew_subs 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2178129250 con 0x7f2178180d00 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217813f660 con 0x7f2178180d00 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2174025060 con 0x7f2178180d00 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 --2- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 0x7f214805afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f217404ef60 con 0x7f2178180d00 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 1 --2- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 0x7f214805afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:16.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 10 monclient: get_auth_request con 0x7f214803ab10 auth_method 0 2026-02-22T20:52:16.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.853+0000 7f217cbde640 1 --2- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 0x7f214805afc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2168007fd0 tx=0x7f2168002990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:16.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.857+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f2174010040 con 0x7f2178180d00 2026-02-22T20:52:16.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.857+0000 7f216d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:16.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.857+0000 7f216d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f217810ce30 con 0x7f214803ab10 2026-02-22T20:52:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f216d7fa640 1 -- 10.20.193.7:0/1783459820 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34177 (secure 0 0 0) 0x7f217810ce30 con 0x7f214803ab10 2026-02-22T20:52:16.942 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:16.943 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T20:52:16.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 msgr2=0x7f214805afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 0x7f214805afc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2168007fd0 tx=0x7f2168002990 comp rx=0 tx=0).stop 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 10 monclient: shutdown 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 msgr2=0x7f2178128d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f217400ec40 tx=0x7f217400c490 comp rx=0 tx=0).stop 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 shutdown_connections 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2178180d00 0x7f2178128d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> v2:10.20.193.61:6800/2336688312 conn(0x7f214803ab10 0x7f214805afc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f217813fd70 0x7f21781807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 --2- 10.20.193.7:0/1783459820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f217813f290 0x7f217810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:16.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 >> 10.20.193.7:0/1783459820 conn(0x7f2178093df0 msgr2=0x7f2178057390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:16.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 shutdown_connections 2026-02-22T20:52:16.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:16.937+0000 7f217ee69640 1 -- 10.20.193.7:0/1783459820 wait complete. 2026-02-22T20:52:16.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:16.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:16.952 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-22T20:52:15.910747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":47,"kb_used_meta":161616,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1453780,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":48747,"internal_metadata":165495189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.708913"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632251+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T20:52:13.632251+0000","last_peered":"2026-02-22T20:52:13.632251+0000","last_clean":"2026-02-22T20:52:13.632251+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T20:52:13.632251+0000","last_undegraded":"2026-02-22T20:52:13.632251+0000","last_fullsized":"2026-02-22T20:52:13.632251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212768+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T20:52:13.212768+0000","last_peered":"2026-02-22T20:52:13.212768+0000","last_clean":"2026-02-22T20:52:13.212768+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T20:52:13.212768+0000","last_undegraded":"2026-02-22T20:52:13.212768+0000","last_fullsized":"2026-02-22T20:52:13.212768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632188+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T20:52:13.632188+0000","last_peered":"2026-02-22T20:52:13.632188+0000","last_clean":"2026-02-22T20:52:13.632188+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T20:52:13.632188+0000","last_undegraded":"2026-02-22T20:52:13.632188+0000","last_fullsized":"2026-02-22T20:52:13.632188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212815+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T20:52:13.212815+0000","last_peered":"2026-02-22T20:52:13.212815+0000","last_clean":"2026-02-22T20:52:13.212815+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T20:52:13.212815+0000","last_undegraded":"2026-02-22T20:52:13.212815+0000","last_fullsized":"2026-02-22T20:52:13.212815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.204088+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T20:52:13.204088+0000","last_peered":"2026-02-22T20:52:13.204088+0000","last_clean":"2026-02-22T20:52:13.204088+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T20:52:13.204088+0000","last_undegraded":"2026-02-22T20:52:13.204088+0000","last_fullsized":"2026-02-22T20:52:13.204088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212879+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T20:52:13.212879+0000","last_peered":"2026-02-22T20:52:13.212879+0000","last_clean":"2026-02-22T20:52:13.212879+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T20:52:13.212879+0000","last_undegraded":"2026-02-22T20:52:13.212879+0000","last_fullsized":"2026-02-22T20:52:13.212879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632457+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T20:52:13.632457+0000","last_peered":"2026-02-22T20:52:13.632457+0000","last_clean":"2026-02-22T20:52:13.632457+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T20:52:13.632457+0000","last_undegraded":"2026-02-22T20:52:13.632457+0000","last_fullsized":"2026-02-22T20:52:13.632457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.203940+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T20:52:13.203940+0000","last_peered":"2026-02-22T20:52:13.203940+0000","last_clean":"2026-02-22T20:52:13.203940+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T20:52:13.203940+0000","last_undegraded":"2026-02-22T20:52:13.203940+0000","last_fullsized":"2026-02-22T20:52:13.203940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":155,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.631852+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T20:52:13.631852+0000","last_peered":"2026-02-22T20:52:13.631852+0000","last_clean":"2026-02-22T20:52:13.631852+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T20:52:13.631852+0000","last_undegraded":"2026-02-22T20:52:13.631852+0000","last_fullsized":"2026-02-22T20:52:13.631852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T20:52:16.954 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T20:52:17.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.013+0000 7f1b4d69b640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.013+0000 7f1b4d69b640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.013+0000 7f1b4d69b640 10 monclient: monmap: 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.019498+0000 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.019498+0000 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.020 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 Processor -- start 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- start start 2026-02-22T20:52:17.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: init 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1b4813c350 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1b481604a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1b48181fa0 0x7f1b481a2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-a con 0x7f1b48181fa0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4808ffd0 con 0x7f1b481604a0 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4808ec00 con 0x7f1b4813c350 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1b480930f0 con 0x7f1b48181fa0 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): authenticate will time out at 549.492889s 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1b48181fa0 0x7f1b481a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1b48181fa0 0x7f1b481a2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46464/0 (socket says 10.20.193.7:46464) 2026-02-22T20:52:17.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f1b4813c350 0x7f1b4813c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:44446/0 (socket says 10.20.193.7:44446) 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 -- 10.20.193.7:0/1275763199 learned_addr learned my addr 10.20.193.7:0/1275763199 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1b481604a0 0x7f1b48180880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39356/0 (socket says 10.20.193.7:39356) 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): get_auth_request con 0x7f1b48181fa0 auth_method 0 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 1 -- 10.20.193.7:0/1275763199 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220969013 0 0) 0x7f1b4808ffd0 con 0x7f1b481604a0 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient(hunting): my global_id is 4425 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 1 -- 10.20.193.7:0/1275763199 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b34003620 con 0x7f1b481604a0 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): handle_auth_done global_id 4422 payload 274 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 -- 10.20.193.7:0/1275763199 >> v1:10.20.193.61:6789/0 conn(0x7f1b4813c350 legacy=0x7f1b4813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 -- 10.20.193.7:0/1275763199 >> v1:10.20.193.7:6789/0 conn(0x7f1b481604a0 legacy=0x7f1b48180880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 -- 10.20.193.7:0/1275763199 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4808eee0 con 0x7f1b48181fa0 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 --2- 10.20.193.7:0/1275763199 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b48181fa0 0x7f1b481a2380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b4808f550 tx=0x7f1b3801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488f3e29c6388585 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 1 -- 10.20.193.7:0/1275763199 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380b1070 con 0x7f1b48181fa0 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: dump: 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.034 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 1 -- 10.20.193.7:0/1275763199 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b380a4d60 con 0x7f1b48181fa0 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 5 monclient: authenticate success, global_id 4422 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:17.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 1 -- 10.20.193.7:0/1275763199 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380ac680 con 0x7f1b48181fa0 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b45ffb640 10 monclient: dump: 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.036 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 4 set_mon_vals no callback set 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: shutdown 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1275763199 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b48181fa0 msgr2=0x7f1b481a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1275763199 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b48181fa0 0x7f1b481a2380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b4808f550 tx=0x7f1b3801c520 comp rx=0 tx=0).stop 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1275763199 shutdown_connections 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1275763199 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b48181fa0 0x7f1b481a2380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1275763199 >> 10.20.193.7:0/1275763199 conn(0x7f1b480941c0 msgr2=0x7f1b48090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1275763199 shutdown_connections 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1275763199 wait complete. 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: monmap: 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.038 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 Processor -- start 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- start start 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: init 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1b4813c350 0x7f1b481808c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-b con 0x7f1b4813c350 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-a con 0x7f1b481604a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1b48181fa0 0x7f1b48162700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): picked mon.noname-c con 0x7f1b48181fa0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a5d50 con 0x7f1b481604a0 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481a5bd0 con 0x7f1b4813c350 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1b481a5ed0 con 0x7f1b48181fa0 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b4d69b640 10 monclient(hunting): authenticate will time out at 549.495771s 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46470/0 (socket says 10.20.193.7:46470) 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1b48181fa0 0x7f1b48162700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 1 -- 10.20.193.7:0/1579955352 learned_addr learned my addr 10.20.193.7:0/1579955352 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 10 monclient(hunting): get_auth_request con 0x7f1b481604a0 auth_method 0 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): get_auth_request con 0x7f1b48181fa0 auth_method 0 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1b4813c350 0x7f1b481808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 10 monclient(hunting): get_auth_request con 0x7f1b4813c350 auth_method 0 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.017+0000 7f1b46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient(hunting): handle_auth_done global_id 4428 payload 824 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 -- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1b48181fa0 msgr2=0x7f1b48162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1b48181fa0 0x7f1b48162700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 -- 10.20.193.7:0/1579955352 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1b4813c350 msgr2=0x7f1b481808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1b4813c350 0x7f1b481808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.043 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 -- 10.20.193.7:0/1579955352 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b48165620 con 0x7f1b481604a0 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b467fc640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c4f0 tx=0x7f1b3000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30017070 con 0x7f1b481604a0 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: dump: 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.044 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b30005d20 con 0x7f1b481604a0 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30007270 con 0x7f1b481604a0 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 10 monclient: dump: 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.046 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b457fa640 4 set_mon_vals no callback set 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 5 monclient: authenticate success, global_id 4428 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _renew_subs 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b48166490 con 0x7f1b481604a0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _renew_subs 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4808a970 con 0x7f1b481604a0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4813c720 con 0x7f1b481604a0 2026-02-22T20:52:17.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1b30007410 con 0x7f1b481604a0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 --2- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 0x7f1b1405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f1b3004dd80 con 0x7f1b481604a0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 1 --2- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 0x7f1b1405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 10 monclient: get_auth_request con 0x7f1b1403ab20 auth_method 0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.021+0000 7f1b46ffd640 1 --2- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 0x7f1b1405afd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c002770 tx=0x7f1b3c0048e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.025+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1b30051030 con 0x7f1b481604a0 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.025+0000 7f1b277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.048 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.025+0000 7f1b277fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b48057790 con 0x7f1b1403ab20 2026-02-22T20:52:17.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b277fe640 1 -- 10.20.193.7:0/1579955352 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34177 (secure 0 0 0) 0x7f1b48057790 con 0x7f1b1403ab20 2026-02-22T20:52:17.110 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 msgr2=0x7f1b1405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 0x7f1b1405afd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c002770 tx=0x7f1b3c0048e0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 10 monclient: shutdown 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 msgr2=0x7f1b48180e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c4f0 tx=0x7f1b3000c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 shutdown_connections 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1b48181fa0 0x7f1b48162700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1b481604a0 0x7f1b48180e00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1b1403ab20 0x7f1b1405afd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 --2- 10.20.193.7:0/1579955352 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1b4813c350 0x7f1b481808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 >> 10.20.193.7:0/1579955352 conn(0x7f1b480941c0 msgr2=0x7f1b4808cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 shutdown_connections 2026-02-22T20:52:17.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.105+0000 7f1b4d69b640 1 -- 10.20.193.7:0/1579955352 wait complete. 2026-02-22T20:52:17.120 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-22T20:52:15.910747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":47,"kb_used_meta":161616,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1453780,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":48747,"internal_metadata":165495189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.708913"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632251+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T20:52:13.632251+0000","last_peered":"2026-02-22T20:52:13.632251+0000","last_clean":"2026-02-22T20:52:13.632251+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T20:52:13.632251+0000","last_undegraded":"2026-02-22T20:52:13.632251+0000","last_fullsized":"2026-02-22T20:52:13.632251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212768+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T20:52:13.212768+0000","last_peered":"2026-02-22T20:52:13.212768+0000","last_clean":"2026-02-22T20:52:13.212768+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T20:52:13.212768+0000","last_undegraded":"2026-02-22T20:52:13.212768+0000","last_fullsized":"2026-02-22T20:52:13.212768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632188+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T20:52:13.632188+0000","last_peered":"2026-02-22T20:52:13.632188+0000","last_clean":"2026-02-22T20:52:13.632188+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T20:52:13.632188+0000","last_undegraded":"2026-02-22T20:52:13.632188+0000","last_fullsized":"2026-02-22T20:52:13.632188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212815+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T20:52:13.212815+0000","last_peered":"2026-02-22T20:52:13.212815+0000","last_clean":"2026-02-22T20:52:13.212815+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T20:52:13.212815+0000","last_undegraded":"2026-02-22T20:52:13.212815+0000","last_fullsized":"2026-02-22T20:52:13.212815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.204088+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T20:52:13.204088+0000","last_peered":"2026-02-22T20:52:13.204088+0000","last_clean":"2026-02-22T20:52:13.204088+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T20:52:13.204088+0000","last_undegraded":"2026-02-22T20:52:13.204088+0000","last_fullsized":"2026-02-22T20:52:13.204088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212879+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T20:52:13.212879+0000","last_peered":"2026-02-22T20:52:13.212879+0000","last_clean":"2026-02-22T20:52:13.212879+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T20:52:13.212879+0000","last_undegraded":"2026-02-22T20:52:13.212879+0000","last_fullsized":"2026-02-22T20:52:13.212879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632457+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T20:52:13.632457+0000","last_peered":"2026-02-22T20:52:13.632457+0000","last_clean":"2026-02-22T20:52:13.632457+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T20:52:13.632457+0000","last_undegraded":"2026-02-22T20:52:13.632457+0000","last_fullsized":"2026-02-22T20:52:13.632457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.203940+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T20:52:13.203940+0000","last_peered":"2026-02-22T20:52:13.203940+0000","last_clean":"2026-02-22T20:52:13.203940+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T20:52:13.203940+0000","last_undegraded":"2026-02-22T20:52:13.203940+0000","last_fullsized":"2026-02-22T20:52:13.203940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":155,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.631852+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T20:52:13.631852+0000","last_peered":"2026-02-22T20:52:13.631852+0000","last_clean":"2026-02-22T20:52:13.631852+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T20:52:13.631852+0000","last_undegraded":"2026-02-22T20:52:13.631852+0000","last_fullsized":"2026-02-22T20:52:13.631852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T20:52:17.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T20:52:17.123 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T20:52:17.123 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T20:52:17.123 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T20:52:17.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: monmap: 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.185672+0000 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.185672+0000 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.188 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 Processor -- start 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 -- start start 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: init 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 0x7f8a5c090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5c08c7a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8a5c0909a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f8a5c090d70 0x7f8a5c1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-a con 0x7f8a5c090d70 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c08d840 con 0x7f8a5c0909a0 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c08db20 con 0x7f8a5c090d70 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c0851e0 con 0x7f8a5c08c7a0 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a63693640 10 monclient(hunting): authenticate will time out at 549.658595s 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 0x7f8a5c090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f8a5c090d70 0x7f8a5c1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a60c07640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f8a5c0909a0 0x7f8a5c17f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39364/0 (socket says 10.20.193.7:39364) 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a60c07640 1 -- 10.20.193.7:0/1074388654 learned_addr learned my addr 10.20.193.7:0/1074388654 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 0x7f8a5c090460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46754/0 (socket says 10.20.193.7:46754) 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): get_auth_request con 0x7f8a5c08c7a0 auth_method 0 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): get_auth_request con 0x7f8a5c090d70 auth_method 0 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61408640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 1 -- 10.20.193.7:0/1074388654 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671154707 0 0) 0x7f8a5c08d840 con 0x7f8a5c0909a0 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 10 monclient(hunting): _negotiate 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 10 monclient(hunting): my global_id is 4434 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a4bfff640 1 -- 10.20.193.7:0/1074388654 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a44003620 con 0x7f8a5c0909a0 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient(hunting): handle_auth_done global_id 4431 payload 274 2026-02-22T20:52:17.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 -- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 msgr2=0x7f8a5c090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 --2- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 0x7f8a5c090460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 -- 10.20.193.7:0/1074388654 >> v1:10.20.193.7:6789/0 conn(0x7f8a5c0909a0 legacy=0x7f8a5c17f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.181+0000 7f8a61c09640 1 -- 10.20.193.7:0/1074388654 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0911d0 con 0x7f8a5c090d70 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 --2- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c090d70 0x7f8a5c1a0e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a58004b00 tx=0x7f8a5801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2ceb1ca14f3fb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 1 -- 10.20.193.7:0/1074388654 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580b2070 con 0x7f8a5c090d70 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: dump: 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.199 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 1 -- 10.20.193.7:0/1074388654 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a580a5910 con 0x7f8a5c090d70 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 1 -- 10.20.193.7:0/1074388654 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580a5cc0 con 0x7f8a5c090d70 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4bfff640 10 monclient: dump: 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.201 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 5 monclient: authenticate success, global_id 4431 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 4 set_mon_vals no callback set 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: shutdown 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c090d70 msgr2=0x7f8a5c1a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c090d70 0x7f8a5c1a0e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a58004b00 tx=0x7f8a5801c830 comp rx=0 tx=0).stop 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1074388654 shutdown_connections 2026-02-22T20:52:17.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c090d70 0x7f8a5c1a0e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- 10.20.193.7:0/1074388654 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c08c7a0 0x7f8a5c090460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1074388654 >> 10.20.193.7:0/1074388654 conn(0x7f8a5c08e050 msgr2=0x7f8a5c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1074388654 shutdown_connections 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1074388654 wait complete. 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: monmap: 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.203 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 Processor -- start 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- start start 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: init 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8a5c08c7a0 0x7f8a5c1d9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5c08c7a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-a con 0x7f8a5c0909a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 0x7f8a5c1d9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): picked mon.noname-c con 0x7f8a5c090d70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a3ef0 con 0x7f8a5c0909a0 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a3d70 con 0x7f8a5c08c7a0 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a4070 con 0x7f8a5c090d70 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient(hunting): authenticate will time out at 549.662775s 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 0x7f8a5c1d9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46494/0 (socket says 10.20.193.7:46494) 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 1 -- 10.20.193.7:0/1721298575 learned_addr learned my addr 10.20.193.7:0/1721298575 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): get_auth_request con 0x7f8a5c0909a0 auth_method 0 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): get_auth_request con 0x7f8a5c090d70 auth_method 0 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61408640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8a5c08c7a0 0x7f8a5c1d9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61408640 10 monclient(hunting): get_auth_request con 0x7f8a5c08c7a0 auth_method 0 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61408640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61408640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61408640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient(hunting): handle_auth_done global_id 4358 payload 824 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 -- 10.20.193.7:0/1721298575 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8a5c08c7a0 msgr2=0x7f8a5c1d9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8a5c08c7a0 0x7f8a5c1d9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 -- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 msgr2=0x7f8a5c1d99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 monclient: found mon.noname-c 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 -- 10.20.193.7:0/1721298575 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c05d190 con 0x7f8a5c090d70 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a60c07640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a61c09640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 0x7f8a5c1d9ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a5801a460 tx=0x7f8a580195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580b2040 con 0x7f8a5c090d70 2026-02-22T20:52:17.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: dump: 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.209 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a58004040 con 0x7f8a5c090d70 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58009450 con 0x7f8a5c090d70 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a49ffb640 10 monclient: dump: 2026-02-22T20:52:17.210 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a4b7fe640 4 set_mon_vals no callback set 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 5 monclient: authenticate success, global_id 4358 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _renew_subs 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c05d470 con 0x7f8a5c090d70 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _renew_subs 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c08b9e0 con 0x7f8a5c090d70 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.185+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c08b490 con 0x7f8a5c090d70 2026-02-22T20:52:17.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8a580b5070 con 0x7f8a5c090d70 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 1 --2- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 0x7f8a2c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f8a580e9110 con 0x7f8a5c090d70 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a61408640 1 --2- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 0x7f8a2c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a61408640 10 monclient: get_auth_request con 0x7f8a2c03ab20 auth_method 0 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a61408640 1 --2- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 0x7f8a2c05afd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004780 tx=0x7f8a4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f8a58016540 con 0x7f8a5c090d70 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.189+0000 7f8a49ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-22T20:52:17.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-22T20:52:17.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8a5c05fc70 con 0x7f8a5c090d70 2026-02-22T20:52:17.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a49ffb640 1 -- 10.20.193.7:0/1721298575 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8a580bce20 con 0x7f8a5c090d70 2026-02-22T20:52:17.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a49ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-22T20:52:17.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a49ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:17.297 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:17.297 INFO:teuthology.orchestra.run.trial007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T20:52:17.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 msgr2=0x7f8a2c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 0x7f8a2c05afd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004780 tx=0x7f8a4c008040 comp rx=0 tx=0).stop 2026-02-22T20:52:17.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 10 monclient: shutdown 2026-02-22T20:52:17.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 msgr2=0x7f8a5c1d9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 0x7f8a5c1d9ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a5801a460 tx=0x7f8a580195d0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 shutdown_connections 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8a5c090d70 0x7f8a5c1d9ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8a5c0909a0 0x7f8a5c1d99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8a2c03ab20 0x7f8a2c05afd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 --2- 10.20.193.7:0/1721298575 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8a5c08c7a0 0x7f8a5c1d9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 >> 10.20.193.7:0/1721298575 conn(0x7f8a5c08e050 msgr2=0x7f8a5c089730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 shutdown_connections 2026-02-22T20:52:17.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.293+0000 7f8a63693640 1 -- 10.20.193.7:0/1721298575 wait complete. 2026-02-22T20:52:17.308 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T20:52:17.308 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-22T20:52:17.332 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-22T20:52:17.333 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T20:52:17.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: monmap: 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.405615+0000 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.405615+0000 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.405 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.406 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 Processor -- start 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 -- start start 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: init 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdbb813f780 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 0x7fdbb8056180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-b con 0x7fdbb813fb50 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdbb8181440 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb8091820 con 0x7fdbb813f780 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb8091b00 con 0x7fdbb8181440 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb813f110 con 0x7fdbb813fb50 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb7577640 10 monclient(hunting): authenticate will time out at 549.878939s 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb6575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fdbb813f780 0x7fdbb8055a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39378/0 (socket says 10.20.193.7:39378) 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb6575640 1 -- 10.20.193.7:0/3563910336 learned_addr learned my addr 10.20.193.7:0/3563910336 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 1 --2- 10.20.193.7:0/3563910336 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 0x7fdbb8056180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): get_auth_request con 0x7fdbb813fb50 auth_method 0 2026-02-22T20:52:17.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient(hunting): handle_auth_done global_id 4361 payload 274 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5573640 1 -- 10.20.193.7:0/3563910336 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360954259 0 0) 0x7fdbb8091820 con 0x7fdbb813f780 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 1 -- 10.20.193.7:0/3563910336 >> v1:10.20.193.61:6789/0 conn(0x7fdbb8181440 legacy=0x7fdbb81a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 1 -- 10.20.193.7:0/3563910336 >> v1:10.20.193.7:6789/0 conn(0x7fdbb813f780 legacy=0x7fdbb8055a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 1 monclient: found mon.noname-b 2026-02-22T20:52:17.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5d74640 1 -- 10.20.193.7:0/3563910336 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb813ff80 con 0x7fdbb813fb50 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.401+0000 7fdbb5573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 1 --2- 10.20.193.7:0/3563910336 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 0x7fdbb8056180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c5852c2c40c53b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 1 -- 10.20.193.7:0/3563910336 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba00ab680 con 0x7fdbb813fb50 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: dump: 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.417 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 1 -- 10.20.193.7:0/3563910336 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba00b0070 con 0x7fdbb813fb50 2026-02-22T20:52:17.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 1 -- 10.20.193.7:0/3563910336 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba00aba40 con 0x7fdbb813fb50 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 5 monclient: authenticate success, global_id 4361 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 4 set_mon_vals no callback set 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5573640 10 monclient: dump: 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.419 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: shutdown 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3563910336 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 msgr2=0x7fdbb8056180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3563910336 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 0x7fdbb8056180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba001c460 comp rx=0 tx=0).stop 2026-02-22T20:52:17.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3563910336 shutdown_connections 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3563910336 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813fb50 0x7fdbb8056180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3563910336 >> 10.20.193.7:0/3563910336 conn(0x7fdbb80906f0 msgr2=0x7fdbb8090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3563910336 shutdown_connections 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3563910336 wait complete. 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: monmap: 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.421 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 Processor -- start 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- start start 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: init 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-c con 0x7fdbb813f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdbb813fb50 0x7fdbb812a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-b con 0x7fdbb813fb50 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): picked mon.noname-a con 0x7fdbb8181440 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb8087300 con 0x7fdbb8181440 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb80568d0 con 0x7fdbb813fb50 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb81a5760 con 0x7fdbb813f780 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient(hunting): authenticate will time out at 549.882608s 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46508/0 (socket says 10.20.193.7:46508) 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46780/0 (socket says 10.20.193.7:46780) 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 1 -- 10.20.193.7:0/3570506289 learned_addr learned my addr 10.20.193.7:0/3570506289 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): get_auth_request con 0x7fdbb8181440 auth_method 0 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): get_auth_request con 0x7fdbb813f780 auth_method 0 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdbb813fb50 0x7fdbb812a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 10 monclient(hunting): get_auth_request con 0x7fdbb813fb50 auth_method 0 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient(hunting): handle_auth_done global_id 4364 payload 824 2026-02-22T20:52:17.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 -- 10.20.193.7:0/3570506289 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdbb813fb50 msgr2=0x7fdbb812a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdbb813fb50 0x7fdbb812a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 -- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 msgr2=0x7fdbb812d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 monclient: found mon.noname-c 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 -- 10.20.193.7:0/3570506289 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb808a9e0 con 0x7fdbb813f780 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6d76640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb6575640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0023d0 tx=0x7fdbac00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac004cf0 con 0x7fdbb813f780 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: dump: 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.427 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac0070d0 con 0x7fdbb813f780 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0074a0 con 0x7fdbb813f780 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 10 monclient: dump: 2026-02-22T20:52:17.428 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 5 monclient: authenticate success, global_id 4364 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _renew_subs 2026-02-22T20:52:17.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb4d72640 4 set_mon_vals no callback set 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb810ea90 con 0x7fdbb813f780 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _renew_subs 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb810d850 con 0x7fdbb813f780 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb8087c30 con 0x7fdbb813f780 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fdbac0133c0 con 0x7fdbb813f780 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.405+0000 7fdb9effd640 1 --2- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 0x7fdb8405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fdbac04e5d0 con 0x7fdbb813f780 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdbb5d74640 1 --2- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 0x7fdb8405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdbb5d74640 10 monclient: get_auth_request con 0x7fdb8403ab20 auth_method 0 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdbb5d74640 1 --2- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 0x7fdb8405afd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fdbb808a9e0 con 0x7fdbb813f780 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdb9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.409+0000 7fdb9effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:17.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:17.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbb8055a70 con 0x7fdbb813f780 2026-02-22T20:52:17.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdb9effd640 1 -- 10.20.193.7:0/3570506289 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10807 (secure 0 0 0) 0x7fdbac0054e0 con 0x7fdbb813f780 2026-02-22T20:52:17.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdb9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T20:52:17.498 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdb9effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:17.498 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:17.498 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":17,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T20:52:13.210204+0000","last_up_change":"2026-02-22T20:52:06.185700+0000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T20:52:07.953655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T20:52:10.131782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6800","nonce":2743492886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6801","nonce":2743492886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6805","nonce":2743492886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6803","nonce":2743492886}]},"public_addr":"10.20.193.7:6800/2743492886","cluster_addr":"10.20.193.7:6801/2743492886","heartbeat_back_addr":"10.20.193.7:6805/2743492886","heartbeat_front_addr":"10.20.193.7:6803/2743492886","state":["exists","up"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6802","nonce":2057498835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6804","nonce":2057498835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6807","nonce":2057498835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6806","nonce":2057498835}]},"public_addr":"10.20.193.7:6802/2057498835","cluster_addr":"10.20.193.7:6804/2057498835","heartbeat_back_addr":"10.20.193.7:6807/2057498835","heartbeat_front_addr":"10.20.193.7:6806/2057498835","state":["exists","up"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6808","nonce":1121527665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6809","nonce":1121527665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6811","nonce":1121527665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6810","nonce":1121527665}]},"public_addr":"10.20.193.7:6808/1121527665","cluster_addr":"10.20.193.7:6809/1121527665","heartbeat_back_addr":"10.20.193.7:6811/1121527665","heartbeat_front_addr":"10.20.193.7:6810/1121527665","state":["exists","up"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":3528802164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":3528802164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":3528802164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":3528802164}]},"public_addr":"10.20.193.61:6802/3528802164","cluster_addr":"10.20.193.61:6804/3528802164","heartbeat_back_addr":"10.20.193.61:6808/3528802164","heartbeat_front_addr":"10.20.193.61:6806/3528802164","state":["exists","up"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6801","nonce":461213399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6803","nonce":461213399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6807","nonce":461213399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6805","nonce":461213399}]},"public_addr":"10.20.193.61:6801/461213399","cluster_addr":"10.20.193.61:6803/461213399","heartbeat_back_addr":"10.20.193.61:6807/461213399","heartbeat_front_addr":"10.20.193.61:6805/461213399","state":["exists","up"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6809","nonce":837853154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":837853154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":837853154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6811","nonce":837853154}]},"public_addr":"10.20.193.61:6809/837853154","cluster_addr":"10.20.193.61:6810/837853154","heartbeat_back_addr":"10.20.193.61:6812/837853154","heartbeat_front_addr":"10.20.193.61:6811/837853154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T20:52:17.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 msgr2=0x7fdb8405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 0x7fdb8405afd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 10 monclient: shutdown 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 msgr2=0x7fdbb812a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0023d0 tx=0x7fdbac00c8e0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 shutdown_connections 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdbb8181440 0x7fdbb812d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdb8403ab20 0x7fdb8405afd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdbb813fb50 0x7fdbb812a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 --2- 10.20.193.7:0/3570506289 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdbb813f780 0x7fdbb812a3c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 >> 10.20.193.7:0/3570506289 conn(0x7fdbb80906f0 msgr2=0x7fdbb80882f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 shutdown_connections 2026-02-22T20:52:17.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.493+0000 7fdbb7577640 1 -- 10.20.193.7:0/3570506289 wait complete. 2026-02-22T20:52:17.508 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-22T20:52:07.953655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-22T20:52:10.131782+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 17, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-22T20:52:17.509 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-22T20:52:17.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: monmap: 2026-02-22T20:52:17.581 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.581 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.574272+0000 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.574272+0000 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 Processor -- start 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 -- start start 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: init 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-b con 0x7f16a413c260 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f16a405d520 0x7f16a408e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-a con 0x7f16a405d520 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f16a408e8f0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a408b720 con 0x7f16a408e8f0 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f16a408ba00 con 0x7f16a405d520 2026-02-22T20:52:17.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f16a405bab0 con 0x7f16a413c260 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16ab9c2640 10 monclient(hunting): authenticate will time out at 550.047190s 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f16a405d520 0x7f16a408e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46796/0 (socket says 10.20.193.7:46796) 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 1 -- 10.20.193.7:0/3719952591 learned_addr learned my addr 10.20.193.7:0/3719952591 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): get_auth_request con 0x7f16a413c260 auth_method 0 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): get_auth_request con 0x7f16a405d520 auth_method 0 2026-02-22T20:52:17.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient(hunting): handle_auth_done global_id 4446 payload 274 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 -- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 msgr2=0x7f16a405cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 -- 10.20.193.7:0/3719952591 >> v1:10.20.193.7:6789/0 conn(0x7f16a408e8f0 legacy=0x7f16a41a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a8f36640 1 -- 10.20.193.7:0/3719952591 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a408c970 con 0x7f16a405d520 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.569+0000 7f16a9737640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a405d520 0x7f16a408e3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1698004780 tx=0x7f169801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944675b86a9dd478 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 1 -- 10.20.193.7:0/3719952591 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16980b0070 con 0x7f16a405d520 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: dump: 2026-02-22T20:52:17.586 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 1 -- 10.20.193.7:0/3719952591 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16980ab600 con 0x7f16a405d520 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 1 -- 10.20.193.7:0/3719952591 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16980ab9d0 con 0x7f16a405d520 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 5 monclient: authenticate success, global_id 4446 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 4 set_mon_vals no callback set 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1693fff640 10 monclient: dump: 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.588 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: shutdown 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a405d520 msgr2=0x7f16a408e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a405d520 0x7f16a408e3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1698004780 tx=0x7f169801c440 comp rx=0 tx=0).stop 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3719952591 shutdown_connections 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a405d520 0x7f16a408e3b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3719952591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a413c260 0x7f16a405cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3719952591 >> 10.20.193.7:0/3719952591 conn(0x7f16a408faa0 msgr2=0x7f16a408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3719952591 shutdown_connections 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3719952591 wait complete. 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: monmap: 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.590 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 Processor -- start 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- start start 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: init 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16a405d520 0x7f16a41506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-b con 0x7f16a405d520 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-c con 0x7f16a408e8f0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a413c260 0x7f16a4129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): picked mon.noname-a con 0x7f16a413c260 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16a41a48a0 con 0x7f16a413c260 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f16a41a4720 con 0x7f16a405d520 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f16a41a4a20 con 0x7f16a408e8f0 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient(hunting): authenticate will time out at 550.051241s 2026-02-22T20:52:17.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46800/0 (socket says 10.20.193.7:46800) 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a413c260 0x7f16a4129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 -- 10.20.193.7:0/3878329056 learned_addr learned my addr 10.20.193.7:0/3878329056 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): get_auth_request con 0x7f16a408e8f0 auth_method 0 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): get_auth_request con 0x7f16a413c260 auth_method 0 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9737640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16a405d520 0x7f16a41506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9f38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9737640 10 monclient(hunting): get_auth_request con 0x7f16a405d520 auth_method 0 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9737640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9737640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a9737640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient(hunting): handle_auth_done global_id 4370 payload 824 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 -- 10.20.193.7:0/3878329056 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16a405d520 msgr2=0x7f16a41506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16a405d520 0x7f16a41506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 -- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a413c260 msgr2=0x7f16a4129770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a413c260 0x7f16a4129770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 monclient: found mon.noname-c 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 -- 10.20.193.7:0/3878329056 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a412d4f0 con 0x7f16a408e8f0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16a8f36640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f169801c480 tx=0x7f16980191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16980b9070 con 0x7f16a408e8f0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: dump: 2026-02-22T20:52:17.595 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16980ab9b0 con 0x7f16a408e8f0 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16980b0040 con 0x7f16a408e8f0 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f1691ffb640 10 monclient: dump: 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.597 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16937fe640 4 set_mon_vals no callback set 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 5 monclient: authenticate success, global_id 4370 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _renew_subs 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a413dab0 con 0x7f16a408e8f0 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _renew_subs 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.573+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a412b190 con 0x7f16a408e8f0 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16ab9c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16ab9c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16ab9c2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a408e3b0 con 0x7f16a408e8f0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f16980b3070 con 0x7f16a408e8f0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f1691ffb640 1 --2- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 0x7f167405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f16980e7980 con 0x7f16a408e8f0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16a9737640 1 --2- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 0x7f167405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16a9737640 10 monclient: get_auth_request con 0x7f167403ab10 auth_method 0 2026-02-22T20:52:17.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.577+0000 7f16a9737640 1 --2- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 0x7f167405afc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1694004780 tx=0x7f1694008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.581+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1698016150 con 0x7f16a408e8f0 2026-02-22T20:52:17.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.581+0000 7f1691ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.581+0000 7f1691ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f16a413baa0 con 0x7f16a408e8f0 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f1691ffb640 1 -- 10.20.193.7:0/3878329056 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f1698003e20 con 0x7f16a408e8f0 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f1691ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-22T20:52:17.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f1691ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:17.666 INFO:teuthology.orchestra.run.trial007.stdout:pg_num: 1 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 msgr2=0x7f167405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 0x7f167405afc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1694004780 tx=0x7f1694008040 comp rx=0 tx=0).stop 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 10 monclient: shutdown 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 msgr2=0x7f16a4150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f169801c480 tx=0x7f16980191e0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 shutdown_connections 2026-02-22T20:52:17.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16a413c260 0x7f16a4129770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16a408e8f0 0x7f16a4150bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> v2:10.20.193.61:6800/2336688312 conn(0x7f167403ab10 0x7f167405afc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 --2- 10.20.193.7:0/3878329056 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16a405d520 0x7f16a41506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 >> 10.20.193.7:0/3878329056 conn(0x7f16a408faa0 msgr2=0x7f16a405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 shutdown_connections 2026-02-22T20:52:17.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.661+0000 7f16ab9c2640 1 -- 10.20.193.7:0/3878329056 wait complete. 2026-02-22T20:52:17.676 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-22T20:52:17.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 10 monclient: monmap: 2026-02-22T20:52:17.746 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.746996+0000 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.746996+0000 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 1 Processor -- start 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 1 -- start start 2026-02-22T20:52:17.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.741+0000 7f4b2f445640 10 monclient: init 2026-02-22T20:52:17.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: _add_conns ranks=[4,3,0,2,1] 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f4b2808b540 0x7f4b2813a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-c con 0x7f4b2808b540 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b2813a640 0x7f4b2808e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-a con 0x7f4b2813a640 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b2808e8f0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b280898d0 con 0x7f4b2808e8f0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4b28089240 con 0x7f4b2813a640 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2808adb0 con 0x7f4b2808b540 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): authenticate will time out at 550.220144s 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b2813a640 0x7f4b2808e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f4b2808e8f0 0x7f4b2819e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39384/0 (socket says 10.20.193.7:39384) 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b2813a640 0x7f4b2808e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46532/0 (socket says 10.20.193.7:46532) 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 -- 10.20.193.7:0/214141036 learned_addr learned my addr 10.20.193.7:0/214141036 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): get_auth_request con 0x7f4b2813a640 auth_method 0 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 1 --2- 10.20.193.7:0/214141036 >> v2:10.20.193.61:3300/0 conn(0x7f4b2808b540 0x7f4b2813a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): get_auth_request con 0x7f4b2808b540 auth_method 0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient(hunting): handle_auth_done global_id 4455 payload 274 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 -- 10.20.193.7:0/214141036 >> v2:10.20.193.61:3300/0 conn(0x7f4b2808b540 msgr2=0x7f4b2813a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- 10.20.193.7:0/214141036 >> v2:10.20.193.61:3300/0 conn(0x7f4b2808b540 0x7f4b2813a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 -- 10.20.193.7:0/214141036 >> v1:10.20.193.7:6789/0 conn(0x7f4b2808e8f0 legacy=0x7f4b2819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 -- 10.20.193.7:0/214141036 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2808a7f0 con 0x7f4b2813a640 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- 10.20.193.7:0/214141036 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2813a640 0x7f4b2808e3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b2808af30 tx=0x7f4b1c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fac458a0f62be26 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 1 -- 10.20.193.7:0/214141036 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0b1070 con 0x7f4b2813a640 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: dump: 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.751 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 1 -- 10.20.193.7:0/214141036 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0ac640 con 0x7f4b2813a640 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 1 -- 10.20.193.7:0/214141036 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0aca10 con 0x7f4b2813a640 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 5 monclient: authenticate success, global_id 4455 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 4 set_mon_vals no callback set 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b17fff640 10 monclient: dump: 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: shutdown 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- 10.20.193.7:0/214141036 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2813a640 msgr2=0x7f4b2808e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- 10.20.193.7:0/214141036 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2813a640 0x7f4b2808e3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b2808af30 tx=0x7f4b1c01c400 comp rx=0 tx=0).stop 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- 10.20.193.7:0/214141036 shutdown_connections 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- 10.20.193.7:0/214141036 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2813a640 0x7f4b2808e3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- 10.20.193.7:0/214141036 >> v2:10.20.193.61:3300/0 conn(0x7f4b2808b540 0x7f4b2813a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- 10.20.193.7:0/214141036 >> 10.20.193.7:0/214141036 conn(0x7f4b2808faa0 msgr2=0x7f4b2808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- 10.20.193.7:0/214141036 shutdown_connections 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- 10.20.193.7:0/214141036 wait complete. 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: monmap: 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 Processor -- start 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- start start 2026-02-22T20:52:17.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: init 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2808b540 0x7f4b280869d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-a con 0x7f4b2808b540 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 0x7f4b28086f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-b con 0x7f4b2808e8f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): picked mon.noname-c con 0x7f4b2813a640 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b281a23e0 con 0x7f4b2808b540 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4b281a2260 con 0x7f4b2808e8f0 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4b281a2560 con 0x7f4b2813a640 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2f445640 10 monclient(hunting): authenticate will time out at 550.223566s 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2808b540 0x7f4b280869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46806/0 (socket says 10.20.193.7:46806) 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 -- 10.20.193.7:0/1602780627 learned_addr learned my addr 10.20.193.7:0/1602780627 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): get_auth_request con 0x7f4b2813a640 auth_method 0 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): get_auth_request con 0x7f4b2808b540 auth_method 0 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d1ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient(hunting): handle_auth_done global_id 4373 payload 824 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 0x7f4b28086f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 -- 10.20.193.7:0/1602780627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 msgr2=0x7f4b28086f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 0x7f4b28086f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 -- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2808b540 msgr2=0x7f4b280869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2808b540 0x7f4b280869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 monclient: found mon.noname-c 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 -- 10.20.193.7:0/1602780627 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b28086690 con 0x7f4b2813a640 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 10 monclient: get_auth_request con 0x7f4b2808e8f0 auth_method 0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2c9b9640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 0x7f4b28086f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b2d9bb640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400caf0 tx=0x7f4b2400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24017070 con 0x7f4b2813a640 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: dump: 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2400aca0 con 0x7f4b2813a640 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24012600 con 0x7f4b2813a640 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.745+0000 7f4b15ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b15ffb640 10 monclient: dump: 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 5 monclient: authenticate success, global_id 4373 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b177fe640 4 set_mon_vals no callback set 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _renew_subs 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2812ff50 con 0x7f4b2813a640 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _renew_subs 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2812ed10 con 0x7f4b2813a640 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4b240127a0 con 0x7f4b2813a640 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2805ca20 con 0x7f4b2813a640 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b15ffb640 1 --2- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 0x7f4af805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f4b2404e640 con 0x7f4b2813a640 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2d1ba640 1 --2- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 0x7f4af805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2d1ba640 10 monclient: get_auth_request con 0x7f4af803ab20 auth_method 0 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.749+0000 7f4b2d1ba640 1 --2- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 0x7f4af805afd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b18004780 tx=0x7f4b18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.753+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f4b28086690 con 0x7f4b2813a640 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.753+0000 7f4b15ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.753+0000 7f4b15ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.829+0000 7f4b2f445640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.829+0000 7f4b2f445640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.829+0000 7f4b2f445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.829+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f4b28057e70 con 0x7f4b2813a640 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b15ffb640 1 -- 10.20.193.7:0/1602780627 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) ==== 92+0+10 (secure 0 0 0) 0x7f4b240096d0 con 0x7f4b2813a640 2026-02-22T20:52:17.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b15ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-22T20:52:17.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b15ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:17.836 INFO:teuthology.orchestra.run.trial007.stdout:pg_num: 8 2026-02-22T20:52:17.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 msgr2=0x7f4af805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 0x7f4af805afd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b18004780 tx=0x7f4b18008040 comp rx=0 tx=0).stop 2026-02-22T20:52:17.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 10 monclient: shutdown 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 msgr2=0x7f4b28087450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400caf0 tx=0x7f4b2400a060 comp rx=0 tx=0).stop 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 shutdown_connections 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b2813a640 0x7f4b28087450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4af803ab20 0x7f4af805afd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b2808e8f0 0x7f4b28086f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 --2- 10.20.193.7:0/1602780627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b2808b540 0x7f4b280869d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 >> 10.20.193.7:0/1602780627 conn(0x7f4b2808faa0 msgr2=0x7f4b2805b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 shutdown_connections 2026-02-22T20:52:17.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.833+0000 7f4b2f445640 1 -- 10.20.193.7:0/1602780627 wait complete. 2026-02-22T20:52:17.846 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-22T20:52:17.846 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T20:52:17.911 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: get_monmap_and_config 2026-02-22T20:52:17.911 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.911 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: monmap: 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:17.910079+0000 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:17.910079+0000 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:17.912 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 Processor -- start 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 -- start start 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: init 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 0x7fc2c0092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-b con 0x7fc2c0091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc2c013f1b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc2c013fcb0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c008e6a0 con 0x7fc2c013fcb0 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c008e910 con 0x7fc2c013f1b0 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c008ebf0 con 0x7fc2c0091c70 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2c4b34640 10 monclient(hunting): authenticate will time out at 550.383086s 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 0x7fc2c0092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2bed76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc2c013fcb0 0x7fc2c01a1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39398/0 (socket says 10.20.193.7:39398) 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2bed76640 1 -- 10.20.193.7:0/1783981271 learned_addr learned my addr 10.20.193.7:0/1783981271 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): get_auth_request con 0x7fc2c0091c70 auth_method 0 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient(hunting): handle_auth_done global_id 4376 payload 274 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2bd573640 1 -- 10.20.193.7:0/1783981271 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986809712 0 0) 0x7fc2c008e6a0 con 0x7fc2c013fcb0 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 1 -- 10.20.193.7:0/1783981271 >> v1:10.20.193.61:6789/0 conn(0x7fc2c013f1b0 legacy=0x7fc2c013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:17.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 1 -- 10.20.193.7:0/1783981271 >> v1:10.20.193.7:6789/0 conn(0x7fc2c013fcb0 legacy=0x7fc2c01a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 1 monclient: found mon.noname-b 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2be575640 1 -- 10.20.193.7:0/1783981271 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c008eed0 con 0x7fc2c0091c70 2026-02-22T20:52:17.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.905+0000 7fc2bd573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:17.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- 10.20.193.7:0/1783981271 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 0x7fc2c0092040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009840 tx=0x7fc2b401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff551a7e5b5543e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 1 -- 10.20.193.7:0/1783981271 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40aa430 con 0x7fc2c0091c70 2026-02-22T20:52:17.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:17.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: dump: 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 1 -- 10.20.193.7:0/1783981271 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b40af070 con 0x7fc2c0091c70 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 1 -- 10.20.193.7:0/1783981271 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40aa7f0 con 0x7fc2c0091c70 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bd573640 10 monclient: dump: 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.924 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 5 monclient: authenticate success, global_id 4376 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 4 set_mon_vals no callback set 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: shutdown 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1783981271 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 msgr2=0x7fc2c0092040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1783981271 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 0x7fc2c0092040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009840 tx=0x7fc2b401c4f0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1783981271 shutdown_connections 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1783981271 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c0091c70 0x7fc2c0092040 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1783981271 >> 10.20.193.7:0/1783981271 conn(0x7fc2c0093d80 msgr2=0x7fc2c0090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1783981271 shutdown_connections 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1783981271 wait complete. 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: build_initial_monmap 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: monmap: 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:17.926 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 Processor -- start 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- start start 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: init 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-a con 0x7fc2c0091c70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc2c013f1b0 0x7fc2c01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-b con 0x7fc2c013f1b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 0x7fc2c012ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): picked mon.noname-c con 0x7fc2c013fcb0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01a55d0 con 0x7fc2c0091c70 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01a5450 con 0x7fc2c013f1b0 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c01a5750 con 0x7fc2c013fcb0 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:17.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient(hunting): authenticate will time out at 550.386651s 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 0x7fc2c012ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46548/0 (socket says 10.20.193.7:46548) 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 -- 10.20.193.7:0/1663489439 learned_addr learned my addr 10.20.193.7:0/1663489439 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): get_auth_request con 0x7fc2c0091c70 auth_method 0 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): get_auth_request con 0x7fc2c013fcb0 auth_method 0 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc2c013f1b0 0x7fc2c01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): get_auth_request con 0x7fc2c013f1b0 auth_method 0 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:17.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 -- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 msgr2=0x7fc2c012ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 0x7fc2c012ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 -- 10.20.193.7:0/1663489439 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc2c013f1b0 msgr2=0x7fc2c01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc2c013f1b0 0x7fc2c01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 monclient: found mon.noname-a 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 -- 10.20.193.7:0/1663489439 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c012c710 con 0x7fc2c0091c70 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bed76640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 0x7fc2c012ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2be575640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2b401c530 tx=0x7fc2b4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40b8020 con 0x7fc2c0091c70 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: dump: 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.932 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4003d60 con 0x7fc2c0091c70 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40aa630 con 0x7fc2c0091c70 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:17.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2a6ffd640 10 monclient: dump: 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2bcd72640 4 set_mon_vals no callback set 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 5 monclient: authenticate success, global_id 4467 2026-02-22T20:52:17.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _renew_subs 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c013d870 con 0x7fc2c0091c70 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _renew_subs 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c008a970 con 0x7fc2c0091c70 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.909+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c0092040 con 0x7fc2c0091c70 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc2b40c5060 con 0x7fc2c0091c70 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 1 --2- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 0x7fc28c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:17.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fc2b40e89a0 con 0x7fc2c0091c70 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2bdd74640 1 --2- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 0x7fc28c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2bdd74640 10 monclient: get_auth_request con 0x7fc28c03ab20 auth_method 0 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2bdd74640 1 --2- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 0x7fc28c05afd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2c013d160 tx=0x7fc2a80037e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fc2b4016170 con 0x7fc2c0091c70 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:17.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.913+0000 7fc2a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:17.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2c0092040 con 0x7fc28c03ab20 2026-02-22T20:52:18.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2a6ffd640 1 -- 10.20.193.7:0/1663489439 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34177 (secure 0 0 0) 0x7fc2c0092040 con 0x7fc28c03ab20 2026-02-22T20:52:18.001 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 msgr2=0x7fc28c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 0x7fc28c05afd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2c013d160 tx=0x7fc2a80037e0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 10 monclient: shutdown 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 msgr2=0x7fc2c0150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2b401c530 tx=0x7fc2b4019290 comp rx=0 tx=0).stop 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 shutdown_connections 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc2c013fcb0 0x7fc2c012ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc28c03ab20 0x7fc28c05afd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc2c013f1b0 0x7fc2c01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 --2- 10.20.193.7:0/1663489439 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc2c0091c70 0x7fc2c0150490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 >> 10.20.193.7:0/1663489439 conn(0x7fc2c0093d80 msgr2=0x7fc2c0056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 shutdown_connections 2026-02-22T20:52:18.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:17.997+0000 7fc2c4b34640 1 -- 10.20.193.7:0/1663489439 wait complete. 2026-02-22T20:52:18.011 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T20:52:17.910953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":47,"kb_used_meta":161616,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1453780,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":48747,"internal_metadata":165495189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709119"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632251+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T20:52:13.632251+0000","last_peered":"2026-02-22T20:52:13.632251+0000","last_clean":"2026-02-22T20:52:13.632251+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T20:52:13.632251+0000","last_undegraded":"2026-02-22T20:52:13.632251+0000","last_fullsized":"2026-02-22T20:52:13.632251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212768+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T20:52:13.212768+0000","last_peered":"2026-02-22T20:52:13.212768+0000","last_clean":"2026-02-22T20:52:13.212768+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T20:52:13.212768+0000","last_undegraded":"2026-02-22T20:52:13.212768+0000","last_fullsized":"2026-02-22T20:52:13.212768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632188+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T20:52:13.632188+0000","last_peered":"2026-02-22T20:52:13.632188+0000","last_clean":"2026-02-22T20:52:13.632188+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T20:52:13.632188+0000","last_undegraded":"2026-02-22T20:52:13.632188+0000","last_fullsized":"2026-02-22T20:52:13.632188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212815+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T20:52:13.212815+0000","last_peered":"2026-02-22T20:52:13.212815+0000","last_clean":"2026-02-22T20:52:13.212815+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T20:52:13.212815+0000","last_undegraded":"2026-02-22T20:52:13.212815+0000","last_fullsized":"2026-02-22T20:52:13.212815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.204088+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T20:52:13.204088+0000","last_peered":"2026-02-22T20:52:13.204088+0000","last_clean":"2026-02-22T20:52:13.204088+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T20:52:13.204088+0000","last_undegraded":"2026-02-22T20:52:13.204088+0000","last_fullsized":"2026-02-22T20:52:13.204088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212879+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T20:52:13.212879+0000","last_peered":"2026-02-22T20:52:13.212879+0000","last_clean":"2026-02-22T20:52:13.212879+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T20:52:13.212879+0000","last_undegraded":"2026-02-22T20:52:13.212879+0000","last_fullsized":"2026-02-22T20:52:13.212879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632457+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T20:52:13.632457+0000","last_peered":"2026-02-22T20:52:13.632457+0000","last_clean":"2026-02-22T20:52:13.632457+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T20:52:13.632457+0000","last_undegraded":"2026-02-22T20:52:13.632457+0000","last_fullsized":"2026-02-22T20:52:13.632457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.203940+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T20:52:13.203940+0000","last_peered":"2026-02-22T20:52:13.203940+0000","last_clean":"2026-02-22T20:52:13.203940+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T20:52:13.203940+0000","last_undegraded":"2026-02-22T20:52:13.203940+0000","last_fullsized":"2026-02-22T20:52:13.203940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":155,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.631852+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T20:52:13.631852+0000","last_peered":"2026-02-22T20:52:13.631852+0000","last_clean":"2026-02-22T20:52:13.631852+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T20:52:13.631852+0000","last_undegraded":"2026-02-22T20:52:13.631852+0000","last_fullsized":"2026-02-22T20:52:13.631852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T20:52:18.012 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T20:52:18.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.077+0000 7fd85fc8a640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.077+0000 7fd85fc8a640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.077+0000 7fd85fc8a640 10 monclient: monmap: 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.083443+0000 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.083443+0000 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.090 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.077+0000 7fd85fc8a640 1 Processor -- start 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- start start 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: init 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-22T20:52:18.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd85813f290 0x7fd85813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-a con 0x7fd85813f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd85813fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 0x7fd8581a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-c con 0x7fd85813c680 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85808fd70 con 0x7fd85813fba0 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd85808e1f0 con 0x7fd85813f290 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd85808ec90 con 0x7fd85813c680 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): authenticate will time out at 550.556448s 2026-02-22T20:52:18.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd85813f290 0x7fd85813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd85813f290 0x7fd85813f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46560/0 (socket says 10.20.193.7:46560) 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 -- 10.20.193.7:0/2949756475 learned_addr learned my addr 10.20.193.7:0/2949756475 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): get_auth_request con 0x7fd85813f290 auth_method 0 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 1 --2- 10.20.193.7:0/2949756475 >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 0x7fd8581a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): get_auth_request con 0x7fd85813c680 auth_method 0 2026-02-22T20:52:18.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_done global_id 4470 payload 274 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 -- 10.20.193.7:0/2949756475 >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 msgr2=0x7fd8581a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 --2- 10.20.193.7:0/2949756475 >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 0x7fd8581a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 -- 10.20.193.7:0/2949756475 >> v1:10.20.193.7:6789/0 conn(0x7fd85813fba0 legacy=0x7fd85813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 monclient: found mon.noname-a 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 -- 10.20.193.7:0/2949756475 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858092bc0 con 0x7fd85813f290 2026-02-22T20:52:18.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 1 -- 10.20.193.7:0/2949756475 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959204891 0 0) 0x7fd84c002920 con 0x7fd85813fba0 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 1 --2- 10.20.193.7:0/2949756475 >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 0x7fd8581a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 --2- 10.20.193.7:0/2949756475 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85813f660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd85808f390 tx=0x7fd84801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55319094fd894f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 1 -- 10.20.193.7:0/2949756475 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480aa610 con 0x7fd85813f290 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: dump: 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.095 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 1 -- 10.20.193.7:0/2949756475 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8480af070 con 0x7fd85813f290 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 1 -- 10.20.193.7:0/2949756475 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480aa9d0 con 0x7fd85813f290 2026-02-22T20:52:18.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 5 monclient: authenticate success, global_id 4470 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 4 set_mon_vals no callback set 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85c9fd640 10 monclient: dump: 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.097 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: shutdown 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- 10.20.193.7:0/2949756475 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 msgr2=0x7fd85813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/2949756475 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85813f660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd85808f390 tx=0x7fd84801c4b0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- 10.20.193.7:0/2949756475 shutdown_connections 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/2949756475 >> v2:10.20.193.61:3300/0 conn(0x7fd85813c680 0x7fd8581a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/2949756475 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85813f660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- 10.20.193.7:0/2949756475 >> 10.20.193.7:0/2949756475 conn(0x7fd858093df0 msgr2=0x7fd8580902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- 10.20.193.7:0/2949756475 shutdown_connections 2026-02-22T20:52:18.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- 10.20.193.7:0/2949756475 wait complete. 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: monmap: 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 Processor -- start 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- start start 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: init 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd85813c680 0x7fd858109e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-b con 0x7fd85813c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-a con 0x7fd85813f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd85813fba0 0x7fd85810a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): picked mon.noname-c con 0x7fd85813fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd858090de0 con 0x7fd85813f290 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd858090c60 con 0x7fd85813c680 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd8581a4540 con 0x7fd85813fba0 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85fc8a640 10 monclient(hunting): authenticate will time out at 550.559611s 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46572/0 (socket says 10.20.193.7:46572) 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd85813fba0 0x7fd85810a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 -- 10.20.193.7:0/3210569109 learned_addr learned my addr 10.20.193.7:0/3210569109 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): get_auth_request con 0x7fd85813f290 auth_method 0 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): get_auth_request con 0x7fd85813fba0 auth_method 0 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd85813c680 0x7fd858109e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): get_auth_request con 0x7fd85813c680 auth_method 0 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85e200640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d9ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient(hunting): handle_auth_done global_id 4476 payload 824 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 -- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd85813fba0 msgr2=0x7fd85810a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd85813fba0 0x7fd85810a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 -- 10.20.193.7:0/3210569109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd85813c680 msgr2=0x7fd858109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd85813c680 0x7fd858109e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.081+0000 7fd85d1fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d1fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d1fe640 1 -- 10.20.193.7:0/3210569109 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85808a9e0 con 0x7fd85813f290 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d1fe640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c730 tx=0x7fd84c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c017070 con 0x7fd85813f290 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: dump: 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.104 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c005270 con 0x7fd85813f290 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 5 monclient: authenticate success, global_id 4476 2026-02-22T20:52:18.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _renew_subs 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85813eeb0 con 0x7fd85813f290 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c003670 con 0x7fd85813f290 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 10 monclient: dump: 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.106 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd847fff640 4 set_mon_vals no callback set 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _renew_subs 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd858122cf0 con 0x7fd85813f290 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85813f660 con 0x7fd85813f290 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd84c003810 con 0x7fd85813f290 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 --2- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 0x7fd82805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7fd84c04deb0 con 0x7fd85813f290 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d9ff640 1 --2- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 0x7fd82805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d9ff640 10 monclient: get_auth_request con 0x7fd82803ab20 auth_method 0 2026-02-22T20:52:18.108 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.085+0000 7fd85d9ff640 1 --2- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 0x7fd82805afd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd848004780 tx=0x7fd8480a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.089+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd85808fd70 con 0x7fd85813f290 2026-02-22T20:52:18.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.089+0000 7fd8467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.089+0000 7fd8467fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd85805fb70 con 0x7fd82803ab20 2026-02-22T20:52:18.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd8467fc640 1 -- 10.20.193.7:0/3210569109 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34177 (secure 0 0 0) 0x7fd85805fb70 con 0x7fd82803ab20 2026-02-22T20:52:18.171 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T20:52:18.171 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 msgr2=0x7fd82805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 0x7fd82805afd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd848004780 tx=0x7fd8480a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 10 monclient: shutdown 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 msgr2=0x7fd85810a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c730 tx=0x7fd84c00cbf0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 shutdown_connections 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd85813fba0 0x7fd85810a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd85813f290 0x7fd85810a380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd82803ab20 0x7fd82805afd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 --2- 10.20.193.7:0/3210569109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd85813c680 0x7fd858109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 >> 10.20.193.7:0/3210569109 conn(0x7fd858093df0 msgr2=0x7fd858055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 shutdown_connections 2026-02-22T20:52:18.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.169+0000 7fd85fc8a640 1 -- 10.20.193.7:0/3210569109 wait complete. 2026-02-22T20:52:18.181 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T20:52:17.910953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":47,"kb_used_meta":161616,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1453780,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":48747,"internal_metadata":165495189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709119"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632251+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T20:52:13.632251+0000","last_peered":"2026-02-22T20:52:13.632251+0000","last_clean":"2026-02-22T20:52:13.632251+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T20:52:13.632251+0000","last_undegraded":"2026-02-22T20:52:13.632251+0000","last_fullsized":"2026-02-22T20:52:13.632251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212768+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T20:52:13.212768+0000","last_peered":"2026-02-22T20:52:13.212768+0000","last_clean":"2026-02-22T20:52:13.212768+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T20:52:13.212768+0000","last_undegraded":"2026-02-22T20:52:13.212768+0000","last_fullsized":"2026-02-22T20:52:13.212768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632188+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T20:52:13.632188+0000","last_peered":"2026-02-22T20:52:13.632188+0000","last_clean":"2026-02-22T20:52:13.632188+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T20:52:13.632188+0000","last_undegraded":"2026-02-22T20:52:13.632188+0000","last_fullsized":"2026-02-22T20:52:13.632188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212815+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T20:52:13.212815+0000","last_peered":"2026-02-22T20:52:13.212815+0000","last_clean":"2026-02-22T20:52:13.212815+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T20:52:13.212815+0000","last_undegraded":"2026-02-22T20:52:13.212815+0000","last_fullsized":"2026-02-22T20:52:13.212815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.204088+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T20:52:13.204088+0000","last_peered":"2026-02-22T20:52:13.204088+0000","last_clean":"2026-02-22T20:52:13.204088+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T20:52:13.204088+0000","last_undegraded":"2026-02-22T20:52:13.204088+0000","last_fullsized":"2026-02-22T20:52:13.204088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.212879+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T20:52:13.212879+0000","last_peered":"2026-02-22T20:52:13.212879+0000","last_clean":"2026-02-22T20:52:13.212879+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T20:52:13.212879+0000","last_undegraded":"2026-02-22T20:52:13.212879+0000","last_fullsized":"2026-02-22T20:52:13.212879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.632457+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T20:52:13.632457+0000","last_peered":"2026-02-22T20:52:13.632457+0000","last_clean":"2026-02-22T20:52:13.632457+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T20:52:13.632457+0000","last_undegraded":"2026-02-22T20:52:13.632457+0000","last_fullsized":"2026-02-22T20:52:13.632457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.203940+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T20:52:13.203940+0000","last_peered":"2026-02-22T20:52:13.203940+0000","last_clean":"2026-02-22T20:52:13.203940+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T20:52:13.203940+0000","last_undegraded":"2026-02-22T20:52:13.203940+0000","last_fullsized":"2026-02-22T20:52:13.203940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":155,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-22T20:52:13.631852+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T20:52:13.631852+0000","last_peered":"2026-02-22T20:52:13.631852+0000","last_clean":"2026-02-22T20:52:13.631852+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T20:52:13.631852+0000","last_undegraded":"2026-02-22T20:52:13.631852+0000","last_fullsized":"2026-02-22T20:52:13.631852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":45501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":148,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":151552,"data_stored":45520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":635869,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T20:52:18.182 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-22T20:52:18.182 DEBUG:tasks.mon_thrash:Yielding 2026-02-22T20:52:18.182 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T20:52:18.194 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T20:52:18.194 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial061.front.sepia.ceph.com 2026-02-22T20:52:18.194 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:52:18.194 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-22T20:52:18.194 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771793538, revive delay: 20.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 20.0 2026-02-22T20:52:18.194 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:52:18.194 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:18.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: monmap: 2026-02-22T20:52:18.259 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.257771+0000 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.257771+0000 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.260 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 Processor -- start 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 -- start start 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: init 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 0x7f879813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-c con 0x7f879813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:18.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f879813fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-b con 0x7f879813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879808fd70 con 0x7f879813fba0 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f879808e1f0 con 0x7f879813f290 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f879808ec90 con 0x7f879813c680 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879eee5640 10 monclient(hunting): authenticate will time out at 550.730782s 2026-02-22T20:52:18.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46846/0 (socket says 10.20.193.7:46846) 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 -- 10.20.193.7:0/960198739 learned_addr learned my addr 10.20.193.7:0/960198739 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): get_auth_request con 0x7f879813c680 auth_method 0 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879cc5a640 1 --2- 10.20.193.7:0/960198739 >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 0x7f879813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient(hunting): handle_auth_done global_id 4391 payload 274 2026-02-22T20:52:18.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 -- 10.20.193.7:0/960198739 >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 msgr2=0x7f879813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 --2- 10.20.193.7:0/960198739 >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 0x7f879813f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 -- 10.20.193.7:0/960198739 >> v1:10.20.193.61:6789/0 conn(0x7f879813fba0 legacy=0x7f879813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 monclient: found mon.noname-b 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879d45b640 1 -- 10.20.193.7:0/960198739 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8798092bc0 con 0x7f879813c680 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879cc5a640 10 monclient: get_auth_request con 0x7f879813f290 auth_method 0 2026-02-22T20:52:18.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.253+0000 7f879cc5a640 1 --2- 10.20.193.7:0/960198739 >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 0x7f879813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:18.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 1 --2- 10.20.193.7:0/960198739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8794009580 tx=0x7f879401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21f337bf4605b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 1 -- 10.20.193.7:0/960198739 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940b2070 con 0x7f879813c680 2026-02-22T20:52:18.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: dump: 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.271 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 1 -- 10.20.193.7:0/960198739 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87940a57d0 con 0x7f879813c680 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 1 -- 10.20.193.7:0/960198739 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940a5bc0 con 0x7f879813c680 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878f7fe640 10 monclient: dump: 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.272 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 5 monclient: authenticate success, global_id 4391 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 4 set_mon_vals no callback set 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: shutdown 2026-02-22T20:52:18.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/960198739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 msgr2=0x7f87981a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- 10.20.193.7:0/960198739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8794009580 tx=0x7f879401c8f0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/960198739 shutdown_connections 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- 10.20.193.7:0/960198739 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813c680 0x7f87981a17e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- 10.20.193.7:0/960198739 >> v2:10.20.193.61:3300/0 conn(0x7f879813f290 0x7f879813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/960198739 >> 10.20.193.7:0/960198739 conn(0x7f8798093df0 msgr2=0x7f87980902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/960198739 shutdown_connections 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/960198739 wait complete. 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: monmap: 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.274 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 Processor -- start 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- start start 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: init 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 0x7f8798129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-b con 0x7f879813c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-c con 0x7f879813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f879813fba0 0x7f879812a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): picked mon.noname-a con 0x7f879813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87981a46c0 con 0x7f879813fba0 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f87981a4540 con 0x7f879813c680 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f87981a4840 con 0x7f879813f290 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient(hunting): authenticate will time out at 550.734919s 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46852/0 (socket says 10.20.193.7:46852) 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 -- 10.20.193.7:0/4289182833 learned_addr learned my addr 10.20.193.7:0/4289182833 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): get_auth_request con 0x7f879813f290 auth_method 0 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f879813fba0 0x7f879812a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): get_auth_request con 0x7f879813fba0 auth_method 0 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879d45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 0x7f8798129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 10 monclient(hunting): get_auth_request con 0x7f879813c680 auth_method 0 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient(hunting): handle_auth_done global_id 4394 payload 824 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 -- 10.20.193.7:0/4289182833 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 msgr2=0x7f8798129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 0x7f8798129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 -- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f879813fba0 msgr2=0x7f879812a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f879813fba0 0x7f879812a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 monclient: found mon.noname-c 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 -- 10.20.193.7:0/4289182833 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879812cb00 con 0x7f879813f290 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879cc5a640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 0x7f8798129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:18.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878ffff640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f878000c4f0 tx=0x7f878000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780016020 con 0x7f879813f290 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: dump: 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.280 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8780005220 con 0x7f879813f290 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800068d0 con 0x7f879813f290 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 5 monclient: authenticate success, global_id 4394 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _renew_subs 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879812d970 con 0x7f879813f290 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878effd640 4 set_mon_vals no callback set 2026-02-22T20:52:18.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f878d7fa640 10 monclient: dump: 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _renew_subs 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f879812b610 con 0x7f879813f290 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.257+0000 7f879eee5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879eee5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879eee5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879813f660 con 0x7f879813f290 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8780006a70 con 0x7f879813f290 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 1 --2- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 0x7f876805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3559+0+0 (secure 0 0 0) 0x7f878004e180 con 0x7f879813f290 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879cc5a640 1 --2- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 0x7f876805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879cc5a640 10 monclient: get_auth_request con 0x7f876803ab20 auth_method 0 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f879cc5a640 1 --2- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 0x7f876805afd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8788004780 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f8780020020 con 0x7f879813f290 2026-02-22T20:52:18.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.261+0000 7f878d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f879805fb70 con 0x7f879813f290 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f878d7fa640 1 -- 10.20.193.7:0/4289182833 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f879808fd70 con 0x7f879813f290 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f878d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:18.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f878d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 msgr2=0x7f876805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 0x7f876805afd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8788004780 tx=0x7f8788008040 comp rx=0 tx=0).stop 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 10 monclient: shutdown 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 msgr2=0x7f879812a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f878000c4f0 tx=0x7f878000c9b0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 shutdown_connections 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f879813fba0 0x7f879812a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f879813f290 0x7f879812a390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> v2:10.20.193.61:6800/2336688312 conn(0x7f876803ab20 0x7f876805afd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 --2- 10.20.193.7:0/4289182833 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f879813c680 0x7f8798129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 >> 10.20.193.7:0/4289182833 conn(0x7f8798093df0 msgr2=0x7f8798055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 shutdown_connections 2026-02-22T20:52:18.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.381+0000 7f879eee5640 1 -- 10.20.193.7:0/4289182833 wait complete. 2026-02-22T20:52:18.397 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:52:18.398 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:52:18.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:52:18.398 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:52:18.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.500 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 10 monclient: monmap: 2026-02-22T20:52:18.500 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.500 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.467138+0000 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.467138+0000 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.501 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 1 Processor -- start 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 1 -- start start 2026-02-22T20:52:18.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.461+0000 7ff1f56dd640 10 monclient: init 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-b con 0x7ff1f008ff00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff1f013c4f0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff1f013c900 0x7ff1f0039630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-a con 0x7ff1f013c900 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:18.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f008ea60 con 0x7ff1f013c4f0 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff1f008ed40 con 0x7ff1f013c900 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f008f020 con 0x7ff1f008ff00 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): authenticate will time out at 550.940142s 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46864/0 (socket says 10.20.193.7:46864) 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/1904645727 learned_addr learned my addr 10.20.193.7:0/1904645727 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): get_auth_request con 0x7ff1f008ff00 auth_method 0 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 1 --2- 10.20.193.7:0/1904645727 >> v2:10.20.193.7:3300/0 conn(0x7ff1f013c900 0x7ff1f0039630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): get_auth_request con 0x7ff1f013c900 auth_method 0 2026-02-22T20:52:18.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_done global_id 4397 payload 274 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/1904645727 >> v2:10.20.193.7:3300/0 conn(0x7ff1f013c900 msgr2=0x7ff1f0039630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- 10.20.193.7:0/1904645727 >> v2:10.20.193.7:3300/0 conn(0x7ff1f013c900 0x7ff1f0039630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/1904645727 >> v1:10.20.193.61:6789/0 conn(0x7ff1f013c4f0 legacy=0x7ff1f0038f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 monclient: found mon.noname-b 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/1904645727 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f008dce0 con 0x7ff1f008ff00 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- 10.20.193.7:0/1904645727 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40090a0 tx=0x7ff1e401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f4abd14ca8a6e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 1 -- 10.20.193.7:0/1904645727 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40ad630 con 0x7ff1f008ff00 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: dump: 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.507 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 1 -- 10.20.193.7:0/1904645727 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e40ad7d0 con 0x7ff1f008ff00 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 1 -- 10.20.193.7:0/1904645727 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40adba0 con 0x7ff1f008ff00 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 5 monclient: authenticate success, global_id 4397 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 4 set_mon_vals no callback set 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1edffb640 10 monclient: dump: 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.509 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: shutdown 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- 10.20.193.7:0/1904645727 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 msgr2=0x7ff1f013bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/1904645727 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40090a0 tx=0x7ff1e401c500 comp rx=0 tx=0).stop 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- 10.20.193.7:0/1904645727 shutdown_connections 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/1904645727 >> v2:10.20.193.7:3300/0 conn(0x7ff1f013c900 0x7ff1f0039630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/1904645727 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f013bfb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- 10.20.193.7:0/1904645727 >> 10.20.193.7:0/1904645727 conn(0x7ff1f008cf40 msgr2=0x7ff1f008d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- 10.20.193.7:0/1904645727 shutdown_connections 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- 10.20.193.7:0/1904645727 wait complete. 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: monmap: 2026-02-22T20:52:18.510 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 Processor -- start 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- start start 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: init 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f0126100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-c con 0x7ff1f008ff00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff1f013c4f0 0x7ff1f0126640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-b con 0x7ff1f013c4f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f0126b80 0x7ff1f0126fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): picked mon.noname-a con 0x7ff1f0126b80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01a4040 con 0x7ff1f0126b80 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01a3ec0 con 0x7ff1f013c4f0 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f01a41c0 con 0x7ff1f008ff00 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1f56dd640 10 monclient(hunting): authenticate will time out at 550.943646s 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f0126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f0126100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46880/0 (socket says 10.20.193.7:46880) 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/3488331501 learned_addr learned my addr 10.20.193.7:0/3488331501 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): get_auth_request con 0x7ff1f008ff00 auth_method 0 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f0126b80 0x7ff1f0126fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): get_auth_request con 0x7ff1f0126b80 auth_method 0 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff1f013c4f0 0x7ff1f0126640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient(hunting): handle_auth_done global_id 4400 payload 824 2026-02-22T20:52:18.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff1f013c4f0 msgr2=0x7ff1f0126640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff1f013c4f0 0x7ff1f0126640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f0126b80 msgr2=0x7ff1f0126fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f0126b80 0x7ff1f0126fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 monclient: found mon.noname-c 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1eeffd640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f00875c0 con 0x7ff1f008ff00 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ee7fc640 10 monclient: get_auth_request con 0x7ff1f013c4f0 auth_method 0 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.465+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff1f013c4f0 0x7ff1f0126640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1eeffd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f0126100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009070 tx=0x7ff1e40192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40ba030 con 0x7ff1f008ff00 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: dump: 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.514 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4004020 con 0x7ff1f008ff00 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40043d0 con 0x7ff1f008ff00 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 5 monclient: authenticate success, global_id 4400 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 monclient: _renew_subs 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ed7fa640 4 set_mon_vals no callback set 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f013ad50 con 0x7ff1f008ff00 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: dump: 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 monclient: _renew_subs 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f0129a70 con 0x7ff1f008ff00 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 0x7ff1f0121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0127500 con 0x7ff1f013c8e0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff1e40c7060 con 0x7ff1f008ff00 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 0x7ff1f0121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient: get_auth_request con 0x7ff1f013c8e0 auth_method 0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_done global_id 4500 payload 824 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1f013bfb0 con 0x7ff1f013c8e0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 --2- 10.20.193.7:0/3488331501 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff1bc03ab20 0x7ff1bc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7ff1e40e8c60 con 0x7ff1f008ff00 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 0x7ff1f0121fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80037b0 tx=0x7ff1d800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8016070 con 0x7ff1f013c8e0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: dump: 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.517 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ef7fe640 1 --2- 10.20.193.7:0/3488331501 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff1bc03ab20 0x7ff1bc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ef7fe640 10 monclient: get_auth_request con 0x7ff1bc03ab20 auth_method 0 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7ff1d800b920 con 0x7ff1f013c8e0 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 msgr2=0x7ff1f0121fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 0x7ff1f0121fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80037b0 tx=0x7ff1d800db80 comp rx=0 tx=0).stop 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 msgr2=0x7ff1f0121fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1cf7fe640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f013c8e0 0x7ff1f0121fe0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80037b0 tx=0x7ff1d800db80 comp rx=0 tx=0).stop 2026-02-22T20:52:18.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.469+0000 7ff1ef7fe640 1 --2- 10.20.193.7:0/3488331501 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff1bc03ab20 0x7ff1bc05afd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff1f008fa20 tx=0x7ff1e000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 0x7ff1f004ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f013b2c0 con 0x7ff1f004ca80 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 0x7ff1f004ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient: get_auth_request con 0x7ff1f004ca80 auth_method 0 2026-02-22T20:52:18.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 10 monclient(hunting): handle_auth_done global_id 4503 payload 824 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 1 -- 10.20.193.7:0/3488331501 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1f0122520 con 0x7ff1f004ca80 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ee7fc640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 0x7ff1f004ce80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800dbc0 tx=0x7ff1d8003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d801bdf0 con 0x7ff1f004ca80 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 10 monclient: dump: 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.520 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7ff1d801bdf0 con 0x7ff1f004ca80 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 msgr2=0x7ff1f004ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 0x7ff1f004ce80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800dbc0 tx=0x7ff1d8003850 comp rx=0 tx=0).stop 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 msgr2=0x7ff1f004ce80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1cf7fe640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff1f004ca80 0x7ff1f004ce80 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800dbc0 tx=0x7ff1d8003850 comp rx=0 tx=0).stop 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:18.521 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 4, 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 17603, 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 17, 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.522 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:18.523 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.524 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.525 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.526 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.527 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.528 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.529 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.529 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:18.529 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff1bc03ab20 msgr2=0x7ff1bc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/3488331501 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff1bc03ab20 0x7ff1bc05afd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff1f008fa20 tx=0x7ff1e000b040 comp rx=0 tx=0).stop 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 10 monclient: shutdown 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 msgr2=0x7ff1f0126100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 --2- 10.20.193.7:0/3488331501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff1f008ff00 0x7ff1f0126100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009070 tx=0x7ff1e40192a0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ef7fe640 1 -- 10.20.193.7:0/3488331501 reap_dead start 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1ef7fe640 1 -- 10.20.193.7:0/3488331501 reap_dead start 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 shutdown_connections 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 >> 10.20.193.7:0/3488331501 conn(0x7ff1f008cf40 msgr2=0x7ff1f0088ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 shutdown_connections 2026-02-22T20:52:18.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.473+0000 7ff1f56dd640 1 -- 10.20.193.7:0/3488331501 wait complete. 2026-02-22T20:52:18.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:18.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:52:18.530 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:52:18.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: monmap: 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.602248+0000 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.602248+0000 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 Processor -- start 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 -- start start 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: init 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-22T20:52:18.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f785013f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-b con 0x7f785013fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f7850180d00 0x7f78501a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-c con 0x7f7850180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785008fd70 con 0x7f785013f290 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f785008e1f0 con 0x7f7850180d00 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f785008ec90 con 0x7f785013fd70 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f7855ebe640 10 monclient(hunting): authenticate will time out at 551.075147s 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f785013f290 0x7f785013f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:43662/0 (socket says 10.20.193.7:43662) 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:58312/0 (socket says 10.20.193.7:58312) 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784f7fe640 1 -- 10.20.193.7:0/2955963022 learned_addr learned my addr 10.20.193.7:0/2955963022 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): get_auth_request con 0x7f785013fd70 auth_method 0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 1 --2- 10.20.193.7:0/2955963022 >> v2:10.20.193.61:3300/0 conn(0x7f7850180d00 0x7f78501a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): get_auth_request con 0x7f7850180d00 auth_method 0 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient(hunting): handle_auth_done global_id 4403 payload 274 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 -- 10.20.193.7:0/2955963022 >> v2:10.20.193.61:3300/0 conn(0x7f7850180d00 msgr2=0x7f78501a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 --2- 10.20.193.7:0/2955963022 >> v2:10.20.193.61:3300/0 conn(0x7f7850180d00 0x7f78501a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 -- 10.20.193.7:0/2955963022 >> v1:10.20.193.7:6789/0 conn(0x7f785013f290 legacy=0x7f785013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 monclient: found mon.noname-b 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784e7fc640 1 -- 10.20.193.7:0/2955963022 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175997338 0 0) 0x7f783c002920 con 0x7f785013f290 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784effd640 1 -- 10.20.193.7:0/2955963022 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7850092bc0 con 0x7f785013fd70 2026-02-22T20:52:18.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.597+0000 7f784e7fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 1 --2- 10.20.193.7:0/2955963022 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f785008e370 tx=0x7f784001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf2bdc1cb478b96 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 1 -- 10.20.193.7:0/2955963022 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400ab5f0 con 0x7f785013fd70 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: dump: 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 1 -- 10.20.193.7:0/2955963022 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78400b0070 con 0x7f785013fd70 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 1 -- 10.20.193.7:0/2955963022 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400ab9b0 con 0x7f785013fd70 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784e7fc640 10 monclient: dump: 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 5 monclient: authenticate success, global_id 4403 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 4 set_mon_vals no callback set 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: shutdown 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/2955963022 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 msgr2=0x7f78501807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- 10.20.193.7:0/2955963022 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f785008e370 tx=0x7f784001c3f0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/2955963022 shutdown_connections 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- 10.20.193.7:0/2955963022 >> v2:10.20.193.61:3300/0 conn(0x7f7850180d00 0x7f78501a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- 10.20.193.7:0/2955963022 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/2955963022 >> 10.20.193.7:0/2955963022 conn(0x7f7850093df0 msgr2=0x7f78500902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/2955963022 shutdown_connections 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/2955963022 wait complete. 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: monmap: 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 Processor -- start 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- start start 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: init 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 0x7f78501893b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-c con 0x7f785013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-b con 0x7f785013fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7850180d00 0x7f78501898f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): picked mon.noname-a con 0x7f7850180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78501a3fc0 con 0x7f7850180d00 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f78501a3e40 con 0x7f785013fd70 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f78501a4140 con 0x7f785013f290 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): authenticate will time out at 551.078750s 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 0x7f78501893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 0x7f78501893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:58328/0 (socket says 10.20.193.7:58328) 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 -- 10.20.193.7:0/4278642648 learned_addr learned my addr 10.20.193.7:0/4278642648 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): get_auth_request con 0x7f785013f290 auth_method 0 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7850180d00 0x7f78501898f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): get_auth_request con 0x7f7850180d00 auth_method 0 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): get_auth_request con 0x7f785013fd70 auth_method 0 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient(hunting): handle_auth_done global_id 4406 payload 824 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f785013fd70 msgr2=0x7f78501807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f785013fd70 0x7f78501807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7850180d00 msgr2=0x7f78501898f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7850180d00 0x7f78501898f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 monclient: found mon.noname-c 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785019dfe0 con 0x7f785013f290 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784f7fe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 0x7f78501893b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c700 tx=0x7f783c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c018070 con 0x7f785013f290 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: dump: 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c004ae0 con 0x7f785013f290 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 5 monclient: authenticate success, global_id 4406 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _renew_subs 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785019bca0 con 0x7f785013f290 2026-02-22T20:52:18.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0070d0 con 0x7f785013f290 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784dffb640 4 set_mon_vals no callback set 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f782bfff640 10 monclient: dump: 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _renew_subs 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f785013d290 con 0x7f785013f290 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 0x7f785008bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f785013f660 con 0x7f785008bc00 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 0x7f785008bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient: get_auth_request con 0x7f785008bc00 auth_method 0 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 10 monclient(hunting): handle_auth_done global_id 4409 payload 824 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.601+0000 7f784effd640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f785019c7e0 con 0x7f785008bc00 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 0x7f785008bfd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f785008e370 tx=0x7f784001ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f783c007270 con 0x7f785013f290 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 --2- 10.20.193.7:0/4278642648 >> v2:10.20.193.61:6800/2336688312 conn(0x7f782003aae0 0x7f782005af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7f783c04df90 con 0x7f785013f290 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400b9070 con 0x7f785008bc00 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 10 monclient: dump: 2026-02-22T20:52:18.616 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f78400b0040 con 0x7f785008bc00 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 msgr2=0x7f785008bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 0x7f785008bfd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f785008e370 tx=0x7f784001ac30 comp rx=0 tx=0).stop 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 msgr2=0x7f785008bfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f782bfff640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008bc00 0x7f785008bfd0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f785008e370 tx=0x7f784001ac30 comp rx=0 tx=0).stop 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784ffff640 1 --2- 10.20.193.7:0/4278642648 >> v2:10.20.193.61:6800/2336688312 conn(0x7f782003aae0 0x7f782005af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784ffff640 10 monclient: get_auth_request con 0x7f782003aae0 auth_method 0 2026-02-22T20:52:18.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784ffff640 1 --2- 10.20.193.7:0/4278642648 >> v2:10.20.193.61:6800/2336688312 conn(0x7f782003aae0 0x7f782005af90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f785008a610 tx=0x7f784400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f7855ebe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:18.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f7855ebe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 0x7f785019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f7855ebe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f785005fb50 con 0x7f785008c510 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 0x7f785019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient: get_auth_request con 0x7f785008c510 auth_method 0 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 10 monclient(hunting): handle_auth_done global_id 4412 payload 824 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 1 -- 10.20.193.7:0/4278642648 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7850189e30 con 0x7f785008c510 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.605+0000 7f784effd640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 0x7f785019a470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f784001a020 tx=0x7f7840019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400c3d30 con 0x7f785008c510 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 10 monclient: dump: 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f78400be690 con 0x7f785008c510 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 msgr2=0x7f785019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 0x7f785019a470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f784001a020 tx=0x7f7840019190 comp rx=0 tx=0).stop 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 msgr2=0x7f785019a470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f782bfff640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785008c510 0x7f785019a470 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f784001a020 tx=0x7f7840019190 comp rx=0 tx=0).stop 2026-02-22T20:52:18.620 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 4, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 17735, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 17, 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.621 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.622 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.623 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.624 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.625 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:18.626 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.627 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:18.628 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 >> v2:10.20.193.61:6800/2336688312 conn(0x7f782003aae0 msgr2=0x7f782005af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 --2- 10.20.193.7:0/4278642648 >> v2:10.20.193.61:6800/2336688312 conn(0x7f782003aae0 0x7f782005af90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f785008a610 tx=0x7f784400b040 comp rx=0 tx=0).stop 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 10 monclient: shutdown 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 msgr2=0x7f78501893b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 --2- 10.20.193.7:0/4278642648 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f785013f290 0x7f78501893b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c700 tx=0x7f783c00cbc0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f784ffff640 1 -- 10.20.193.7:0/4278642648 reap_dead start 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f784ffff640 1 -- 10.20.193.7:0/4278642648 reap_dead start 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 shutdown_connections 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 >> 10.20.193.7:0/4278642648 conn(0x7f7850093df0 msgr2=0x7f7850055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 shutdown_connections 2026-02-22T20:52:18.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.609+0000 7f7855ebe640 1 -- 10.20.193.7:0/4278642648 wait complete. 2026-02-22T20:52:18.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:18.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:52:18.630 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.685+0000 7f8d0323a640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.685+0000 7f8d0323a640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.685+0000 7f8d0323a640 10 monclient: monmap: 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.691595+0000 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.691595+0000 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 Processor -- start 2026-02-22T20:52:18.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- start start 2026-02-22T20:52:18.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: init 2026-02-22T20:52:18.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-22T20:52:18.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8cfc13f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:18.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-b con 0x7f8cfc13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f8cfc180d00 0x7f8cfc1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-c con 0x7f8cfc180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc08fd70 con 0x7f8cfc13f290 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f8cfc08e1f0 con 0x7f8cfc180d00 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc08ec90 con 0x7f8cfc13fd70 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): authenticate will time out at 551.164617s 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:58352/0 (socket says 10.20.193.7:58352) 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 -- 10.20.193.7:0/3539303820 learned_addr learned my addr 10.20.193.7:0/3539303820 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): get_auth_request con 0x7f8cfc13fd70 auth_method 0 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): handle_auth_done global_id 4415 payload 274 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 -- 10.20.193.7:0/3539303820 >> v2:10.20.193.61:3300/0 conn(0x7f8cfc180d00 msgr2=0x7f8cfc1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3539303820 >> v2:10.20.193.61:3300/0 conn(0x7f8cfc180d00 0x7f8cfc1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 -- 10.20.193.7:0/3539303820 >> v1:10.20.193.61:6789/0 conn(0x7f8cfc13f290 legacy=0x7f8cfc13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 monclient: found mon.noname-b 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 -- 10.20.193.7:0/3539303820 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc092bc0 con 0x7f8cfc13fd70 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3539303820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc08e370 tx=0x7f8ce401c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1db067d7da4dc67 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 1 -- 10.20.193.7:0/3539303820 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40b0070 con 0x7f8cfc13fd70 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: dump: 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.698 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 1 -- 10.20.193.7:0/3539303820 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce40ab600 con 0x7f8cfc13fd70 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 1 -- 10.20.193.7:0/3539303820 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40ab9d0 con 0x7f8cfc13fd70 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 5 monclient: authenticate success, global_id 4415 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 4 set_mon_vals no callback set 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf37fe640 10 monclient: dump: 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.699 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: shutdown 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3539303820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 msgr2=0x7f8cfc1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3539303820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc08e370 tx=0x7f8ce401c2f0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3539303820 shutdown_connections 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3539303820 >> v2:10.20.193.61:3300/0 conn(0x7f8cfc180d00 0x7f8cfc1a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3539303820 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3539303820 >> 10.20.193.7:0/3539303820 conn(0x7f8cfc093df0 msgr2=0x7f8cfc0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3539303820 shutdown_connections 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3539303820 wait complete. 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: monmap: 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.700 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 Processor -- start 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- start start 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: init 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8cfc13f290 0x7f8cfc10be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-a con 0x7f8cfc13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-b con 0x7f8cfc13fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 0x7f8cfc128cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): picked mon.noname-c con 0x7f8cfc180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc1a4050 con 0x7f8cfc13f290 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc090da0 con 0x7f8cfc13fd70 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc1a41d0 con 0x7f8cfc180d00 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient(hunting): authenticate will time out at 551.167302s 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8cfc13f290 0x7f8cfc10be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 0x7f8cfc128cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8cfc13f290 0x7f8cfc10be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57390/0 (socket says 10.20.193.7:57390) 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 1 -- 10.20.193.7:0/3605061069 learned_addr learned my addr 10.20.193.7:0/3605061069 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 0x7f8cfc128cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:58358/0 (socket says 10.20.193.7:58358) 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): get_auth_request con 0x7f8cfc13f290 auth_method 0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): get_auth_request con 0x7f8cfc180d00 auth_method 0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): get_auth_request con 0x7f8cfc13fd70 auth_method 0 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient(hunting): handle_auth_done global_id 4418 payload 824 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc13fd70 msgr2=0x7f8cfc1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8cfc13f290 msgr2=0x7f8cfc10be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8cfc13f290 0x7f8cfc10be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 monclient: found mon.noname-c 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc10d680 con 0x7f8cfc180d00 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc13fd70 0x7f8cfc1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d017b0640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 0x7f8cfc128cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800bdf0 tx=0x7f8cf800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800ca00 con 0x7f8cfc180d00 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: dump: 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.703 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf8010070 con 0x7f8cfc180d00 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 5 monclient: authenticate success, global_id 4418 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _renew_subs 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc10c810 con 0x7f8cfc180d00 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800cde0 con 0x7f8cfc180d00 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf17fa640 10 monclient: dump: 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.704 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8cf2ffd640 4 set_mon_vals no callback set 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _renew_subs 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.689+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc10d0c0 con 0x7f8cfc180d00 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d0323a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 0x7f8cfc12c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc10d2c0 con 0x7f8cfc12bd80 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8cf801d030 con 0x7f8cfc180d00 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 0x7f8cfc12c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 --2- 10.20.193.7:0/3605061069 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ccc03ab20 0x7f8ccc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient: get_auth_request con 0x7f8cfc12bd80 auth_method 0 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7f8cf804e680 con 0x7f8cfc180d00 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3605061069 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ccc03ab20 0x7f8ccc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf3fff640 10 monclient: get_auth_request con 0x7f8ccc03ab20 auth_method 0 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 10 monclient(hunting): handle_auth_done global_id 4411 payload 824 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cfc13f660 con 0x7f8cfc12bd80 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8d00faf640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 0x7f8cfc12c150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00f770 tx=0x7f8cec00fc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf3fff640 1 --2- 10.20.193.7:0/3605061069 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ccc03ab20 0x7f8ccc05afd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4002410 tx=0x7f8ce40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec018020 con 0x7f8cfc12bd80 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 10 monclient: dump: 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.706 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f8cec00d950 con 0x7f8cfc12bd80 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 msgr2=0x7f8cfc12c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 0x7f8cfc12c150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00f770 tx=0x7f8cec00fc30 comp rx=0 tx=0).stop 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 msgr2=0x7f8cfc12c150 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.693+0000 7f8cf17fa640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12bd80 0x7f8cfc12c150 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00f770 tx=0x7f8cec00fc30 comp rx=0 tx=0).stop 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 0x7f8cfc0886e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc05fb70 con 0x7f8cfc12c690 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 0x7f8cfc0886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient: get_auth_request con 0x7f8cfc12c690 auth_method 0 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 1 -- 10.20.193.7:0/3605061069 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8cfc12ca90 con 0x7f8cfc12c690 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d00faf640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 0x7f8cfc0886e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8cec016000 tx=0x7f8cec003850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec018040 con 0x7f8cfc12c690 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 10 monclient: dump: 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5047 (secure 0 0 0) 0x7f8cec014de0 con 0x7f8cfc12c690 2026-02-22T20:52:18.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 msgr2=0x7f8cfc0886e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 0x7f8cfc0886e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8cec016000 tx=0x7f8cec003850 comp rx=0 tx=0).stop 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 msgr2=0x7f8cfc0886e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8cf17fa640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8cfc12c690 0x7f8cfc0886e0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8cec016000 tx=0x7f8cec003850 comp rx=0 tx=0).stop 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 4, 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 17787, 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:18.710 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 17, 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:18.711 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:18.712 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:18.713 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.714 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.715 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.717 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:18.718 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:18.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ccc03ab20 msgr2=0x7f8ccc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3605061069 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ccc03ab20 0x7f8ccc05afd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4002410 tx=0x7f8ce40a6000 comp rx=0 tx=0).stop 2026-02-22T20:52:18.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 10 monclient: shutdown 2026-02-22T20:52:18.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 msgr2=0x7f8cfc128cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 --2- 10.20.193.7:0/3605061069 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8cfc180d00 0x7f8cfc128cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800bdf0 tx=0x7f8cf800bee0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d017b0640 1 -- 10.20.193.7:0/3605061069 reap_dead start 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d017b0640 1 -- 10.20.193.7:0/3605061069 reap_dead start 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 shutdown_connections 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 >> 10.20.193.7:0/3605061069 conn(0x7f8cfc093df0 msgr2=0x7f8cfc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 shutdown_connections 2026-02-22T20:52:18.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.697+0000 7f8d0323a640 1 -- 10.20.193.7:0/3605061069 wait complete. 2026-02-22T20:52:18.720 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:18.720 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-22T20:52:18.720 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:52:18.720 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-22T20:52:18.720 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-22T20:52:18.721 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T20:52:18.721 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:52:18.730 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:52:18.730 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:52:18.730 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:52:18.730 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:52:18.731 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.732 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.733 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T20:52:18.733 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:52:18.733 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:18.736 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:52:18.736 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:52:18.736 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:52:18.736 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:52:18.737 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:52:18.738 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:52:18.739 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:52:18.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: get_monmap_and_config 2026-02-22T20:52:18.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: monmap: 2026-02-22T20:52:18.807 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.807 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:18.806772+0000 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:18.806772+0000 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 Processor -- start 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 -- start start 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: init 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff32c13cef0 0x7ff32c13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-a con 0x7ff32c13cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:18.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff32c13d800 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 0x7ff32c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-c con 0x7ff32c13a2e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c05d510 con 0x7ff32c13d800 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c08b800 con 0x7ff32c13cef0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c08a720 con 0x7ff32c13a2e0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff33167e640 10 monclient(hunting): authenticate will time out at 551.279713s 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff32c13cef0 0x7ff32c13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32b7fe640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 msgr2=0x7ff32c19f480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32a7fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff32c13d800 0x7ff32c139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:43666/0 (socket says 10.20.193.7:43666) 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32a7fc640 1 -- 10.20.193.7:0/1309780128 learned_addr learned my addr 10.20.193.7:0/1309780128 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32b7fe640 1 --2- 10.20.193.7:0/1309780128 >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 0x7ff32c19f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): get_auth_request con 0x7ff32c13cef0 auth_method 0 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.801+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): handle_auth_done global_id 4515 payload 274 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/1309780128 >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 msgr2=0x7ff32c19f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- 10.20.193.7:0/1309780128 >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 0x7ff32c19f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/1309780128 >> v1:10.20.193.7:6789/0 conn(0x7ff32c13d800 legacy=0x7ff32c139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 monclient: found mon.noname-a 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/1309780128 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c08aa00 con 0x7ff32c13cef0 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- 10.20.193.7:0/1309780128 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13cef0 0x7ff32c13d2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff320004780 tx=0x7ff32001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b567d62692a6623 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 1 -- 10.20.193.7:0/1309780128 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200b0070 con 0x7ff32c13cef0 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: dump: 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.814 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 1 -- 10.20.193.7:0/1309780128 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200ab600 con 0x7ff32c13cef0 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 1 -- 10.20.193.7:0/1309780128 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200ab9d0 con 0x7ff32c13cef0 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 5 monclient: authenticate success, global_id 4515 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 4 set_mon_vals no callback set 2026-02-22T20:52:18.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff329ffb640 10 monclient: dump: 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: shutdown 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/1309780128 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13cef0 msgr2=0x7ff32c13d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- 10.20.193.7:0/1309780128 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13cef0 0x7ff32c13d2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff320004780 tx=0x7ff32001c420 comp rx=0 tx=0).stop 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/1309780128 shutdown_connections 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- 10.20.193.7:0/1309780128 >> v2:10.20.193.61:3300/0 conn(0x7ff32c13a2e0 0x7ff32c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- 10.20.193.7:0/1309780128 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13cef0 0x7ff32c13d2c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/1309780128 >> 10.20.193.7:0/1309780128 conn(0x7ff32c08f860 msgr2=0x7ff32c08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/1309780128 shutdown_connections 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/1309780128 wait complete. 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: build_initial_monmap 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: monmap: 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:18.817 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 Processor -- start 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- start start 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: init 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-a con 0x7ff32c13a2e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13cef0 0x7ff32c19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-c con 0x7ff32c13cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 0x7ff32c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): picked mon.noname-b con 0x7ff32c13d800 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1a2360 con 0x7ff32c13a2e0 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1a21e0 con 0x7ff32c13d800 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c1a24e0 con 0x7ff32c13cef0 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient(hunting): authenticate will time out at 551.283250s 2026-02-22T20:52:18.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32b7fe640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 msgr2=0x7ff32c19e9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57400/0 (socket says 10.20.193.7:57400) 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/666650474 learned_addr learned my addr 10.20.193.7:0/666650474 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): get_auth_request con 0x7ff32c13a2e0 auth_method 0 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32b7fe640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 0x7ff32c19e9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13cef0 0x7ff32c19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): get_auth_request con 0x7ff32c13cef0 auth_method 0 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:18.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient(hunting): handle_auth_done global_id 4521 payload 824 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13cef0 msgr2=0x7ff32c19e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13cef0 0x7ff32c19e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/666650474 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 msgr2=0x7ff32c19e9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 0x7ff32c19e9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 monclient: found mon.noname-a 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 -- 10.20.193.7:0/666650474 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c05d0b0 con 0x7ff32c13a2e0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff32affd640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff32001c990 tx=0x7ff3200191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200b0040 con 0x7ff32c13a2e0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: dump: 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.820 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200b9070 con 0x7ff32c13a2e0 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200abbb0 con 0x7ff32c13a2e0 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff30b7fe640 10 monclient: dump: 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:18.821 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff3297fa640 4 set_mon_vals no callback set 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 5 monclient: authenticate success, global_id 4521 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _renew_subs 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c086620 con 0x7ff32c13a2e0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _renew_subs 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.805+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c12ac50 con 0x7ff32c13a2e0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff33167e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff33167e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff33167e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32c13d2c0 con 0x7ff32c13a2e0 2026-02-22T20:52:18.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff320003710 con 0x7ff32c13a2e0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 1 --2- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 0x7ff2f805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7ff3200e87d0 con 0x7ff32c13a2e0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff32a7fc640 1 --2- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 0x7ff2f805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff32a7fc640 10 monclient: get_auth_request con 0x7ff2f803aa90 auth_method 0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff32a7fc640 1 --2- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 0x7ff2f805af40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0578b0 tx=0x7ff314009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7ff320016130 con 0x7ff32c13a2e0 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:18.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.809+0000 7ff30b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:18.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:18.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:18.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:18.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff32c1288f0 con 0x7ff32c13a2e0 2026-02-22T20:52:18.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff30b7fe640 1 -- 10.20.193.7:0/666650474 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7ff3200a5e20 con 0x7ff32c13a2e0 2026-02-22T20:52:18.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff30b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:18.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff30b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:18.928 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:18.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 msgr2=0x7ff2f805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 0x7ff2f805af40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0578b0 tx=0x7ff314009040 comp rx=0 tx=0).stop 2026-02-22T20:52:18.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 10 monclient: shutdown 2026-02-22T20:52:18.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:18.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 msgr2=0x7ff32c139770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:18.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff32001c990 tx=0x7ff3200191c0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 shutdown_connections 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2f803aa90 0x7ff2f805af40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13d800 0x7ff32c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13cef0 0x7ff32c19e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 --2- 10.20.193.7:0/666650474 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c13a2e0 0x7ff32c139770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 >> 10.20.193.7:0/666650474 conn(0x7ff32c08f860 msgr2=0x7ff32c13b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:18.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 shutdown_connections 2026-02-22T20:52:18.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:18.921+0000 7ff33167e640 1 -- 10.20.193.7:0/666650474 wait complete. 2026-02-22T20:52:21.937 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:21.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:21.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: get_monmap_and_config 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: build_initial_monmap 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: monmap: 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:22.002312+0000 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:22.002312+0000 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:22.001 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:22.002 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:22.002 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:22.002 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 Processor -- start 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 -- start start 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: init 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fcf60092c20 0x7fcf6013f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-c con 0x7fcf60092c20 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcf6013f7d0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcf6013fc30 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:22.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6013cd90 con 0x7fcf6013fc30 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf60056c10 con 0x7fcf6013f7d0 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fcf60140070 con 0x7fcf60092c20 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf65980640 10 monclient(hunting): authenticate will time out at 554.475436s 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf6497e640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fcf60092c20 msgr2=0x7fcf6013f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf57fff640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fcf6013f7d0 legacy=0x7fcf6013bf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf6497e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fcf60092c20 0x7fcf6013f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf6517f640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fcf6013fc30 0x7fcf6013c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:43670/0 (socket says 10.20.193.7:43670) 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf6517f640 1 -- 10.20.193.7:0/3604464643 learned_addr learned my addr 10.20.193.7:0/3604464643 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:22.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245142670 0 0) 0x7fcf6013cd90 con 0x7fcf6013fc30 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient(hunting): _negotiate 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient(hunting): my global_id is 4524 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf4c003620 con 0x7fcf6013fc30 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1227088781 0 0) 0x7fcf4c003620 con 0x7fcf6013fc30 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 >> v2:10.20.193.61:3300/0 conn(0x7fcf60092c20 msgr2=0x7fcf6013f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 --2- 10.20.193.7:0/3604464643 >> v2:10.20.193.61:3300/0 conn(0x7fcf60092c20 0x7fcf6013f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 >> v1:10.20.193.61:6789/0 conn(0x7fcf6013f7d0 legacy=0x7fcf6013bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:52:22.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf600919a0 con 0x7fcf6013fc30 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fcf5c0031e0 con 0x7fcf6013fc30 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: dump: 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:22.017 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:21.997+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 >> v1:10.20.193.7:6789/0 conn(0x7fcf6013fc30 legacy=0x7fcf6013c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:22.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf4c003ab0 0x7fcf4c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): picked mon.b con 0x7fcf4c003ab0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf4c004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): picked mon.a con 0x7fcf4c0048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf4c005480 0x7fcf4c065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): picked mon.c con 0x7fcf4c005480 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60140070 con 0x7fcf4c0048d0 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0663b0 con 0x7fcf4c003ab0 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c0665b0 con 0x7fcf4c005480 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf4c004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 -- 10.20.193.7:0/3604464643 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf4c003ab0 msgr2=0x7fcf4c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): get_auth_request con 0x7fcf4c0048d0 auth_method 0 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf4c003ab0 0x7fcf4c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf4c005480 0x7fcf4c065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:22.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): get_auth_request con 0x7fcf4c005480 auth_method 0 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient(hunting): handle_auth_done global_id 4524 payload 293 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 -- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf4c005480 msgr2=0x7fcf4c065ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf4c005480 0x7fcf4c065ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 -- 10.20.193.7:0/3604464643 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf4c003ab0 msgr2=0x7fcf4c003ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf4c003ab0 0x7fcf4c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 monclient: found mon.a 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 -- 10.20.193.7:0/3604464643 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c003620 con 0x7fcf4c0048d0 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient: _finish_auth 0 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 5 monclient: authenticate success, global_id 4524 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 1 -- 10.20.193.7:0/3604464643 reap_dead start 2026-02-22T20:52:22.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf4c004d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009da0 tx=0x7fcf4801cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47c79c47e4e1a56 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480099a0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: dump: 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:22.023 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf480a9070 con 0x7fcf4c0048d0 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 1 -- 10.20.193.7:0/3604464643 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480a5700 con 0x7fcf4c0048d0 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 4 set_mon_vals no callback set 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf577fe640 10 monclient: dump: 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.024 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: shutdown 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 msgr2=0x7fcf4c004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf4c004d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009da0 tx=0x7fcf4801cb10 comp rx=0 tx=0).stop 2026-02-22T20:52:22.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/3604464643 shutdown_connections 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 --2- 10.20.193.7:0/3604464643 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf4c004d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/3604464643 >> 10.20.193.7:0/3604464643 conn(0x7fcf600906f0 msgr2=0x7fcf60090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/3604464643 shutdown_connections 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/3604464643 wait complete. 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: build_initial_monmap 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: monmap: 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:22.026 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 Processor -- start 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- start start 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: init 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-a con 0x7fcf4c0048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:22.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 0x7fcf60123980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-b con 0x7fcf60125560 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf60113370 0x7fcf601137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): picked mon.noname-c con 0x7fcf60113370 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6013c900 con 0x7fcf4c0048d0 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6013c780 con 0x7fcf60125560 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6013ca80 con 0x7fcf60113370 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient(hunting): authenticate will time out at 554.479371s 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:22.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 msgr2=0x7fcf60123980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57426/0 (socket says 10.20.193.7:57426) 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 -- 10.20.193.7:0/1819684339 learned_addr learned my addr 10.20.193.7:0/1819684339 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): get_auth_request con 0x7fcf4c0048d0 auth_method 0 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf57fff640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 0x7fcf60123980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf60113370 0x7fcf601137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): get_auth_request con 0x7fcf60113370 auth_method 0 2026-02-22T20:52:22.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6517f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 -- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf60113370 msgr2=0x7fcf601137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf60113370 0x7fcf601137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 -- 10.20.193.7:0/1819684339 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 msgr2=0x7fcf60123980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 0x7fcf60123980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient: _finish_hunting 0 2026-02-22T20:52:22.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 monclient: found mon.noname-a 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 -- 10.20.193.7:0/1819684339 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf60126a80 con 0x7fcf4c0048d0 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf6497e640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000b780 tx=0x7fcf5000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50005070 con 0x7fcf4c0048d0 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: dump: 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.031 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf50010070 con 0x7fcf4c0048d0 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50005410 con 0x7fcf4c0048d0 2026-02-22T20:52:22.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf557fa640 10 monclient: dump: 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:22.033 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf56ffd640 4 set_mon_vals no callback set 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 5 monclient: authenticate success, global_id 4527 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _renew_subs 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6008a9e0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _renew_subs 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.001+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf60124a00 con 0x7fcf4c0048d0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf65980640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf65980640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf65980640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf60142840 con 0x7fcf4c0048d0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fcf500055b0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 1 --2- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 0x7fcf3005aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7fcf5004e1c0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf57fff640 1 --2- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 0x7fcf3005aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf57fff640 10 monclient: get_auth_request con 0x7fcf3003aa30 auth_method 0 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf57fff640 1 --2- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 0x7fcf3005aee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801c940 tx=0x7fcf48005b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fcf500143d0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:22.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.005+0000 7fcf557fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcf6005faa0 con 0x7fcf4c0048d0 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf557fa640 1 -- 10.20.193.7:0/1819684339 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fcf50008b10 con 0x7fcf4c0048d0 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf557fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf557fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:22.120 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 msgr2=0x7fcf3005aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 0x7fcf3005aee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801c940 tx=0x7fcf48005b40 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 10 monclient: shutdown 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 msgr2=0x7fcf60123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000b780 tx=0x7fcf5000bc40 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 shutdown_connections 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcf60113370 0x7fcf601137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf3003aa30 0x7fcf3005aee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcf60125560 0x7fcf60123980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 --2- 10.20.193.7:0/1819684339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcf4c0048d0 0x7fcf60123440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 >> 10.20.193.7:0/1819684339 conn(0x7fcf600906f0 msgr2=0x7fcf6008e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:22.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 shutdown_connections 2026-02-22T20:52:22.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:22.117+0000 7fcf65980640 1 -- 10.20.193.7:0/1819684339 wait complete. 2026-02-22T20:52:25.131 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: get_monmap_and_config 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: build_initial_monmap 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: monmap: 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:25.201967+0000 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:25.201967+0000 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:25.201 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:25.202 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:25.202 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:25.202 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 Processor -- start 2026-02-22T20:52:25.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 -- start start 2026-02-22T20:52:25.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: init 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0d9813f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-b con 0x7f0d9813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0d98180d00 0x7f0d981a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-a con 0x7f0d98180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9808fd70 con 0x7f0d9813f290 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9808e1f0 con 0x7f0d98180d00 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9808ec90 con 0x7f0d9813fd70 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d9cb2c640 10 monclient(hunting): authenticate will time out at 557.674998s 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f0d9813f290 0x7f0d9813f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:43678/0 (socket says 10.20.193.7:43678) 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96575640 1 -- 10.20.193.7:0/300426082 learned_addr learned my addr 10.20.193.7:0/300426082 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 --2- 10.20.193.7:0/300426082 >> v2:10.20.193.7:3300/0 conn(0x7f0d98180d00 0x7f0d981a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:25.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): get_auth_request con 0x7f0d98180d00 auth_method 0 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): get_auth_request con 0x7f0d9813fd70 auth_method 0 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient(hunting): handle_auth_done global_id 4530 payload 274 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 -- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 msgr2=0x7f0d981807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 -- 10.20.193.7:0/300426082 >> v1:10.20.193.7:6789/0 conn(0x7f0d9813f290 legacy=0x7f0d9813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:25.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:25.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 monclient: found mon.noname-a 2026-02-22T20:52:25.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:25.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:25.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d96d76640 1 -- 10.20.193.7:0/300426082 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d98092bc0 con 0x7f0d98180d00 2026-02-22T20:52:25.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.197+0000 7f0d95d74640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d981a10e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d9808e370 tx=0x7f0d8801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747769f945c10e55 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 1 -- 10.20.193.7:0/300426082 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880b2070 con 0x7f0d98180d00 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: dump: 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:25.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: _finish_auth 0 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 1 -- 10.20.193.7:0/300426082 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d880a58a0 con 0x7f0d98180d00 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 1 -- 10.20.193.7:0/300426082 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880a5c90 con 0x7f0d98180d00 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95573640 10 monclient: dump: 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 5 monclient: authenticate success, global_id 4530 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 4 set_mon_vals no callback set 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: shutdown 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 msgr2=0x7f0d981a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d981a10e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d9808e370 tx=0x7f0d8801c7e0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/300426082 shutdown_connections 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d981a10e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/300426082 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/300426082 >> 10.20.193.7:0/300426082 conn(0x7f0d98093df0 msgr2=0x7f0d980902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/300426082 shutdown_connections 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/300426082 wait complete. 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: build_initial_monmap 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: monmap: 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:25.211 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 Processor -- start 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- start start 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: init 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-c con 0x7f0d9813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-b con 0x7f0d9813fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d9812bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): picked mon.noname-a con 0x7f0d98180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981a4050 con 0x7f0d98180d00 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98090dd0 con 0x7f0d9813fd70 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d981a41d0 con 0x7f0d9813f290 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient(hunting): authenticate will time out at 557.679267s 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:25.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:58414/0 (socket says 10.20.193.7:58414) 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 -- 10.20.193.7:0/3618410254 learned_addr learned my addr 10.20.193.7:0/3618410254 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): get_auth_request con 0x7f0d9813f290 auth_method 0 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95d74640 1 -- 10.20.193.7:0/3618410254 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 msgr2=0x7f0d981807c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d95d74640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d9812bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): get_auth_request con 0x7f0d98180d00 auth_method 0 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient(hunting): handle_auth_done global_id 4430 payload 824 2026-02-22T20:52:25.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 -- 10.20.193.7:0/3618410254 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 msgr2=0x7f0d981807c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 -- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 msgr2=0x7f0d9812bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d9812bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 monclient: found mon.noname-c 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 -- 10.20.193.7:0/3618410254 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9810c760 con 0x7f0d9813f290 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d96575640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c730 tx=0x7f0d8c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c017070 con 0x7f0d9813f290 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: dump: 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:25.214 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: _finish_auth 0 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c005bd0 con 0x7f0d9813f290 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c007070 con 0x7f0d9813f290 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 5 monclient: authenticate success, global_id 4430 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _renew_subs 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9812cc10 con 0x7f0d9813f290 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d94d72640 4 set_mon_vals no callback set 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d7effd640 10 monclient: dump: 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:25.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _renew_subs 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.201+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9812c210 con 0x7f0d9813f290 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d9cb2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d9cb2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d9cb2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9813f660 con 0x7f0d9813f290 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0d8c007210 con 0x7f0d9813f290 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d7effd640 1 --2- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 0x7f0d6405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3925+0+0 (secure 0 0 0) 0x7f0d8c04df70 con 0x7f0d9813f290 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d95d74640 1 --2- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 0x7f0d6405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d95d74640 10 monclient: get_auth_request con 0x7f0d6403aa90 auth_method 0 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.205+0000 7f0d95d74640 1 --2- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 0x7f0d6405af40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0d9810bc40 tx=0x7f0d80009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.209+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f0d9808fd70 con 0x7f0d9813f290 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.209+0000 7f0d7effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:25.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.209+0000 7f0d7effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:25.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:25.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:25.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:25.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d9810c030 con 0x7f0d9813f290 2026-02-22T20:52:25.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d7effd640 1 -- 10.20.193.7:0/3618410254 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f0d8c008ce0 con 0x7f0d9813f290 2026-02-22T20:52:25.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d7effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:25.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d7effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:25.323 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:25.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 msgr2=0x7f0d6405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 0x7f0d6405af40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0d9810bc40 tx=0x7f0d80009290 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 10 monclient: shutdown 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 msgr2=0x7f0d9812c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c730 tx=0x7f0d8c00cbf0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 shutdown_connections 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d98180d00 0x7f0d9812bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d6403aa90 0x7f0d6405af40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d9813fd70 0x7f0d981807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 --2- 10.20.193.7:0/3618410254 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d9813f290 0x7f0d9812c6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:25.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.317+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 >> 10.20.193.7:0/3618410254 conn(0x7f0d98093df0 msgr2=0x7f0d98055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:25.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.321+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 shutdown_connections 2026-02-22T20:52:25.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:25.321+0000 7f0d9cb2c640 1 -- 10.20.193.7:0/3618410254 wait complete. 2026-02-22T20:52:26.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:26.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:28.333 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:28.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: get_monmap_and_config 2026-02-22T20:52:28.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: build_initial_monmap 2026-02-22T20:52:28.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: monmap: 2026-02-22T20:52:28.402 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:28.402 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:28.402 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:28.402297+0000 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:28.402297+0000 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 Processor -- start 2026-02-22T20:52:28.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 -- start start 2026-02-22T20:52:28.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: init 2026-02-22T20:52:28.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:28.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f095013be70 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-c con 0x7f095013c950 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-a con 0x7f095017d950 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09500875d0 con 0x7f095013be70 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f09500878b0 con 0x7f095017d950 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f095008b780 con 0x7f095013c950 2026-02-22T20:52:28.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0956e79640 10 monclient(hunting): authenticate will time out at 560.875452s 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0947fff640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 msgr2=0x7f095017d410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0947fff640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0954bee640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f095013be70 0x7f095013c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:43688/0 (socket says 10.20.193.7:43688) 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 learned_addr learned my addr 10.20.193.7:0/2241797785 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f095017d950 auth_method 0 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:52:28.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:28.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:28.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.397+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:28.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 msgr2=0x7f095017d410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f0947fff640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f095017d950 auth_method 0 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:28.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:28.601+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 msgr2=0x7f095017d410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f0947fff640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f095017d950 auth_method 0 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:29.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:29.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:52:29.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:29.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:29.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.005+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:52:29.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 msgr2=0x7f095017d410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:29.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f0947fff640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:52:29.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f095017d950 auth_method 0 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:29.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:29.809+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): tick 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 monclient(hunting): continuing hunt 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 msgr2=0x7f095017d410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:31.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f095013c950 0x7f095017d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 msgr2=0x7f095019dd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f095017d950 0x7f095019dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.7:6789/0 conn(0x7f095013be70 legacy=0x7f095013c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient: _add_conns ranks=[2,1] 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): picked mon.noname-b con 0x7f0934003790 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0934024260 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09500872f0 con 0x7f0934024260 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f095008b780 con 0x7f0934003790 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f09467fc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934024260 legacy=0x7f09340446f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 10 monclient(hunting): get_auth_request con 0x7f0934003790 auth_method 0 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:31.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.401+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 10 monclient(hunting): get_auth_request con 0x7f0934003790 auth_method 0 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:31.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:52:31.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:31.605+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934024260 legacy=0x7f09340446f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:52:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:52:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:52:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:52:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:52:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 10 monclient(hunting): get_auth_request con 0x7f0934003790 auth_method 0 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:52:32.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.009+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934024260 legacy=0x7f09340446f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 10 monclient(hunting): get_auth_request con 0x7f0934003790 auth_method 0 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:32.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:52:32.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:52:32.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:32.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:52:32.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:32.813+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934024260 legacy=0x7f09340446f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:34.346 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: starting. 2026-02-22T20:52:34.346 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18569 2026-02-22T20:52:34.346 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: created object 0... 2026-02-22T20:52:34.347 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: created object 25... 2026-02-22T20:52:34.347 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: created object 49... 2026-02-22T20:52:34.347 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: finishing. 2026-02-22T20:52:34.347 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18570]: shutting down. 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): tick 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 monclient(hunting): continuing hunt 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934003790 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934024260 legacy=0x7f09340446f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 reap_dead start 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 0x7f0934023bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): picked mon.noname-c con 0x7f0934045f60 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0934046430 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f0934046980 0x7f09340674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): picked mon.noname-a con 0x7f0934046980 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09340470a0 con 0x7f0934046430 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f095008b780 con 0x7f0934046980 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 1 -- 10.20.193.7:0/2241797785 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f0934068b20 con 0x7f0934045f60 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09467fc640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f0947fff640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934046430 legacy=0x7f0934044640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f0954bee640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f0954bee640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.7:3300/0 conn(0x7f0934046980 0x7f09340674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f0934046980 auth_method 0 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.397+0000 7f09553ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient(hunting): handle_auth_done global_id 4536 payload 274 2026-02-22T20:52:34.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 msgr2=0x7f0934023bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 0x7f0934023bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 >> v1:10.20.193.61:6789/0 conn(0x7f0934046430 legacy=0x7f0934044640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 monclient: found mon.noname-a 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 -- 10.20.193.7:0/2241797785 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500872f0 con 0x7f0934046980 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09553ef640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f09340674e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f095008af70 tx=0x7f094c01d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d947c6088a6395 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 1 -- 10.20.193.7:0/2241797785 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c0a6490 con 0x7f0934046980 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: dump: 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 1 -- 10.20.193.7:0/2241797785 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094c0b0070 con 0x7f0934046980 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 1 -- 10.20.193.7:0/2241797785 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c0a6870 con 0x7f0934046980 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 5 monclient: authenticate success, global_id 4536 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 4 set_mon_vals no callback set 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f09477fe640 10 monclient: dump: 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.405 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 10 monclient: shutdown 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 msgr2=0x7f09340674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f09340674e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f095008af70 tx=0x7f094c01d220 comp rx=0 tx=0).stop 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- 10.20.193.7:0/2241797785 shutdown_connections 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 --2- 10.20.193.7:0/2241797785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f09340674e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 --2- 10.20.193.7:0/2241797785 >> v2:10.20.193.61:3300/0 conn(0x7f0934045f60 0x7f0934023bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- 10.20.193.7:0/2241797785 >> 10.20.193.7:0/2241797785 conn(0x7f095008f860 msgr2=0x7f095008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- 10.20.193.7:0/2241797785 shutdown_connections 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- 10.20.193.7:0/2241797785 wait complete. 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 10 monclient: build_initial_monmap 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 10 monclient: monmap: 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:34.406 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 Processor -- start 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 1 -- start start 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.401+0000 7f0956e79640 10 monclient: init 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 0x7f09501265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-b con 0x7f0934045f60 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-c con 0x7f0934046430 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:34.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f0950123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): picked mon.noname-a con 0x7f0934046980 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09501393d0 con 0x7f0934046980 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0950086b40 con 0x7f0934045f60 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0950139550 con 0x7f0934046430 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient(hunting): authenticate will time out at 566.880263s 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0954bee640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 msgr2=0x7f09501265d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0954bee640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 0x7f09501265d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f0950123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50858/0 (socket says 10.20.193.7:50858) 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 -- 10.20.193.7:0/112876728 learned_addr learned my addr 10.20.193.7:0/112876728 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): get_auth_request con 0x7f0934046430 auth_method 0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): get_auth_request con 0x7f0934046980 auth_method 0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient(hunting): handle_auth_done global_id 4433 payload 824 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 -- 10.20.193.7:0/112876728 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 msgr2=0x7f09501265d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 0x7f09501265d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 -- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 msgr2=0x7f0950123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f0950123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 monclient: found mon.noname-c 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 -- 10.20.193.7:0/112876728 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0950088e70 con 0x7f0934046430 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09553ef640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f0950123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0947fff640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0938007210 tx=0x7f093800cd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093800a930 con 0x7f0934046430 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: dump: 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0938015020 con 0x7f0934046430 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093800acf0 con 0x7f0934046430 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 10 monclient: dump: 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0946ffd640 4 set_mon_vals no callback set 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 5 monclient: authenticate success, global_id 4433 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _renew_subs 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095005c510 con 0x7f0934046430 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _renew_subs 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0950107eb0 con 0x7f0934046430 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0938010440 con 0x7f0934046430 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 --2- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 0x7f092005af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09501398e0 con 0x7f0934046430 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3925+0+0 (secure 0 0 0) 0x7f093804f230 con 0x7f0934046430 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0954bee640 1 --2- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 0x7f092005af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0954bee640 10 monclient: get_auth_request con 0x7f092003aa90 auth_method 0 2026-02-22T20:52:34.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.405+0000 7f0954bee640 1 --2- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 0x7f092005af40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0940002410 tx=0x7f0940009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.409+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f093801f020 con 0x7f0934046430 2026-02-22T20:52:34.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.409+0000 7f09457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.409+0000 7f09457fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0950106af0 con 0x7f0934046430 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f09457fa640 1 -- 10.20.193.7:0/112876728 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (secure 0 0 0) 0x7f0938005160 con 0x7f0934046430 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f09457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:34.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f09457fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:34.526 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 msgr2=0x7f092005af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 0x7f092005af40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0940002410 tx=0x7f0940009040 comp rx=0 tx=0).stop 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 10 monclient: shutdown 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 msgr2=0x7f095017d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0938007210 tx=0x7f093800cd40 comp rx=0 tx=0).stop 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 shutdown_connections 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0934046980 0x7f0950123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0934046430 0x7f095017d410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> v2:10.20.193.61:6800/2336688312 conn(0x7f092003aa90 0x7f092005af40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 --2- 10.20.193.7:0/112876728 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0934045f60 0x7f09501265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 >> 10.20.193.7:0/112876728 conn(0x7f095008f860 msgr2=0x7f0950089d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 shutdown_connections 2026-02-22T20:52:34.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.521+0000 7f0956e79640 1 -- 10.20.193.7:0/112876728 wait complete. 2026-02-22T20:52:34.536 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:52:34.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:52:34.537 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 10 monclient: get_monmap_and_config 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 10 monclient: build_initial_monmap 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 10 monclient: monmap: 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:34.611096+0000 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:34.611096+0000 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:34.610 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 1 Processor -- start 2026-02-22T20:52:34.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 1 -- start start 2026-02-22T20:52:34.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.605+0000 7fe6acc50640 10 monclient: init 2026-02-22T20:52:34.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:34.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 0x7fe6a813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-c con 0x7fe6a813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe6a813fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-b con 0x7fe6a813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a808fd70 con 0x7fe6a813fba0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a808e1f0 con 0x7fe6a813f290 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a808ec90 con 0x7fe6a813c680 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient(hunting): authenticate will time out at 567.084108s 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6575640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 msgr2=0x7fe6a813f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5d74640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fe6a813fba0 legacy=0x7fe6a813bf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6575640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 0x7fe6a813f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50866/0 (socket says 10.20.193.7:50866) 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 -- 10.20.193.7:0/2650603255 learned_addr learned my addr 10.20.193.7:0/2650603255 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): get_auth_request con 0x7fe6a813c680 auth_method 0 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_done global_id 4436 payload 274 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 -- 10.20.193.7:0/2650603255 >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 msgr2=0x7fe6a813f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 --2- 10.20.193.7:0/2650603255 >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 0x7fe6a813f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 -- 10.20.193.7:0/2650603255 >> v1:10.20.193.61:6789/0 conn(0x7fe6a813fba0 legacy=0x7fe6a813bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 monclient: found mon.noname-b 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 -- 10.20.193.7:0/2650603255 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a8092bc0 con 0x7fe6a813c680 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a6d76640 1 --2- 10.20.193.7:0/2650603255 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe698009580 tx=0x7fe69801c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c8469496062d8b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 1 -- 10.20.193.7:0/2650603255 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6980ac070 con 0x7fe6a813c680 2026-02-22T20:52:34.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: dump: 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 1 -- 10.20.193.7:0/2650603255 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6980a6690 con 0x7fe6a813c680 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 1 -- 10.20.193.7:0/2650603255 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6980a6a80 con 0x7fe6a813c680 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6a5573640 10 monclient: dump: 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.614 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 5 monclient: authenticate success, global_id 4436 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 4 set_mon_vals no callback set 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: shutdown 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- 10.20.193.7:0/2650603255 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 msgr2=0x7fe6a81a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 --2- 10.20.193.7:0/2650603255 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe698009580 tx=0x7fe69801c730 comp rx=0 tx=0).stop 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- 10.20.193.7:0/2650603255 shutdown_connections 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 --2- 10.20.193.7:0/2650603255 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a81a17e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 --2- 10.20.193.7:0/2650603255 >> v2:10.20.193.61:3300/0 conn(0x7fe6a813f290 0x7fe6a813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- 10.20.193.7:0/2650603255 >> 10.20.193.7:0/2650603255 conn(0x7fe6a8093df0 msgr2=0x7fe6a80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- 10.20.193.7:0/2650603255 shutdown_connections 2026-02-22T20:52:34.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- 10.20.193.7:0/2650603255 wait complete. 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: build_initial_monmap 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: monmap: 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 Processor -- start 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 1 -- start start 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.609+0000 7fe6acc50640 10 monclient: init 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a8150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-c con 0x7fe6a813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe6a813f290 0x7fe6a8151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-b con 0x7fe6a813f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a813fba0 0x7fe6a812a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): picked mon.noname-a con 0x7fe6a813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81a46c0 con 0x7fe6a813fba0 2026-02-22T20:52:34.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81a4540 con 0x7fe6a813f290 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a81a4840 con 0x7fe6a813c680 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): authenticate will time out at 567.088143s 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a8150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe6a813f290 msgr2=0x7fe6a8151040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a813fba0 0x7fe6a812a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe6a813f290 0x7fe6a8151040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a8150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50870/0 (socket says 10.20.193.7:50870) 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 -- 10.20.193.7:0/512524569 learned_addr learned my addr 10.20.193.7:0/512524569 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): get_auth_request con 0x7fe6a813c680 auth_method 0 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): get_auth_request con 0x7fe6a813fba0 auth_method 0 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient(hunting): handle_auth_done global_id 4439 payload 824 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe6a813f290 msgr2=0x7fe6a8151040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe6a813f290 0x7fe6a8151040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a813fba0 msgr2=0x7fe6a812a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a813fba0 0x7fe6a812a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 monclient: found mon.noname-c 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a813ee80 con 0x7fe6a813c680 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6575640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a8150b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b780 tx=0x7fe69c00bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c005070 con 0x7fe6a813c680 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: dump: 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c010070 con 0x7fe6a813c680 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c005410 con 0x7fe6a813c680 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 5 monclient: authenticate success, global_id 4439 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _renew_subs 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a808a9e0 con 0x7fe6a813c680 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a4d72640 4 set_mon_vals no callback set 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: dump: 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _renew_subs 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a812d540 con 0x7fe6a813c680 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 0x7fe6a812a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a813f660 con 0x7fe6a812a610 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 0x7fe6a812a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient: get_auth_request con 0x7fe6a812a610 auth_method 0 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe69c01d030 con 0x7fe6a813c680 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_done global_id 4545 payload 824 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6a812c5e0 con 0x7fe6a812a610 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 --2- 10.20.193.7:0/512524569 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe67403aa90 0x7fe67405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a5d74640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 0x7fe6a812a9e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6a813d4d0 tx=0x7fe69000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3925+0+0 (secure 0 0 0) 0x7fe69c04de90 con 0x7fe6a813c680 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690005070 con 0x7fe6a812a610 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: dump: 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.622 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 1 --2- 10.20.193.7:0/512524569 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe67403aa90 0x7fe67405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 10 monclient: get_auth_request con 0x7fe67403aa90 auth_method 0 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fe690015070 con 0x7fe6a812a610 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 msgr2=0x7fe6a812a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 0x7fe6a812a9e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6a813d4d0 tx=0x7fe69000b8e0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 msgr2=0x7fe6a812a9e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe68effd640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812a610 0x7fe6a812a9e0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6a813d4d0 tx=0x7fe69000b8e0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.613+0000 7fe6a6d76640 1 --2- 10.20.193.7:0/512524569 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe67403aa90 0x7fe67405af40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe698007270 tx=0x7fe6980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 0x7fe6a80886e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a805fb70 con 0x7fe6a812af20 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 0x7fe6a80886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient: get_auth_request con 0x7fe6a812af20 auth_method 0 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 10 monclient(hunting): handle_auth_done global_id 4548 payload 824 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 1 -- 10.20.193.7:0/512524569 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe6a813c390 con 0x7fe6a812af20 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a5d74640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 0x7fe6a80886e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c010 tx=0x7fe690005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690005760 con 0x7fe6a812af20 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:34.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 10 monclient: dump: 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5037 (secure 0 0 0) 0x7fe690005760 con 0x7fe6a812af20 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 msgr2=0x7fe6a80886e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 0x7fe6a80886e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c010 tx=0x7fe690005ad0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 msgr2=0x7fe6a80886e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe68effd640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe6a812af20 0x7fe6a80886e0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe69000c010 tx=0x7fe690005ad0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 8, 2026-02-22T20:52:34.625 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 33747, 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.626 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:34.627 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:34.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.629 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:34.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:34.631 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe67403aa90 msgr2=0x7fe67405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 --2- 10.20.193.7:0/512524569 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe67403aa90 0x7fe67405af40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe698007270 tx=0x7fe6980a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 10 monclient: shutdown 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 msgr2=0x7fe6a8150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 --2- 10.20.193.7:0/512524569 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe6a813c680 0x7fe6a8150b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b780 tx=0x7fe69c00bc40 comp rx=0 tx=0).stop 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a6d76640 1 -- 10.20.193.7:0/512524569 reap_dead start 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6a6d76640 1 -- 10.20.193.7:0/512524569 reap_dead start 2026-02-22T20:52:34.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 shutdown_connections 2026-02-22T20:52:34.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 >> 10.20.193.7:0/512524569 conn(0x7fe6a8093df0 msgr2=0x7fe6a8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 shutdown_connections 2026-02-22T20:52:34.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.617+0000 7fe6acc50640 1 -- 10.20.193.7:0/512524569 wait complete. 2026-02-22T20:52:34.633 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:52:34.633 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:52:34.633 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.697+0000 7fc44e5e6640 10 monclient: get_monmap_and_config 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.697+0000 7fc44e5e6640 10 monclient: build_initial_monmap 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.697+0000 7fc44e5e6640 10 monclient: monmap: 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:34.703339+0000 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:34.703339+0000 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.697+0000 7fc44e5e6640 1 Processor -- start 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- start start 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: init 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-b con 0x7fc44813d8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 0x7fc448038f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-c con 0x7fc44813a460 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc448039460 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc448086ea0 con 0x7fc448039460 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc44808e3e0 con 0x7fc44813a460 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc44808e6c0 con 0x7fc44813d8b0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): authenticate will time out at 567.176573s 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 msgr2=0x7fc448038f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50882/0 (socket says 10.20.193.7:50882) 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 -- 10.20.193.7:0/3556979924 learned_addr learned my addr 10.20.193.7:0/3556979924 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44cb5c640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc448039460 0x7fc44819e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:40502/0 (socket says 10.20.193.7:40502) 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 --2- 10.20.193.7:0/3556979924 >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 0x7fc448038f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): get_auth_request con 0x7fc44813d8b0 auth_method 0 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_done global_id 4442 payload 274 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 1 -- 10.20.193.7:0/3556979924 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005191943 0 0) 0x7fc448086ea0 con 0x7fc448039460 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 -- 10.20.193.7:0/3556979924 >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 msgr2=0x7fc448038f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- 10.20.193.7:0/3556979924 >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 0x7fc448038f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 -- 10.20.193.7:0/3556979924 >> v1:10.20.193.7:6789/0 conn(0x7fc448039460 legacy=0x7fc44819e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 monclient: found mon.noname-b 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 -- 10.20.193.7:0/3556979924 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44808e9a0 con 0x7fc44813d8b0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- 10.20.193.7:0/3556979924 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4340090a0 tx=0x7fc43401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1efbd924d4eb1521 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 1 -- 10.20.193.7:0/3556979924 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340a9400 con 0x7fc44813d8b0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: dump: 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 1 -- 10.20.193.7:0/3556979924 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4340a95a0 con 0x7fc44813d8b0 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 1 -- 10.20.193.7:0/3556979924 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340a9970 con 0x7fc44813d8b0 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 5 monclient: authenticate success, global_id 4442 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 4 set_mon_vals no callback set 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc446ffd640 10 monclient: dump: 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: shutdown 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3556979924 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 msgr2=0x7fc448139f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3556979924 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc4340090a0 tx=0x7fc43401c520 comp rx=0 tx=0).stop 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3556979924 shutdown_connections 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3556979924 >> v2:10.20.193.61:3300/0 conn(0x7fc44813a460 0x7fc448038f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3556979924 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44813d8b0 0x7fc448139f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3556979924 >> 10.20.193.7:0/3556979924 conn(0x7fc44808cf40 msgr2=0x7fc44808d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3556979924 shutdown_connections 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3556979924 wait complete. 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: build_initial_monmap 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: monmap: 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:34.715 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 Processor -- start 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- start start 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: init 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 0x7fc44811b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-c con 0x7fc448039460 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc44813a460 0x7fc4480878d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-a con 0x7fc44813a460 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc44813d8b0 0x7fc448087e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): picked mon.noname-b con 0x7fc44813d8b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a22e0 con 0x7fc44813a460 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481a2160 con 0x7fc44813d8b0 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc4481a2460 con 0x7fc448039460 2026-02-22T20:52:34.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44e5e6640 10 monclient(hunting): authenticate will time out at 567.179505s 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 0x7fc44811b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc44813a460 0x7fc4480878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 0x7fc44811b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50890/0 (socket says 10.20.193.7:50890) 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 -- 10.20.193.7:0/3061451931 learned_addr learned my addr 10.20.193.7:0/3061451931 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): get_auth_request con 0x7fc448039460 auth_method 0 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44cb5c640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc44813d8b0 msgr2=0x7fc448087e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): get_auth_request con 0x7fc44813a460 auth_method 0 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc44cb5c640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc44813d8b0 0x7fc448087e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient(hunting): handle_auth_done global_id 4554 payload 824 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 msgr2=0x7fc44811b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 0x7fc44811b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc44813d8b0 msgr2=0x7fc448087e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc44813d8b0 0x7fc448087e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient: _finish_hunting 0 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 monclient: found mon.noname-a 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44805d910 con 0x7fc44813a460 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc447fff640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448039460 0x7fc44811b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc4477fe640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc44813a460 0x7fc4480878d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc43800b520 tx=0x7fc43800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.701+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438005070 con 0x7fc44813a460 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:34.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: dump: 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: _finish_auth 0 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438014070 con 0x7fc44813a460 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438005410 con 0x7fc44813a460 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:34.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: dump: 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc4467fc640 4 set_mon_vals no callback set 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 5 monclient: authenticate success, global_id 4554 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 monclient: _renew_subs 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4480875c0 con 0x7fc44813a460 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 monclient: _renew_subs 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44805b990 con 0x7fc44813a460 2026-02-22T20:52:34.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 0x7fc44808ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc448088720 con 0x7fc448088350 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 0x7fc44808ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc4380055b0 con 0x7fc44813a460 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient: get_auth_request con 0x7fc448088350 auth_method 0 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 --2- 10.20.193.7:0/3061451931 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc41803aa80 0x7fc41805af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 10 monclient(hunting): handle_auth_done global_id 4448 payload 824 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4480008e0 con 0x7fc448088350 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3925+0+0 (secure 0 0 0) 0x7fc43804e210 con 0x7fc44813a460 2026-02-22T20:52:34.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc447fff640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 0x7fc44808ad40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc4340192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44cb5c640 1 --2- 10.20.193.7:0/3061451931 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc41803aa80 0x7fc41805af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44cb5c640 10 monclient: get_auth_request con 0x7fc41803aa80 auth_method 0 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340c0030 con 0x7fc448088350 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: dump: 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fc434004020 con 0x7fc448088350 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:34.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:34.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 msgr2=0x7fc44808ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 0x7fc44808ad40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc4340192c0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 msgr2=0x7fc44808ad40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:34.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc444ff9640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc448088350 0x7fc44808ad40 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc4340192c0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.705+0000 7fc44cb5c640 1 --2- 10.20.193.7:0/3061451931 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc41803aa80 0x7fc41805af30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc43c002ca0 tx=0x7fc43c002ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:34.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 0x7fc44808b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:34.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc44811bb10 con 0x7fc44808b280 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 0x7fc44808b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient: get_auth_request con 0x7fc44808b280 auth_method 0 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 10 monclient(hunting): handle_auth_done global_id 4451 payload 824 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 1 -- 10.20.193.7:0/3061451931 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc44808bbc0 con 0x7fc44808b280 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc447fff640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 0x7fc44808b680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc434009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340c0040 con 0x7fc44808b280 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 10 monclient: dump: 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:34.725 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4868 (secure 0 0 0) 0x7fc434003c60 con 0x7fc44808b280 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 msgr2=0x7fc44808b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 0x7fc44808b680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc434009300 comp rx=0 tx=0).stop 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 msgr2=0x7fc44808b680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:34.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc444ff9640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc44808b280 0x7fc44808b680 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc44813cd60 tx=0x7fc434009300 comp rx=0 tx=0).stop 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 8, 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 33835, 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.727 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.728 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:34.729 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:34.730 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:34.733 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.734 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:34.735 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:34.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc41803aa80 msgr2=0x7fc41805af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3061451931 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc41803aa80 0x7fc41805af30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc43c002ca0 tx=0x7fc43c002ef0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 10 monclient: shutdown 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc44813a460 msgr2=0x7fc4480878d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 --2- 10.20.193.7:0/3061451931 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc44813a460 0x7fc4480878d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc43800b520 tx=0x7fc43800b9e0 comp rx=0 tx=0).stop 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44cb5c640 1 -- 10.20.193.7:0/3061451931 reap_dead start 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44cb5c640 1 -- 10.20.193.7:0/3061451931 reap_dead start 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 shutdown_connections 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 >> 10.20.193.7:0/3061451931 conn(0x7fc44808cf40 msgr2=0x7fc44811f180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 shutdown_connections 2026-02-22T20:52:34.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:34.709+0000 7fc44e5e6640 1 -- 10.20.193.7:0/3061451931 wait complete. 2026-02-22T20:52:34.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:52:34.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:52:35.295 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18571]: starting. 2026-02-22T20:52:35.296 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18571]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18569 2026-02-22T20:52:35.296 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18571]: shutting down. 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: starting. 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18569 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: created object 0... 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: created object 25... 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: created object 49... 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: finishing. 2026-02-22T20:52:36.934 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18604]: shutting down. 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: starting. 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: listing objects. 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: listed object 0... 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: listed object 25... 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: saw 50 objects 2026-02-22T20:52:36.945 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18606]: shutting down. 2026-02-22T20:52:36.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:36.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:37.888 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:37.888 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18605]: starting. 2026-02-22T20:52:37.888 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18605]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18569 2026-02-22T20:52:37.888 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18605]: shutting down. 2026-02-22T20:52:37.891 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:37.891 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:37.891 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:52:37.893 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: starting. 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18656 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: created object 0... 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: created object 25... 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: created object 49... 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: finishing. 2026-02-22T20:52:39.942 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18657]: shutting down. 2026-02-22T20:52:40.896 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18658]: starting. 2026-02-22T20:52:40.897 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18658]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18656 2026-02-22T20:52:40.897 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18658]: shutting down. 2026-02-22T20:52:41.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:41.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:42.956 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:42.956 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: starting. 2026-02-22T20:52:42.956 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18656 2026-02-22T20:52:42.957 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: created object 0... 2026-02-22T20:52:42.957 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: created object 25... 2026-02-22T20:52:42.957 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: created object 49... 2026-02-22T20:52:42.957 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: finishing. 2026-02-22T20:52:42.957 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18691]: shutting down. 2026-02-22T20:52:42.967 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:42.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: starting. 2026-02-22T20:52:42.968 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: listing objects. 2026-02-22T20:52:42.968 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: listed object 0... 2026-02-22T20:52:42.968 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: listed object 25... 2026-02-22T20:52:42.968 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: saw 50 objects 2026-02-22T20:52:42.968 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18693]: shutting down. 2026-02-22T20:52:43.906 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:43.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18692]: starting. 2026-02-22T20:52:43.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18692]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18656 2026-02-22T20:52:43.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18692]: shutting down. 2026-02-22T20:52:43.909 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:43.909 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:43.909 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:52:43.912 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:52:45.962 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: starting. 2026-02-22T20:52:45.963 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18743 2026-02-22T20:52:45.963 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: created object 0... 2026-02-22T20:52:45.963 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: created object 25... 2026-02-22T20:52:45.963 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: created object 49... 2026-02-22T20:52:45.963 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: finishing. 2026-02-22T20:52:45.964 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18744]: shutting down. 2026-02-22T20:52:46.913 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18745]: starting. 2026-02-22T20:52:46.914 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18745]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18743 2026-02-22T20:52:46.914 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18745]: shutting down. 2026-02-22T20:52:46.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:46.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:48.973 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: starting. 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18743 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: created object 0... 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: created object 25... 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: created object 49... 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: finishing. 2026-02-22T20:52:48.974 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18778]: shutting down. 2026-02-22T20:52:48.983 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: starting. 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: listing objects. 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: listed object 0... 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: listed object 25... 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: saw 50 objects 2026-02-22T20:52:48.984 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18780]: shutting down. 2026-02-22T20:52:49.926 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:49.926 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18779]: starting. 2026-02-22T20:52:49.926 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18779]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18743 2026-02-22T20:52:49.926 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18779]: shutting down. 2026-02-22T20:52:49.928 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:49.928 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:49.928 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:52:49.931 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:52:51.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:51.952 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: starting. 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18830 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: created object 0... 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: created object 25... 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: created object 49... 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: finishing. 2026-02-22T20:52:51.984 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18831]: shutting down. 2026-02-22T20:52:52.938 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18832]: starting. 2026-02-22T20:52:52.938 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18832]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18830 2026-02-22T20:52:52.938 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18832]: shutting down. 2026-02-22T20:52:54.739 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-22T20:52:54.739 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T20:52:54.739 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T20:52:54.741 INFO:tasks.ceph.mon.b:Started 2026-02-22T20:52:54.742 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:52:54.742 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: get_monmap_and_config 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: build_initial_monmap 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: monmap: 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:54.817 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:54.810825+0000 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:54.810825+0000 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 Processor -- start 2026-02-22T20:52:54.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 -- start start 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: init 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f5d8808c7a0 0x7f5d88090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-a con 0x7f5d8808c7a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f5d880909a0 0x7f5d88090da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-c con 0x7f5d880909a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5d8817f6d0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8808d840 con 0x7f5d8817f6d0 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f5d880912e0 con 0x7f5d8808c7a0 2026-02-22T20:52:54.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8808db20 con 0x7f5d880909a0 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8edef640 10 monclient(hunting): authenticate will time out at 587.283708s 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f5d8808c7a0 0x7f5d88090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f5d8808c7a0 0x7f5d88090460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38286/0 (socket says 10.20.193.7:38286) 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 1 -- 10.20.193.7:0/2165768677 learned_addr learned my addr 10.20.193.7:0/2165768677 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): get_auth_request con 0x7f5d8808c7a0 auth_method 0 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d7ffff640 1 --2- 10.20.193.7:0/2165768677 >> v2:10.20.193.61:3300/0 conn(0x7f5d880909a0 0x7f5d88090da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d8cb64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d7ffff640 10 monclient(hunting): get_auth_request con 0x7f5d880909a0 auth_method 0 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.805+0000 7f5d7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient(hunting): handle_auth_done global_id 4668 payload 274 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 -- 10.20.193.7:0/2165768677 >> v2:10.20.193.61:3300/0 conn(0x7f5d880909a0 msgr2=0x7f5d88090da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/2165768677 >> v2:10.20.193.61:3300/0 conn(0x7f5d880909a0 0x7f5d88090da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 -- 10.20.193.7:0/2165768677 >> v1:10.20.193.61:6789/0 conn(0x7f5d8817f6d0 legacy=0x7f5d8819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient: _finish_hunting 0 2026-02-22T20:52:54.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 monclient: found mon.noname-a 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 -- 10.20.193.7:0/2165768677 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d880851e0 con 0x7f5d8808c7a0 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/2165768677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8808c7a0 0x7f5d88090460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d88085410 tx=0x7f5d7801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bda9450072cdd server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 1 -- 10.20.193.7:0/2165768677 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780a6040 con 0x7f5d8808c7a0 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: dump: 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.822 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 1 -- 10.20.193.7:0/2165768677 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d780af070 con 0x7f5d8808c7a0 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 1 -- 10.20.193.7:0/2165768677 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780aa860 con 0x7f5d8808c7a0 2026-02-22T20:52:54.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 5 monclient: authenticate success, global_id 4668 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 4 set_mon_vals no callback set 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7f7fe640 10 monclient: dump: 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.824 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: shutdown 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/2165768677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8808c7a0 msgr2=0x7f5d88090460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- 10.20.193.7:0/2165768677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8808c7a0 0x7f5d88090460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d88085410 tx=0x7f5d7801c4c0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/2165768677 shutdown_connections 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- 10.20.193.7:0/2165768677 >> v2:10.20.193.61:3300/0 conn(0x7f5d880909a0 0x7f5d88090da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- 10.20.193.7:0/2165768677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8808c7a0 0x7f5d88090460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/2165768677 >> 10.20.193.7:0/2165768677 conn(0x7f5d8808e050 msgr2=0x7f5d8808e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/2165768677 shutdown_connections 2026-02-22T20:52:54.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/2165768677 wait complete. 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: build_initial_monmap 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: monmap: 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:54.826 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 Processor -- start 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- start start 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: init 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-b con 0x7f5d8808c7a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-c con 0x7f5d880909a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 0x7f5d88084490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): picked mon.noname-a con 0x7f5d8817f6d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:54.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d881a3d80 con 0x7f5d8817f6d0 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5d881a3c00 con 0x7f5d8808c7a0 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5d881a3f00 con 0x7f5d880909a0 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient(hunting): authenticate will time out at 587.287155s 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 0x7f5d88084490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41496/0 (socket says 10.20.193.7:41496) 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 -- 10.20.193.7:0/3980498730 learned_addr learned my addr 10.20.193.7:0/3980498730 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 0x7f5d88084490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38296/0 (socket says 10.20.193.7:38296) 2026-02-22T20:52:54.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): get_auth_request con 0x7f5d880909a0 auth_method 0 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): get_auth_request con 0x7f5d8817f6d0 auth_method 0 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient(hunting): get_auth_request con 0x7f5d8808c7a0 auth_method 0 2026-02-22T20:52:54.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8d365640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 -- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 msgr2=0x7f5d8812dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 -- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 msgr2=0x7f5d8812dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 -- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 msgr2=0x7f5d8812dd40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:52:54.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 -- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 msgr2=0x7f5d88084490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 0x7f5d88084490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 monclient: found mon.noname-c 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 -- 10.20.193.7:0/3980498730 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8807d9d0 con 0x7f5d880909a0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7ffff640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e770 tx=0x7f5d7000ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70017070 con 0x7f5d880909a0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: dump: 2026-02-22T20:52:54.831 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:54.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7000c870 con 0x7f5d880909a0 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000f040 con 0x7f5d880909a0 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7d7fa640 10 monclient: dump: 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:54.833 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d7effd640 4 set_mon_vals no callback set 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 5 monclient: authenticate success, global_id 4538 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _renew_subs 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d88086e90 con 0x7f5d880909a0 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _renew_subs 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.809+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8807d6f0 con 0x7f5d880909a0 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8edef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8edef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:54.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8edef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8805d750 con 0x7f5d880909a0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5d70012050 con 0x7f5d880909a0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 1 --2- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 0x7f5d5805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 3897+0+0 (secure 0 0 0) 0x7f5d7004e5a0 con 0x7f5d880909a0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 0x7f5d5805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8cb64640 10 monclient: get_auth_request con 0x7f5d5803ab20 auth_method 0 2026-02-22T20:52:54.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d8cb64640 1 --2- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 0x7f5d5805afd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009690 tx=0x7f5d780a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:54.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5d7000a0d0 con 0x7f5d880909a0 2026-02-22T20:52:54.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:54.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.813+0000 7f5d7d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:54.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:54.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:54.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:54.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5d88090460 con 0x7f5d880909a0 2026-02-22T20:52:54.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d7d7fa640 1 -- 10.20.193.7:0/3980498730 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f5d7000a320 con 0x7f5d880909a0 2026-02-22T20:52:54.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d7d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:54.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d7d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:54.929 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 msgr2=0x7f5d5805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 0x7f5d5805afd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009690 tx=0x7f5d780a7000 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 10 monclient: shutdown 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 msgr2=0x7f5d88083f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e770 tx=0x7f5d7000ec30 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 shutdown_connections 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5d8817f6d0 0x7f5d88084490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5d880909a0 0x7f5d88083f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d5803ab20 0x7f5d5805afd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 --2- 10.20.193.7:0/3980498730 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5d8808c7a0 0x7f5d8812dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 >> 10.20.193.7:0/3980498730 conn(0x7f5d8808e050 msgr2=0x7f5d8808a800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 shutdown_connections 2026-02-22T20:52:54.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:54.925+0000 7f5d8edef640 1 -- 10.20.193.7:0/3980498730 wait complete. 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: starting. 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18830 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: created object 0... 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: created object 25... 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: created object 49... 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: finishing. 2026-02-22T20:52:54.996 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18865]: shutting down. 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: starting. 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: listing objects. 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: listed object 0... 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: listed object 25... 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: saw 50 objects 2026-02-22T20:52:55.008 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18867]: shutting down. 2026-02-22T20:52:55.951 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:55.951 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18866]: starting. 2026-02-22T20:52:55.951 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18866]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18830 2026-02-22T20:52:55.951 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18866]: shutting down. 2026-02-22T20:52:55.953 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:55.953 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:52:55.953 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:52:55.955 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:52:56.952 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:52:56.952 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:52:57.940 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:52:58.002 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: starting. 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18959 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: created object 0... 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: created object 25... 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: created object 49... 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: finishing. 2026-02-22T20:52:58.003 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[18960]: shutting down. 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: get_monmap_and_config 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: monmap: 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:58.005917+0000 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:58.005917+0000 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.005 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:58.006 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:58.006 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:58.006 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:58.006 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:58.006 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 Processor -- start 2026-02-22T20:52:58.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 -- start start 2026-02-22T20:52:58.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: init 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd5ec092c20 0x7fd5ec13f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-a con 0x7fd5ec092c20 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 0x7fd5ec13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-c con 0x7fd5ec13f7d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 0x7fd5ec13c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-b con 0x7fd5ec13bf70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ec056c10 con 0x7fd5ec092c20 2026-02-22T20:52:58.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ec0919a0 con 0x7fd5ec13f7d0 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec091c80 con 0x7fd5ec13bf70 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ebfff640 10 monclient(hunting): authenticate will time out at 590.478829s 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd5ec092c20 0x7fd5ec13f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 0x7fd5ec13c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd5ec092c20 0x7fd5ec13f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38304/0 (socket says 10.20.193.7:38304) 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2883559486 learned_addr learned my addr 10.20.193.7:0/2883559486 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): get_auth_request con 0x7fd5ec092c20 auth_method 0 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 0x7fd5ec13c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41500/0 (socket says 10.20.193.7:41500) 2026-02-22T20:52:58.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): get_auth_request con 0x7fd5ec13bf70 auth_method 0 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient(hunting): handle_auth_done global_id 4689 payload 274 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 msgr2=0x7fd5ec13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 0x7fd5ec13c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2883559486 >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 msgr2=0x7fd5ec13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ea7fc640 1 --2- 10.20.193.7:0/2883559486 >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 0x7fd5ec13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2883559486 >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 0x7fd5ec13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 monclient: found mon.noname-a 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2883559486 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec091f60 con 0x7fd5ec092c20 2026-02-22T20:52:58.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ea7fc640 10 monclient: get_auth_request con 0x7fd5ec13f7d0 auth_method 0 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.001+0000 7fd5ea7fc640 1 --2- 10.20.193.7:0/2883559486 >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 0x7fd5ec13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec092c20 0x7fd5ec13f290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec093720 tx=0x7fd5e001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c6110431f8ac56 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 1 -- 10.20.193.7:0/2883559486 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00b0070 con 0x7fd5ec092c20 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: dump: 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.019 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 1 -- 10.20.193.7:0/2883559486 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e00ab600 con 0x7fd5ec092c20 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 1 -- 10.20.193.7:0/2883559486 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00ab9d0 con 0x7fd5ec092c20 2026-02-22T20:52:58.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 5 monclient: authenticate success, global_id 4689 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 4 set_mon_vals no callback set 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e9ffb640 10 monclient: dump: 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.021 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: shutdown 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec092c20 msgr2=0x7fd5ec13f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec092c20 0x7fd5ec13f290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec093720 tx=0x7fd5e001c4e0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2883559486 shutdown_connections 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13bf70 0x7fd5ec13c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2883559486 >> v2:10.20.193.61:3300/0 conn(0x7fd5ec13f7d0 0x7fd5ec13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2883559486 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec092c20 0x7fd5ec13f290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2883559486 >> 10.20.193.7:0/2883559486 conn(0x7fd5ec0906f0 msgr2=0x7fd5ec090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2883559486 shutdown_connections 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2883559486 wait complete. 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: monmap: 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:58.023 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 Processor -- start 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- start start 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: init 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-b con 0x7fd5ec092c20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-a con 0x7fd5ec13bf70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): picked mon.noname-c con 0x7fd5ec13f7d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec1a3380 con 0x7fd5ec13bf70 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec1a3200 con 0x7fd5ec092c20 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ec1a3500 con 0x7fd5ec13f7d0 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient(hunting): authenticate will time out at 590.481572s 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38312/0 (socket says 10.20.193.7:38312) 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 -- 10.20.193.7:0/2477110731 learned_addr learned my addr 10.20.193.7:0/2477110731 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): get_auth_request con 0x7fd5ec13bf70 auth_method 0 2026-02-22T20:52:58.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41506/0 (socket says 10.20.193.7:41506) 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): get_auth_request con 0x7fd5ec13f7d0 auth_method 0 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 10 monclient(hunting): get_auth_request con 0x7fd5ec092c20 auth_method 0 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient(hunting): handle_auth_done global_id 4692 payload 824 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 msgr2=0x7fd5ec129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 -- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 msgr2=0x7fd5ec129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 -- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 msgr2=0x7fd5ec12a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 -- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 msgr2=0x7fd5ec129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 monclient: found mon.noname-a 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 -- 10.20.193.7:0/2477110731 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec08a3e0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eb7fe640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ea7fc640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c750 tx=0x7fd5d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4015030 con 0x7fd5ec13bf70 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: dump: 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d4004020 con 0x7fd5ec13bf70 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 5 monclient: authenticate success, global_id 4692 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _renew_subs 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec08a9e0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40043d0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 10 monclient: dump: 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.030 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5e97fa640 4 set_mon_vals no callback set 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _renew_subs 2026-02-22T20:52:58.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec12ca80 con 0x7fd5ec13bf70 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec08f5d0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd5d4022060 con 0x7fd5ec13bf70 2026-02-22T20:52:58.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 --2- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 0x7fd5b805b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 3897+0+0 (secure 0 0 0) 0x7fd5d404e6f0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 0x7fd5b805b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 10 monclient: get_auth_request con 0x7fd5b803ab70 auth_method 0 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.005+0000 7fd5eaffd640 1 --2- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 0x7fd5b805b020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002410 tx=0x7fd5e00ad040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.009+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd5ec08a9e0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.009+0000 7fd5cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.009+0000 7fd5cb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd5ec13c380 con 0x7fd5ec13bf70 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5cb7fe640 1 -- 10.20.193.7:0/2477110731 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fd5d40193b0 con 0x7fd5ec13bf70 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5cb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5cb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:58.121 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 msgr2=0x7fd5b805b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 0x7fd5b805b020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002410 tx=0x7fd5e00ad040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 10 monclient: shutdown 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 msgr2=0x7fd5ec12a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c750 tx=0x7fd5d400cc10 comp rx=0 tx=0).stop 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 shutdown_connections 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5ec13f7d0 0x7fd5ec12a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5ec13bf70 0x7fd5ec12a390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5b803ab70 0x7fd5b805b020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 --2- 10.20.193.7:0/2477110731 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5ec092c20 0x7fd5ec129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 >> 10.20.193.7:0/2477110731 conn(0x7fd5ec0906f0 msgr2=0x7fd5ec13dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 shutdown_connections 2026-02-22T20:52:58.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.117+0000 7fd5ebfff640 1 -- 10.20.193.7:0/2477110731 wait complete. 2026-02-22T20:52:58.131 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:52:58.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:52:58.131 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: get_monmap_and_config 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: monmap: 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:58.201678+0000 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:58.201678+0000 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.200 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 Processor -- start 2026-02-22T20:52:58.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 -- start start 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: init 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f21cc13f290 0x7f21cc13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc13f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f21cc13fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f21cc13c680 0x7f21cc1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc13c680 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc08fd70 con 0x7f21cc13fba0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f21cc08e1f0 con 0x7f21cc13f290 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f21cc08ec90 con 0x7f21cc13c680 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21d0c9a640 10 monclient(hunting): authenticate will time out at 590.674685s 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f21cc13f290 0x7f21cc13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f21cc13f290 0x7f21cc13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38316/0 (socket says 10.20.193.7:38316) 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 -- 10.20.193.7:0/3760584461 learned_addr learned my addr 10.20.193.7:0/3760584461 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): get_auth_request con 0x7f21cc13f290 auth_method 0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21cad76640 1 --2- 10.20.193.7:0/3760584461 >> v2:10.20.193.61:3300/0 conn(0x7f21cc13c680 0x7f21cc1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21cad76640 10 monclient(hunting): get_auth_request con 0x7f21cc13c680 auth_method 0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21cad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient(hunting): handle_auth_done global_id 4695 payload 274 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 -- 10.20.193.7:0/3760584461 >> v2:10.20.193.61:3300/0 conn(0x7f21cc13c680 msgr2=0x7f21cc1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 --2- 10.20.193.7:0/3760584461 >> v2:10.20.193.61:3300/0 conn(0x7f21cc13c680 0x7f21cc1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 -- 10.20.193.7:0/3760584461 >> v1:10.20.193.61:6789/0 conn(0x7f21cc13fba0 legacy=0x7f21cc13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 monclient: found mon.noname-a 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.197+0000 7f21ca575640 1 -- 10.20.193.7:0/3760584461 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc092bc0 con 0x7f21cc13f290 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- 10.20.193.7:0/3760584461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13f290 0x7f21cc13f660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21cc08f390 tx=0x7f21c001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee94de5424d10724 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 1 -- 10.20.193.7:0/3760584461 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00b0070 con 0x7f21cc13f290 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: dump: 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 1 -- 10.20.193.7:0/3760584461 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c00ab600 con 0x7f21cc13f290 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 1 -- 10.20.193.7:0/3760584461 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00ab9d0 con 0x7f21cc13f290 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 5 monclient: authenticate success, global_id 4695 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 4 set_mon_vals no callback set 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9573640 10 monclient: dump: 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.204 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: shutdown 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3760584461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13f290 msgr2=0x7f21cc13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3760584461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13f290 0x7f21cc13f660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21cc08f390 tx=0x7f21c001c2d0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3760584461 shutdown_connections 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3760584461 >> v2:10.20.193.61:3300/0 conn(0x7f21cc13c680 0x7f21cc1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3760584461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13f290 0x7f21cc13f660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3760584461 >> 10.20.193.7:0/3760584461 conn(0x7f21cc093df0 msgr2=0x7f21cc0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3760584461 shutdown_connections 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3760584461 wait complete. 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: monmap: 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.206 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 Processor -- start 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- start start 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: init 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 0x7f21cc12a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc13c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f21cc13f290 0x7f21cc12a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc13f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f21cc13fba0 0x7f21cc12ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): picked mon.noname-b con 0x7f21cc13fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc090de0 con 0x7f21cc13c680 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc090c60 con 0x7f21cc13fba0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f21cc1a4540 con 0x7f21cc13f290 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): authenticate will time out at 590.678210s 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 0x7f21cc12a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f21cc13f290 0x7f21cc12a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 0x7f21cc12a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38322/0 (socket says 10.20.193.7:38322) 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 -- 10.20.193.7:0/3744781365 learned_addr learned my addr 10.20.193.7:0/3744781365 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): get_auth_request con 0x7f21cc13c680 auth_method 0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): get_auth_request con 0x7f21cc13f290 auth_method 0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f21cc13fba0 0x7f21cc12ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 10 monclient(hunting): get_auth_request con 0x7f21cc13fba0 auth_method 0 2026-02-22T20:52:58.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient(hunting): handle_auth_done global_id 4698 payload 824 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f21cc13f290 msgr2=0x7f21cc12a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f21cc13f290 0x7f21cc12a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f21cc13fba0 msgr2=0x7f21cc12ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f21cc13fba0 0x7f21cc12ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 monclient: found mon.noname-a 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc12d230 con 0x7f21cc13c680 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21ca575640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 0x7f21cc12a110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004780 tx=0x7f21c0019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00b0050 con 0x7f21cc13c680 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: dump: 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c00b1040 con 0x7f21cc13c680 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0004020 con 0x7f21cc13c680 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: dump: 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.208 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c8d72640 4 set_mon_vals no callback set 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 5 monclient: authenticate success, global_id 4698 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _renew_subs 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc12d510 con 0x7f21cc13c680 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _renew_subs 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc08a9e0 con 0x7f21cc13c680 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 0x7f21cc088670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc057740 con 0x7f21cc12d750 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 0x7f21cc088670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient: get_auth_request con 0x7f21cc12d750 auth_method 0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f21c00041c0 con 0x7f21cc13c680 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 10 monclient(hunting): handle_auth_done global_id 4701 payload 824 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21cc13f660 con 0x7f21cc12d750 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 --2- 10.20.193.7:0/3744781365 >> v2:10.20.193.61:6800/2336688312 conn(0x7f219803ab20 0x7f219805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 3897+0+0 (secure 0 0 0) 0x7f21c00e84f0 con 0x7f21cc13c680 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21c9d74640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 0x7f21cc088670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4018020 con 0x7f21cc12d750 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21b2ffd640 10 monclient: dump: 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 1 --2- 10.20.193.7:0/3744781365 >> v2:10.20.193.61:6800/2336688312 conn(0x7f219803ab20 0x7f219805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.201+0000 7f21cad76640 10 monclient: get_auth_request con 0x7f219803ab20 auth_method 0 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f21b400d7a0 con 0x7f21cc12d750 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 msgr2=0x7f21cc088670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 0x7f21cc088670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b400fc00 comp rx=0 tx=0).stop 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 msgr2=0x7f21cc088670 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc12d750 0x7f21cc088670 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b400fc00 comp rx=0 tx=0).stop 2026-02-22T20:52:58.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21cad76640 1 --2- 10.20.193.7:0/3744781365 >> v2:10.20.193.61:6800/2336688312 conn(0x7f219803ab20 0x7f219805afd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21cc12c260 tx=0x7f21bc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21d0c9a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 0x7f21cc088fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21d0c9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc0894f0 con 0x7f21cc088bb0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 0x7f21cc088fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient: get_auth_request con 0x7f21cc088bb0 auth_method 0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 10 monclient(hunting): handle_auth_done global_id 4704 payload 824 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 1 -- 10.20.193.7:0/3744781365 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f21cc12b0d0 con 0x7f21cc088bb0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21c9d74640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 0x7f21cc088fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4004680 con 0x7f21cc088bb0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: dump: 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5049 (secure 0 0 0) 0x7f21b4004680 con 0x7f21cc088bb0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 msgr2=0x7f21cc088fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 0x7f21cc088fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b4007f90 comp rx=0 tx=0).stop 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 msgr2=0x7f21cc088fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.205+0000 7f21b2ffd640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc088bb0 0x7f21cc088fb0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21b40037b0 tx=0x7f21b4007f90 comp rx=0 tx=0).stop 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:58.211 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 57335, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.212 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.213 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:58.214 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:52:58.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 >> v2:10.20.193.61:6800/2336688312 conn(0x7f219803ab20 msgr2=0x7f219805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3744781365 >> v2:10.20.193.61:6800/2336688312 conn(0x7f219803ab20 0x7f219805afd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21cc12c260 tx=0x7f21bc00b040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 10 monclient: shutdown 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 msgr2=0x7f21cc12a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 --2- 10.20.193.7:0/3744781365 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f21cc13c680 0x7f21cc12a110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004780 tx=0x7f21c0019070 comp rx=0 tx=0).stop 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21cad76640 1 -- 10.20.193.7:0/3744781365 reap_dead start 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21cad76640 1 -- 10.20.193.7:0/3744781365 reap_dead start 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 shutdown_connections 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 >> 10.20.193.7:0/3744781365 conn(0x7f21cc093df0 msgr2=0x7f21cc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 shutdown_connections 2026-02-22T20:52:58.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.209+0000 7f21d0c9a640 1 -- 10.20.193.7:0/3744781365 wait complete. 2026-02-22T20:52:58.219 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:58.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:52:58.219 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.281+0000 7f5fb78f0640 10 monclient: get_monmap_and_config 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.281+0000 7f5fb78f0640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.281+0000 7f5fb78f0640 10 monclient: monmap: 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:58.287470+0000 2026-02-22T20:52:58.286 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:58.287470+0000 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:58.287 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 Processor -- start 2026-02-22T20:52:58.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- start start 2026-02-22T20:52:58.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: init 2026-02-22T20:52:58.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: _add_conns ranks=[2,0,4,1,3] 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 0x7f5fb0139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb008b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5fb013a4d0 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f5fb013d700 0x7f5fb019f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-c con 0x7f5fb013d700 addr v2:10.20.193.61:3300/0 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb0089920 con 0x7f5fb013a4d0 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb008ab40 con 0x7f5fb013d700 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb008a860 con 0x7f5fb008b590 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): authenticate will time out at 590.760363s 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 0x7f5fb0139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f5fb013a4d0 0x7f5fb013cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:55860/0 (socket says 10.20.193.7:55860) 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): get_auth_request con 0x7f5fb008b590 auth_method 0 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 1 -- 10.20.193.7:0/2807559232 learned_addr learned my addr 10.20.193.7:0/2807559232 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5e66640 1 --2- 10.20.193.7:0/2807559232 >> v2:10.20.193.61:3300/0 conn(0x7f5fb013d700 0x7f5fb019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5e66640 10 monclient(hunting): get_auth_request con 0x7f5fb013d700 auth_method 0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5e66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5e66640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5e66640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_done global_id 4559 payload 274 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 -- 10.20.193.7:0/2807559232 >> v2:10.20.193.61:3300/0 conn(0x7f5fb013d700 msgr2=0x7f5fb019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 --2- 10.20.193.7:0/2807559232 >> v2:10.20.193.61:3300/0 conn(0x7f5fb013d700 0x7f5fb019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 -- 10.20.193.7:0/2807559232 >> v1:10.20.193.7:6789/0 conn(0x7f5fb013a4d0 legacy=0x7f5fb013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 monclient: found mon.noname-b 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 -- 10.20.193.7:0/2807559232 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb0089170 con 0x7f5fb008b590 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 --2- 10.20.193.7:0/2807559232 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 0x7f5fb0139f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0004780 tx=0x7f5fa001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc4bf09c0a16d38d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 1 -- 10.20.193.7:0/2807559232 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb013aab0 con 0x7f5fb008b590 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: dump: 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.290 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 1 -- 10.20.193.7:0/2807559232 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa00b0070 con 0x7f5fb008b590 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 1 -- 10.20.193.7:0/2807559232 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00ab880 con 0x7f5fb008b590 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5f9ffff640 10 monclient: dump: 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 5 monclient: authenticate success, global_id 4559 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:58.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 4 set_mon_vals no callback set 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: shutdown 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- 10.20.193.7:0/2807559232 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 msgr2=0x7f5fb0139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/2807559232 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 0x7f5fb0139f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0004780 tx=0x7f5fa001c440 comp rx=0 tx=0).stop 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- 10.20.193.7:0/2807559232 shutdown_connections 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/2807559232 >> v2:10.20.193.61:3300/0 conn(0x7f5fb013d700 0x7f5fb019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/2807559232 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb008b590 0x7f5fb0139f90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- 10.20.193.7:0/2807559232 >> 10.20.193.7:0/2807559232 conn(0x7f5fb008faa0 msgr2=0x7f5fb008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- 10.20.193.7:0/2807559232 shutdown_connections 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- 10.20.193.7:0/2807559232 wait complete. 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: monmap: 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 Processor -- start 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- start start 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: init 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 0x7f5fb014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb008b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb013a4d0 0x7f5fb014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-c con 0x7f5fb013a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5fb013d700 0x7f5fb01275d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb013d700 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01a2480 con 0x7f5fb008b590 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01a2300 con 0x7f5fb013d700 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb01a2600 con 0x7f5fb013a4d0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb78f0640 10 monclient(hunting): authenticate will time out at 590.763767s 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 0x7f5fb014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb013a4d0 0x7f5fb014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 0x7f5fb014e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38344/0 (socket says 10.20.193.7:38344) 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 1 -- 10.20.193.7:0/20908283 learned_addr learned my addr 10.20.193.7:0/20908283 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): get_auth_request con 0x7f5fb008b590 auth_method 0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): get_auth_request con 0x7f5fb013a4d0 auth_method 0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb5665640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.285+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5fb013d700 0x7f5fb01275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 10 monclient(hunting): handle_auth_done global_id 4710 payload 824 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb013a4d0 msgr2=0x7f5fb014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb013a4d0 0x7f5fb014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5fb013d700 msgr2=0x7f5fb01275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5fb013d700 0x7f5fb01275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 monclient: found mon.noname-a 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb0139900 con 0x7f5fb008b590 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb013a4d0 0x7f5fb014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 10 monclient: get_auth_request con 0x7f5fb013d700 auth_method 0 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5fb013d700 0x7f5fb01275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5665640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 0x7f5fb014e3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa001c480 tx=0x7f5fa00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00b9020 con 0x7f5fb008b590 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: dump: 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa0003d60 con 0x7f5fb008b590 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00ab660 con 0x7f5fb008b590 2026-02-22T20:52:58.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 5 monclient: authenticate success, global_id 4710 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 monclient: _renew_subs 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb012aab0 con 0x7f5fb008b590 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9f7fe640 4 set_mon_vals no callback set 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: dump: 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 monclient: _renew_subs 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb0129b50 con 0x7f5fb008b590 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 0x7f5fb0127b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb0139f70 con 0x7f5fb012bca0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 0x7f5fb0127b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient: get_auth_request con 0x7f5fb012bca0 auth_method 0 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5fa00ab800 con 0x7f5fb008b590 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fb0139b20 con 0x7f5fb012bca0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 --2- 10.20.193.7:0/20908283 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5f8003ab10 0x7f5f8005afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 3897+0+0 (secure 0 0 0) 0x7f5fa00e9060 con 0x7f5fb008b590 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb4e64640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 0x7f5fb0127b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0089b60 tx=0x7f5fa4007770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005970 con 0x7f5fb012bca0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: dump: 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 1 --2- 10.20.193.7:0/20908283 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5f8003ab10 0x7f5f8005afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 10 monclient: get_auth_request con 0x7f5f8003ab10 auth_method 0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f5fa4005970 con 0x7f5fb012bca0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 msgr2=0x7f5fb0127b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 0x7f5fb0127b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0089b60 tx=0x7f5fa4007770 comp rx=0 tx=0).stop 2026-02-22T20:52:58.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 msgr2=0x7f5fb0127b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5f9dffb640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb012bca0 0x7f5fb0127b10 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0089b60 tx=0x7f5fa4007770 comp rx=0 tx=0).stop 2026-02-22T20:52:58.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.289+0000 7f5fb5e66640 1 --2- 10.20.193.7:0/20908283 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5f8003ab10 0x7f5f8005afc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0129340 tx=0x7f5fac00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:58.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 0x7f5fb0128450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb0128990 con 0x7f5fb0128050 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 0x7f5fb0128450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient: get_auth_request con 0x7f5fb0128050 auth_method 0 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 10 monclient(hunting): handle_auth_done global_id 4568 payload 824 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 1 -- 10.20.193.7:0/20908283 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5fb005fc70 con 0x7f5fb0128050 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb4e64640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 0x7f5fb0128450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4017000 tx=0x7f5fa40026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4006030 con 0x7f5fb0128050 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 10 monclient: dump: 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f5fa4006030 con 0x7f5fb0128050 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:58.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 msgr2=0x7f5fb0128450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 0x7f5fb0128450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4017000 tx=0x7f5fa40026e0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 msgr2=0x7f5fb0128450 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5f9dffb640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5fb0128050 0x7f5fb0128450 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4017000 tx=0x7f5fa40026e0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 57419, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.302 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:58.303 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.304 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.305 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.306 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:58.307 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5f8003ab10 msgr2=0x7f5f8005afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/20908283 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5f8003ab10 0x7f5f8005afc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0129340 tx=0x7f5fac00b040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 10 monclient: shutdown 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 msgr2=0x7f5fb014e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 --2- 10.20.193.7:0/20908283 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5fb008b590 0x7f5fb014e3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5fa001c480 tx=0x7f5fa00191e0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb5e66640 1 -- 10.20.193.7:0/20908283 reap_dead start 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb5e66640 1 -- 10.20.193.7:0/20908283 reap_dead start 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 shutdown_connections 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 >> 10.20.193.7:0/20908283 conn(0x7f5fb008faa0 msgr2=0x7f5fb013ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 shutdown_connections 2026-02-22T20:52:58.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.293+0000 7f5fb78f0640 1 -- 10.20.193.7:0/20908283 wait complete. 2026-02-22T20:52:58.308 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:58.308 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:52:58.309 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.361+0000 7fe433c11640 10 monclient: get_monmap_and_config 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.361+0000 7fe433c11640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.361+0000 7fe433c11640 10 monclient: monmap: 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:58.367565+0000 2026-02-22T20:52:58.366 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:58.367565+0000 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:58.367 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 Processor -- start 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- start start 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: init 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe42c08b590 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c17e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-b con 0x7fe42c13a6a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe42c17e8b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c089920 con 0x7fe42c08b590 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c08a860 con 0x7fe42c17e8b0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c13aad0 con 0x7fe42c13a6a0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient(hunting): authenticate will time out at 590.840467s 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431986640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fe42c08b590 0x7fe42c139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:55876/0 (socket says 10.20.193.7:55876) 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431986640 1 -- 10.20.193.7:0/3550974019 learned_addr learned my addr 10.20.193.7:0/3550974019 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 --2- 10.20.193.7:0/3550974019 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c17e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): get_auth_request con 0x7fe42c13a6a0 auth_method 0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient(hunting): handle_auth_done global_id 4571 payload 274 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 -- 10.20.193.7:0/3550974019 >> v1:10.20.193.61:6789/0 conn(0x7fe42c17e8b0 legacy=0x7fe42c19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 1 -- 10.20.193.7:0/3550974019 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65044226 0 0) 0x7fe42c089920 con 0x7fe42c08b590 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 -- 10.20.193.7:0/3550974019 >> v1:10.20.193.7:6789/0 conn(0x7fe42c08b590 legacy=0x7fe42c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 monclient: found mon.noname-b 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 -- 10.20.193.7:0/3550974019 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c089170 con 0x7fe42c13a6a0 2026-02-22T20:52:58.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe431185640 1 --2- 10.20.193.7:0/3550974019 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c17e370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe420009870 tx=0x7fe42001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31390c3febc3004a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 1 -- 10.20.193.7:0/3550974019 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b0070 con 0x7fe42c13a6a0 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: dump: 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.369 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 1 -- 10.20.193.7:0/3550974019 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4200ab600 con 0x7fe42c13a6a0 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 5 monclient: authenticate success, global_id 4571 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 1 -- 10.20.193.7:0/3550974019 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200ab9d0 con 0x7fe42c13a6a0 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 4 set_mon_vals no callback set 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe430984640 10 monclient: dump: 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.370 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: shutdown 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- 10.20.193.7:0/3550974019 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 msgr2=0x7fe42c17e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 --2- 10.20.193.7:0/3550974019 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c17e370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe420009870 tx=0x7fe42001c460 comp rx=0 tx=0).stop 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- 10.20.193.7:0/3550974019 shutdown_connections 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 --2- 10.20.193.7:0/3550974019 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c17e370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- 10.20.193.7:0/3550974019 >> 10.20.193.7:0/3550974019 conn(0x7fe42c08faa0 msgr2=0x7fe42c08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- 10.20.193.7:0/3550974019 shutdown_connections 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- 10.20.193.7:0/3550974019 wait complete. 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: build_initial_monmap 2026-02-22T20:52:58.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: monmap: 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 Processor -- start 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 1 -- start start 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: init 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.365+0000 7fe433c11640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 0x7fe42c12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-a con 0x7fe42c08b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c12b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-c con 0x7fe42c13a6a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c17e8b0 0x7fe42c125b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): picked mon.noname-b con 0x7fe42c17e8b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c1a2f60 con 0x7fe42c08b590 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c1a2de0 con 0x7fe42c17e8b0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c1a30e0 con 0x7fe42c13a6a0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): authenticate will time out at 590.844048s 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 0x7fe42c12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 0x7fe42c12ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:38360/0 (socket says 10.20.193.7:38360) 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 learned_addr learned my addr 10.20.193.7:0/2574951246 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): get_auth_request con 0x7fe42c08b590 auth_method 0 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): get_auth_request con 0x7fe42c13a6a0 auth_method 0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c17e8b0 0x7fe42c125b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 10 monclient(hunting): get_auth_request con 0x7fe42c17e8b0 auth_method 0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient(hunting): handle_auth_done global_id 4574 payload 824 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c17e8b0 msgr2=0x7fe42c125b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c17e8b0 0x7fe42c125b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 msgr2=0x7fe42c12ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 0x7fe42c12ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient: _finish_hunting 0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 monclient: found mon.noname-c 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c128dd0 con 0x7fe42c13a6a0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe42c08b590 0x7fe42c12ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431185640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c12b340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe42001cd00 tx=0x7fe420019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b9070 con 0x7fe42c13a6a0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: dump: 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.374 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4200abde0 con 0x7fe42c13a6a0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b0040 con 0x7fe42c13a6a0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 10 monclient: dump: 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41bfff640 4 set_mon_vals no callback set 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 5 monclient: authenticate success, global_id 4574 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient: _renew_subs 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c086690 con 0x7fe42c13a6a0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient: _renew_subs 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c129670 con 0x7fe42c13a6a0 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c18e590 con 0x7fe42c127e70 2026-02-22T20:52:58.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient: get_auth_request con 0x7fe42c127e70 auth_method 0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe4200b3070 con 0x7fe42c13a6a0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 0x7fe3fc05f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 3897+0+0 (secure 0 0 0) 0x7fe4200e7a90 con 0x7fe42c13a6a0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 1 --2- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 0x7fe3fc05f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 10 monclient: get_auth_request con 0x7fe3fc03f030 auth_method 0 2026-02-22T20:52:58.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.369+0000 7fe432187640 1 --2- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 0x7fe3fc05f4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe428003b30 tx=0x7fe428009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 10 monclient: get_auth_request con 0x7fe42c127e70 auth_method 0 2026-02-22T20:52:58.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:58.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.573+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:52:58.958 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18961]: starting. 2026-02-22T20:52:58.958 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18961]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18959 2026-02-22T20:52:58.958 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[18961]: shutting down. 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient: get_auth_request con 0x7fe42c127e70 auth_method 0 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 10 monclient(hunting): handle_auth_done global_id 34105 payload 824 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe42c0382a0 con 0x7fe42c127e70 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe41c002840 tx=0x7fe41c0077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c01a020 con 0x7fe42c127e70 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 10 monclient: dump: 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.979 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fe41c013bd0 con 0x7fe42c127e70 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe41c002840 tx=0x7fe41c0077f0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 msgr2=0x7fe42c126040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.977+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c127e70 0x7fe42c126040 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe41c002840 tx=0x7fe41c0077f0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c126ec0 con 0x7fe42c126580 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient: get_auth_request con 0x7fe42c126580 auth_method 0 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_done global_id 34108 payload 824 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe42c05fc70 con 0x7fe42c126580 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c002890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 msgr2=0x7fe42c126980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 msgr2=0x7fe42c126980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c002890 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c002890 comp rx=0 tx=0).stop 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 msgr2=0x7fe42c126980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 0x7fe3fc083840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 msgr2=0x7fe42c126980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe42c126580 0x7fe42c126980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc083e20 con 0x7fe3fc063460 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 0x7fe3fc083840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient: get_auth_request con 0x7fe3fc063460 auth_method 0 2026-02-22T20:52:58.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 10 monclient(hunting): handle_auth_done global_id 34111 payload 824 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 -- 10.20.193.7:0/2574951246 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe41c013bd0 con 0x7fe3fc063460 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe431986640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 0x7fe3fc083840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c006040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c03b070 con 0x7fe3fc063460 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient: dump: 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7fe41c0376f0 con 0x7fe3fc063460 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 msgr2=0x7fe3fc083840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 0x7fe3fc083840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c006040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 msgr2=0x7fe3fc083840 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe41a7fc640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe3fc063460 0x7fe3fc083840 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004a10 tx=0x7fe41c006040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe432187640 1 -- 10.20.193.7:0/2574951246 reap_dead start 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 4199, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.986 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.987 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:52:58.988 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:52:58.989 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 msgr2=0x7fe3fc05f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 0x7fe3fc05f4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe428003b30 tx=0x7fe428009040 comp rx=0 tx=0).stop 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 10 monclient: shutdown 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 msgr2=0x7fe42c12b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c12b340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe42001cd00 tx=0x7fe420019200 comp rx=0 tx=0).stop 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 shutdown_connections 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe3fc03f030 0x7fe3fc05f4e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 --2- 10.20.193.7:0/2574951246 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe42c13a6a0 0x7fe42c12b340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 >> 10.20.193.7:0/2574951246 conn(0x7fe42c08faa0 msgr2=0x7fe42c057400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 shutdown_connections 2026-02-22T20:52:58.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:58.981+0000 7fe433c11640 1 -- 10.20.193.7:0/2574951246 wait complete. 2026-02-22T20:52:58.999 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:52:58.999 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:52:58.999 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:52:59.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: get_monmap_and_config 2026-02-22T20:52:59.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: build_initial_monmap 2026-02-22T20:52:59.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: monmap: 2026-02-22T20:52:59.068 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:52:59.069656+0000 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:52:59.069656+0000 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:52:59.069 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 Processor -- start 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 -- start start 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: init 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa4cc08b590 addr v1:10.20.193.7:6789/0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa4cc13a6a0 0x7fa4cc17e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-a con 0x7fa4cc13a6a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa4cc17e8b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4cc089920 con 0x7fa4cc08b590 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4cc08a860 con 0x7fa4cc17e8b0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc13aad0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4d2b90640 10 monclient(hunting): authenticate will time out at 591.542861s 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa4cc13a6a0 0x7fa4cc17e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa4cc13a6a0 0x7fa4cc17e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40174/0 (socket says 10.20.193.7:40174) 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 -- 10.20.193.7:0/3610497772 learned_addr learned my addr 10.20.193.7:0/3610497772 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): get_auth_request con 0x7fa4cc13a6a0 auth_method 0 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:59.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_done global_id 4737 payload 274 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 -- 10.20.193.7:0/3610497772 >> v1:10.20.193.61:6789/0 conn(0x7fa4cc17e8b0 legacy=0x7fa4cc19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 -- 10.20.193.7:0/3610497772 >> v1:10.20.193.7:6789/0 conn(0x7fa4cc08b590 legacy=0x7fa4cc139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 monclient: found mon.noname-a 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.065+0000 7fa4c3fff640 1 -- 10.20.193.7:0/3610497772 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc089170 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- 10.20.193.7:0/3610497772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc17e370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40090a0 tx=0x7fa4b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d46d3143489f53 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 1 -- 10.20.193.7:0/3610497772 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40ab610 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: dump: 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: _finish_auth 0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: _check_auth_tickets 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 1 -- 10.20.193.7:0/3610497772 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b40b0070 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 1 -- 10.20.193.7:0/3610497772 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40ab9d0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 5 monclient: authenticate success, global_id 4737 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c37fe640 10 monclient: dump: 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:59.072 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:59.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: get_monmap_and_config success 2026-02-22T20:52:59.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 4 set_mon_vals no callback set 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: shutdown 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/3610497772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 msgr2=0x7fa4cc17e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/3610497772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc17e370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40090a0 tx=0x7fa4b401c500 comp rx=0 tx=0).stop 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/3610497772 shutdown_connections 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/3610497772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc17e370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/3610497772 >> 10.20.193.7:0/3610497772 conn(0x7fa4cc08faa0 msgr2=0x7fa4cc08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/3610497772 shutdown_connections 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/3610497772 wait complete. 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: build_initial_monmap 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: monmap: 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:52:59.074 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 Processor -- start 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- start start 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: init 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _reopen_session rank -1 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa4cc08b590 0x7fa4cc12d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-b con 0x7fa4cc08b590 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-a con 0x7fa4cc13a6a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa4cc17e8b0 0x7fa4cc129b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): picked mon.noname-c con 0x7fa4cc17e8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1a2f60 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc1a2de0 con 0x7fa4cc08b590 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): start opening mon connection 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc1a30e0 con 0x7fa4cc17e8b0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): _renew_subs 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient(hunting): authenticate will time out at 591.547006s 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa4cc17e8b0 0x7fa4cc129b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40180/0 (socket says 10.20.193.7:40180) 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 -- 10.20.193.7:0/1541968657 learned_addr learned my addr 10.20.193.7:0/1541968657 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): get_auth_request con 0x7fa4cc13a6a0 auth_method 0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): get_auth_request con 0x7fa4cc17e8b0 auth_method 0 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:59.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d1106640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d0905640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa4cc08b590 0x7fa4cc12d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d0905640 10 monclient(hunting): get_auth_request con 0x7fa4cc08b590 auth_method 0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d0905640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d0905640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d0905640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient(hunting): handle_auth_done global_id 4743 payload 824 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 -- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa4cc17e8b0 msgr2=0x7fa4cc129b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa4cc17e8b0 0x7fa4cc129b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 -- 10.20.193.7:0/1541968657 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa4cc08b590 msgr2=0x7fa4cc12d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa4cc08b590 0x7fa4cc12d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient: _finish_hunting 0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 monclient: found mon.noname-a 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 -- 10.20.193.7:0/1541968657 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc10e9f0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c3fff640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4002410 tx=0x7fa4b401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4004230 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: dump: 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: _finish_auth 0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: _check_auth_tickets 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b40043d0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4003710 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c2ffd640 4 set_mon_vals no callback set 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4c17fa640 10 monclient: dump: 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 5 monclient: authenticate success, global_id 4743 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _renew_subs 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc088490 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _renew_subs 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.069+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc10e150 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d2b90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:59.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d2b90640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d2b90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc0382a0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa4b40038d0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4c17fa640 1 --2- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 0x7fa49c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 3503+0+0 (secure 0 0 0) 0x7fa4b40e9170 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d0905640 1 --2- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 0x7fa49c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d0905640 10 monclient: get_auth_request con 0x7fa49c03ab20 auth_method 0 2026-02-22T20:52:59.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.073+0000 7fa4d0905640 1 --2- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 0x7fa49c05afd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc002810 tx=0x7fa4bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:52:59.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.077+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa4b40a8050 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.077+0000 7fa4c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:52:59.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.077+0000 7fa4c17fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:52:59.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.185+0000 7fa4d2b90640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:52:59.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.185+0000 7fa4d2b90640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:52:59.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.185+0000 7fa4d2b90640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:52:59.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.185+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa4cc10ddc0 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4c17fa640 1 -- 10.20.193.7:0/1541968657 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa4b4016210 con 0x7fa4cc13a6a0 2026-02-22T20:52:59.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:52:59.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4c17fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:52:59.193 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.193 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=10,logm=66} crc {auth=40129053,config=3140514009,health=3286817296,kv=3991984195,logm=1338521324}) 2026-02-22T20:52:59.193 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=11,kv=9,logm=68} crc {auth=1134661713,config=3140514009,health=1302963021,kv=497144887,logm=3381657351}) 2026-02-22T20:52:59.193 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=10,logm=66} crc {auth=40129053,config=3140514009,health=3286817296,kv=3991984195,logm=1338521324}) 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=13,kv=10,logm=65} crc {auth=2307997079,config=3140514009,health=2358046931,kv=3991984195,logm=4172294241}) 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046507619}) 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4056986637}) 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046507619}) 2026-02-22T20:52:59.194 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3951481450}) 2026-02-22T20:52:59.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 msgr2=0x7fa49c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 0x7fa49c05afd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc002810 tx=0x7fa4bc009040 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 10 monclient: shutdown 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 msgr2=0x7fa4cc139500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4002410 tx=0x7fa4b401ad40 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 shutdown_connections 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa4cc17e8b0 0x7fa4cc129b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa4cc13a6a0 0x7fa4cc139500 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa49c03ab20 0x7fa49c05afd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 --2- 10.20.193.7:0/1541968657 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa4cc08b590 0x7fa4cc12d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 >> 10.20.193.7:0/1541968657 conn(0x7fa4cc08faa0 msgr2=0x7fa4cc08e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 shutdown_connections 2026-02-22T20:52:59.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:52:59.189+0000 7fa4d2b90640 1 -- 10.20.193.7:0/1541968657 wait complete. 2026-02-22T20:52:59.198 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.198 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1313599676}) 2026-02-22T20:52:59.198 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=489954718}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1313599676}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2754884863}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1806844444}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=509824250}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1806844444}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2625096162}) 2026-02-22T20:52:59.199 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=668946130,mdsmap=774328894,mgr=2075024345,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2798639490,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1741132956,osd_snap=4133920409,osdmap=1328813882}) 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=8,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=7,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=2198712290,mdsmap=774328894,mgr=4245677621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2969692211,mon_config_key=1023171130,monmap=639966935,nvmeofgw=55734535,osd_metadata=2266821947,osd_pg_creating=1741132956,osd_snap=4133920409,osdmap=3141798266}) 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=7,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=668946130,mdsmap=774328894,mgr=2075024345,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2798639490,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1741132956,osd_snap=4133920409,osdmap=1328813882}) 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.189+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=47} crc {logm=2198712290,mdsmap=774328894,mgr=3250251636,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2969692211,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1741132956,osd_snap=1914091868,osdmap=2656595095}) 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.200 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=36} crc {osdmap=1432289490}) 2026-02-22T20:52:59.201 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=37} crc {osdmap=741646904}) 2026-02-22T20:52:59.201 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:52:59.201 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=36} crc {osdmap=1432289490}) 2026-02-22T20:52:59.201 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:52:59.193+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=36} crc {osdmap=4178368828}) 2026-02-22T20:52:59.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:53:00.204 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:53:00.204 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:00.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: get_monmap_and_config 2026-02-22T20:53:00.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: monmap: 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:00.266417+0000 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:00.266417+0000 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:00.266 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:00.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 Processor -- start 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 -- start start 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: init 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f563813f290 0x7f563813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-c con 0x7f563813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f563813fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f563813c680 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563808fd70 con 0x7f563813c680 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5638092bc0 con 0x7f563813fba0 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f563808e1f0 con 0x7f563813f290 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563ed36640 10 monclient(hunting): authenticate will time out at 592.739311s 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563d2ac640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f563813c680 0x7f56381a17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:44970/0 (socket says 10.20.193.7:44970) 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563d2ac640 1 -- 10.20.193.7:0/2441804776 learned_addr learned my addr 10.20.193.7:0/2441804776 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 1 --2- 10.20.193.7:0/2441804776 >> v2:10.20.193.61:3300/0 conn(0x7f563813f290 0x7f563813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): get_auth_request con 0x7f563813f290 auth_method 0 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 1 -- 10.20.193.7:0/2441804776 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378365493 0 0) 0x7f5634002ca0 con 0x7f563813c680 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 10 monclient(hunting): _negotiate 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 10 monclient(hunting): my global_id is 4746 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f562f7fe640 1 -- 10.20.193.7:0/2441804776 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624003620 con 0x7f563813c680 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient(hunting): handle_auth_done global_id 34117 payload 274 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 1 -- 10.20.193.7:0/2441804776 >> v1:10.20.193.61:6789/0 conn(0x7f563813fba0 legacy=0x7f563813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 1 -- 10.20.193.7:0/2441804776 >> v1:10.20.193.7:6789/0 conn(0x7f563813c680 legacy=0x7f56381a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 1 monclient: found mon.noname-c 2026-02-22T20:53:00.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.261+0000 7f563caab640 1 -- 10.20.193.7:0/2441804776 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563808e6d0 con 0x7f563813f290 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- 10.20.193.7:0/2441804776 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813f290 0x7f563813f660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5628004780 tx=0x7f562801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410afa0b6b22bb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 1 -- 10.20.193.7:0/2441804776 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280b0070 con 0x7f563813f290 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: dump: 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 1 -- 10.20.193.7:0/2441804776 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56280ab600 con 0x7f563813f290 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 1 -- 10.20.193.7:0/2441804776 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280ab9d0 con 0x7f563813f290 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 5 monclient: authenticate success, global_id 34117 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 4 set_mon_vals no callback set 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562f7fe640 10 monclient: dump: 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: shutdown 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2441804776 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813f290 msgr2=0x7f563813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 --2- 10.20.193.7:0/2441804776 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813f290 0x7f563813f660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5628004780 tx=0x7f562801c440 comp rx=0 tx=0).stop 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2441804776 shutdown_connections 2026-02-22T20:53:00.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 --2- 10.20.193.7:0/2441804776 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813f290 0x7f563813f660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2441804776 >> 10.20.193.7:0/2441804776 conn(0x7f5638093df0 msgr2=0x7f56380902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2441804776 shutdown_connections 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2441804776 wait complete. 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: monmap: 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 Processor -- start 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- start start 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: init 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-a con 0x7f563813c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f563813f290 0x7f563812a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-c con 0x7f563813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813fba0 0x7f563812a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): picked mon.noname-b con 0x7f563813fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56381a58a0 con 0x7f563813c680 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f56381a5720 con 0x7f563813fba0 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f56381a5a20 con 0x7f563813f290 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient(hunting): authenticate will time out at 592.742878s 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40182/0 (socket says 10.20.193.7:40182) 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 -- 10.20.193.7:0/2600729346 learned_addr learned my addr 10.20.193.7:0/2600729346 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): get_auth_request con 0x7f563813c680 auth_method 0 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f563813f290 0x7f563812a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): get_auth_request con 0x7f563813f290 auth_method 0 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563d2ac640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813fba0 0x7f563812a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563d2ac640 10 monclient(hunting): get_auth_request con 0x7f563813fba0 auth_method 0 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563d2ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563d2ac640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563d2ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient(hunting): handle_auth_done global_id 4749 payload 824 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 -- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f563813f290 msgr2=0x7f563812a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f563813f290 0x7f563812a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 -- 10.20.193.7:0/2600729346 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813fba0 msgr2=0x7f563812a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813fba0 0x7f563812a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 -- 10.20.193.7:0/2600729346 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563812cc30 con 0x7f563813c680 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563caab640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f562801c480 tx=0x7f56280191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280b0040 con 0x7f563813c680 2026-02-22T20:53:00.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: dump: 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56280b9070 con 0x7f563813c680 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280abbb0 con 0x7f563813c680 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 5 monclient: authenticate success, global_id 4749 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _renew_subs 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562effd640 4 set_mon_vals no callback set 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563808a9e0 con 0x7f563813c680 2026-02-22T20:53:00.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f562d7fa640 10 monclient: dump: 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _renew_subs 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563812b740 con 0x7f563813c680 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.265+0000 7f563ed36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f563ed36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f563ed36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563813f660 con 0x7f563813c680 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5628003710 con 0x7f563813c680 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562d7fa640 1 --2- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 0x7f560805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7f56280e85e0 con 0x7f563813c680 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562ffff640 1 --2- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 0x7f560805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562ffff640 10 monclient: get_auth_request con 0x7f560803ab20 auth_method 0 2026-02-22T20:53:00.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.269+0000 7f562ffff640 1 --2- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 0x7f560805afd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f563812b3d0 tx=0x7f56200026e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.273+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5628016150 con 0x7f563813c680 2026-02-22T20:53:00.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.273+0000 7f562d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.273+0000 7f562d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:00.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f563ed36640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:00.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f563ed36640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f563ed36640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f563805fb50 con 0x7f563813c680 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f562d7fa640 1 -- 10.20.193.7:0/2600729346 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f56280a5e20 con 0x7f563813c680 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f562d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.381+0000 7f562d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:00.387 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 msgr2=0x7f560805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 0x7f560805afd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f563812b3d0 tx=0x7f56200026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 10 monclient: shutdown 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 msgr2=0x7f5638129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f562801c480 tx=0x7f56280191e0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 shutdown_connections 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> v2:10.20.193.61:6800/2336688312 conn(0x7f560803ab20 0x7f560805afd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f563813fba0 0x7f563812a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f563813f290 0x7f563812a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 --2- 10.20.193.7:0/2600729346 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f563813c680 0x7f5638129e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 >> 10.20.193.7:0/2600729346 conn(0x7f5638093df0 msgr2=0x7f5638055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 shutdown_connections 2026-02-22T20:53:00.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.385+0000 7f563ed36640 1 -- 10.20.193.7:0/2600729346 wait complete. 2026-02-22T20:53:00.397 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:53:00.397 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:53:00.397 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:53:00.397 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:53:00.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 10 monclient: get_monmap_and_config 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 10 monclient: monmap: 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:00.463097+0000 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:00.463097+0000 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.465 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 1 Processor -- start 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 1 -- start start 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.457+0000 7f244735f640 10 monclient: init 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f244013f290 0x7f244013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-c con 0x7f244013f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f244013fba0 0x7f244013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-a con 0x7f244013fba0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 0x7f244013c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-b con 0x7f244013c4b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f244008e1f0 con 0x7f244013fba0 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f244008ec90 con 0x7f244013f290 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f244008fd70 con 0x7f244013c4b0 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): authenticate will time out at 592.936116s 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f244013fba0 0x7f244013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 0x7f244013c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f244013fba0 0x7f244013bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40196/0 (socket says 10.20.193.7:40196) 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 -- 10.20.193.7:0/2003102763 learned_addr learned my addr 10.20.193.7:0/2003102763 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): get_auth_request con 0x7f244013fba0 auth_method 0 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 0x7f244013c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51066/0 (socket says 10.20.193.7:51066) 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): get_auth_request con 0x7f244013c4b0 auth_method 0 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 --2- 10.20.193.7:0/2003102763 >> v2:10.20.193.61:3300/0 conn(0x7f244013f290 0x7f244013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): get_auth_request con 0x7f244013f290 auth_method 0 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): handle_auth_done global_id 4752 payload 274 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 -- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 msgr2=0x7f244013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 0x7f244013c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 -- 10.20.193.7:0/2003102763 >> v2:10.20.193.61:3300/0 conn(0x7f244013f290 msgr2=0x7f244013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- 10.20.193.7:0/2003102763 >> v2:10.20.193.61:3300/0 conn(0x7f244013f290 0x7f244013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 -- 10.20.193.7:0/2003102763 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2440092bc0 con 0x7f244013fba0 2026-02-22T20:53:00.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013fba0 0x7f244013bf70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24400947c0 tx=0x7f243401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f59868fdfd7614 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 1 -- 10.20.193.7:0/2003102763 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340b0070 con 0x7f244013fba0 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: dump: 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.479 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 1 -- 10.20.193.7:0/2003102763 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24340ab600 con 0x7f244013fba0 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 5 monclient: authenticate success, global_id 4752 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 1 -- 10.20.193.7:0/2003102763 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340ab9d0 con 0x7f244013fba0 2026-02-22T20:53:00.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 4 set_mon_vals no callback set 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f242ffff640 10 monclient: dump: 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.481 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: shutdown 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013fba0 msgr2=0x7f244013bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013fba0 0x7f244013bf70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24400947c0 tx=0x7f243401c480 comp rx=0 tx=0).stop 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- 10.20.193.7:0/2003102763 shutdown_connections 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013c4b0 0x7f244013c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- 10.20.193.7:0/2003102763 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013fba0 0x7f244013bf70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- 10.20.193.7:0/2003102763 >> v2:10.20.193.61:3300/0 conn(0x7f244013f290 0x7f244013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- 10.20.193.7:0/2003102763 >> 10.20.193.7:0/2003102763 conn(0x7f2440093df0 msgr2=0x7f24400902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- 10.20.193.7:0/2003102763 shutdown_connections 2026-02-22T20:53:00.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- 10.20.193.7:0/2003102763 wait complete. 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: monmap: 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:00.483 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 Processor -- start 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- start start 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: init 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 0x7f244008a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-a con 0x7f244013c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f244013f290 0x7f244014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-b con 0x7f244013f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013fba0 0x7f244013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): picked mon.noname-c con 0x7f244013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f24401a2ff0 con 0x7f244013c4b0 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f24401400c0 con 0x7f244013f290 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f24401a3170 con 0x7f244013fba0 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f244735f640 10 monclient(hunting): authenticate will time out at 592.939639s 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 0x7f244008a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013fba0 0x7f244013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 0x7f244008a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40198/0 (socket says 10.20.193.7:40198) 2026-02-22T20:53:00.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 -- 10.20.193.7:0/151017627 learned_addr learned my addr 10.20.193.7:0/151017627 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013fba0 0x7f244013ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51080/0 (socket says 10.20.193.7:51080) 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): get_auth_request con 0x7f244013c4b0 auth_method 0 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): get_auth_request con 0x7f244013fba0 auth_method 0 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24458d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f244013f290 0x7f244014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): get_auth_request con 0x7f244013f290 auth_method 0 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24448d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient(hunting): handle_auth_done global_id 4755 payload 824 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013fba0 msgr2=0x7f244013ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f244013fba0 0x7f244013ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f244013f290 msgr2=0x7f244014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f244013f290 0x7f244014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.461+0000 7f24450d4640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244012ceb0 con 0x7f244013c4b0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24450d4640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 0x7f244008a150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2430009430 tx=0x7f243000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430017070 con 0x7f244013c4b0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: dump: 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.488 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243000c940 con 0x7f244013c4b0 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243000cd30 con 0x7f244013c4b0 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: dump: 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.490 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242f7fe640 4 set_mon_vals no callback set 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 5 monclient: authenticate success, global_id 4755 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 monclient: _renew_subs 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244012c500 con 0x7f244013c4b0 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 monclient: _renew_subs 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2440150400 con 0x7f244013c4b0 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 0x7f244012a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f244013f660 con 0x7f244013bfb0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 0x7f244012a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient: get_auth_request con 0x7f244013bfb0 auth_method 0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2430013470 con 0x7f244013c4b0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 10 monclient(hunting): handle_auth_done global_id 4758 payload 824 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24400008e0 con 0x7f244013bfb0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24448d3640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 0x7f244012a610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2434004780 tx=0x7f243401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 --2- 10.20.193.7:0/151017627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f241003ab20 0x7f241005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7f243004ef10 con 0x7f244013c4b0 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340b9070 con 0x7f244013bfb0 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: dump: 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.493 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24458d5640 1 --2- 10.20.193.7:0/151017627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f241003ab20 0x7f241005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24458d5640 10 monclient: get_auth_request con 0x7f241003ab20 auth_method 0 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f24340aba80 con 0x7f244013bfb0 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 msgr2=0x7f244012a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 0x7f244012a610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2434004780 tx=0x7f243401ad20 comp rx=0 tx=0).stop 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 msgr2=0x7f244012a610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f242dffb640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013bfb0 0x7f244012a610 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2434004780 tx=0x7f243401ad20 comp rx=0 tx=0).stop 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.465+0000 7f24458d5640 1 --2- 10.20.193.7:0/151017627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f241003ab20 0x7f241005afd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f244012b8e0 tx=0x7f243c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 0x7f244008aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f244012ac90 con 0x7f244008abf0 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 0x7f244008aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient: get_auth_request con 0x7f244008abf0 auth_method 0 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 10 monclient(hunting): handle_auth_done global_id 4761 payload 824 2026-02-22T20:53:00.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 1 -- 10.20.193.7:0/151017627 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f244008b530 con 0x7f244008abf0 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24448d3640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 0x7f244008aff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f243401cd20 tx=0x7f2434019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340b9040 con 0x7f244008abf0 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 10 monclient: dump: 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.496 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5049 (secure 0 0 0) 0x7f24340bd400 con 0x7f244008abf0 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 msgr2=0x7f244008aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 0x7f244008aff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f243401cd20 tx=0x7f2434019280 comp rx=0 tx=0).stop 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 msgr2=0x7f244008aff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f242dffb640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244008abf0 0x7f244008aff0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f243401cd20 tx=0x7f2434019280 comp rx=0 tx=0).stop 2026-02-22T20:53:00.497 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 59598, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.498 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.499 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.500 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:00.501 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.502 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.503 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.504 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.505 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.506 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.507 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.508 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.509 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:00.509 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f241003ab20 msgr2=0x7f241005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 --2- 10.20.193.7:0/151017627 >> v2:10.20.193.61:6800/2336688312 conn(0x7f241003ab20 0x7f241005afd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f244012b8e0 tx=0x7f243c00b040 comp rx=0 tx=0).stop 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 10 monclient: shutdown 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 msgr2=0x7f244008a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 --2- 10.20.193.7:0/151017627 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f244013c4b0 0x7f244008a150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2430009430 tx=0x7f243000ee10 comp rx=0 tx=0).stop 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24458d5640 1 -- 10.20.193.7:0/151017627 reap_dead start 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f24458d5640 1 -- 10.20.193.7:0/151017627 reap_dead start 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 shutdown_connections 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 >> 10.20.193.7:0/151017627 conn(0x7f2440093df0 msgr2=0x7f244008d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 shutdown_connections 2026-02-22T20:53:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.469+0000 7f244735f640 1 -- 10.20.193.7:0/151017627 wait complete. 2026-02-22T20:53:00.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:00.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:53:00.511 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:53:00.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: get_monmap_and_config 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: monmap: 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:00.582514+0000 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:00.582514+0000 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:00.582 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:00.583 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:00.583 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:00.583 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 Processor -- start 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 -- start start 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: init 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient: _add_conns ranks=[1,3,2,4,0] 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f492c08ff00 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f492c13c6c0 0x7f492c180470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-a con 0x7f492c13c6c0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-b con 0x7f492c1809b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c13cb00 con 0x7f492c08ff00 2026-02-22T20:53:00.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f492c08ea60 con 0x7f492c13c6c0 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f492c08ed40 con 0x7f492c1809b0 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f49309d0640 10 monclient(hunting): authenticate will time out at 593.055706s 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f492c13c6c0 0x7f492c180470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f492c13c6c0 0x7f492c180470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40234/0 (socket says 10.20.193.7:40234) 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51090/0 (socket says 10.20.193.7:51090) 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 1 -- 10.20.193.7:0/4158511060 learned_addr learned my addr 10.20.193.7:0/4158511060 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): get_auth_request con 0x7f492c13c6c0 auth_method 0 2026-02-22T20:53:00.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): get_auth_request con 0x7f492c1809b0 auth_method 0 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.577+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient(hunting): handle_auth_done global_id 4764 payload 274 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 -- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 msgr2=0x7f492c1a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 -- 10.20.193.7:0/4158511060 >> v1:10.20.193.61:6789/0 conn(0x7f492c08ff00 legacy=0x7f492c13bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 -- 10.20.193.7:0/4158511060 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c08f020 con 0x7f492c13c6c0 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:53:00.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c13c6c0 0x7f492c180470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f49140090a0 tx=0x7f491401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47f21671ada12b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 1 -- 10.20.193.7:0/4158511060 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49140aa680 con 0x7f492c13c6c0 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: dump: 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.597 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 1 -- 10.20.193.7:0/4158511060 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49140af070 con 0x7f492c13c6c0 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 1 -- 10.20.193.7:0/4158511060 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49140aaa40 con 0x7f492c13c6c0 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 5 monclient: authenticate success, global_id 4764 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 4 set_mon_vals no callback set 2026-02-22T20:53:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929573640 10 monclient: dump: 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: shutdown 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c13c6c0 msgr2=0x7f492c180470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c13c6c0 0x7f492c180470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f49140090a0 tx=0x7f491401c500 comp rx=0 tx=0).stop 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/4158511060 shutdown_connections 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- 10.20.193.7:0/4158511060 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c13c6c0 0x7f492c180470 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/4158511060 >> 10.20.193.7:0/4158511060 conn(0x7f492c08cf40 msgr2=0x7f492c08d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/4158511060 shutdown_connections 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/4158511060 wait complete. 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: monmap: 2026-02-22T20:53:00.600 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 Processor -- start 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- start start 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: init 2026-02-22T20:53:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 0x7f492c191410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-a con 0x7f492c08ff00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f492c13c6c0 0x7f492c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-b con 0x7f492c13c6c0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c13af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): picked mon.noname-c con 0x7f492c1809b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f492c1a3e80 con 0x7f492c08ff00 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f492c1a3d00 con 0x7f492c13c6c0 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f492c1a4000 con 0x7f492c1809b0 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient(hunting): authenticate will time out at 593.059363s 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 0x7f492c191410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 0x7f492c191410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40248/0 (socket says 10.20.193.7:40248) 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 -- 10.20.193.7:0/67110179 learned_addr learned my addr 10.20.193.7:0/67110179 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): get_auth_request con 0x7f492c08ff00 auth_method 0 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c13af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): get_auth_request con 0x7f492c1809b0 auth_method 0 2026-02-22T20:53:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f492c13c6c0 0x7f492c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient(hunting): get_auth_request con 0x7f492c13c6c0 auth_method 0 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4929d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient(hunting): handle_auth_done global_id 4767 payload 824 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 msgr2=0x7f492c13af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c1809b0 0x7f492c13af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f492c13c6c0 msgr2=0x7f492c19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f492c13c6c0 0x7f492c19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c12b610 con 0x7f492c08ff00 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f492a575640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 0x7f492c191410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f492000c520 tx=0x7f492000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920017070 con 0x7f492c08ff00 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: dump: 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 5 monclient: authenticate success, global_id 4767 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920006ad0 con 0x7f492c08ff00 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: _renew_subs 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c08a4f0 con 0x7f492c08ff00 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.581+0000 7f4912ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920007030 con 0x7f492c08ff00 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4928d72640 4 set_mon_vals no callback set 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: dump: 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 10 monclient: _renew_subs 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c12d0d0 con 0x7f492c08ff00 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4920005080 con 0x7f492c08ff00 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 0x7f492c13b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f492c13bfb0 con 0x7f492c19eaf0 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 0x7f492c13b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient: get_auth_request con 0x7f492c19eaf0 auth_method 0 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 10 monclient(hunting): handle_auth_done global_id 4610 payload 824 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f492c13b9e0 con 0x7f492c19eaf0 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 --2- 10.20.193.7:0/67110179 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48f803ab20 0x7f48f805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7f492004de30 con 0x7f492c08ff00 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4929d74640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 0x7f492c13b4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49140090a0 tx=0x7f49140192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f492ad76640 1 --2- 10.20.193.7:0/67110179 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48f803ab20 0x7f48f805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914004220 con 0x7f492c19eaf0 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: dump: 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.610 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f492ad76640 10 monclient: get_auth_request con 0x7f48f803ab20 auth_method 0 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f49140af040 con 0x7f492c19eaf0 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 msgr2=0x7f492c13b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 0x7f492c13b4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49140090a0 tx=0x7f49140192a0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 msgr2=0x7f492c13b4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f4912ffd640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c19eaf0 0x7f492c13b4a0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49140090a0 tx=0x7f49140192a0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.585+0000 7f492ad76640 1 --2- 10.20.193.7:0/67110179 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48f803ab20 0x7f48f805afd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f491c004b00 tx=0x7f491c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 0x7f492c19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f492c12c170 con 0x7f492c12a3a0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 0x7f492c19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient: get_auth_request con 0x7f492c12a3a0 auth_method 0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 10 monclient(hunting): handle_auth_done global_id 4613 payload 824 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 1 -- 10.20.193.7:0/67110179 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f492c1a0830 con 0x7f492c12a3a0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4929d74640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 0x7f492c19f170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f491401a130 tx=0x7f4914009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49140c31b0 con 0x7f492c12a3a0 2026-02-22T20:53:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 10 monclient: dump: 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f49140c31b0 con 0x7f492c12a3a0 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 msgr2=0x7f492c19f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 0x7f492c19f170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f491401a130 tx=0x7f4914009300 comp rx=0 tx=0).stop 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 msgr2=0x7f492c19f170 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f4912ffd640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f492c12a3a0 0x7f492c19f170 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f491401a130 tx=0x7f4914009300 comp rx=0 tx=0).stop 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:00.614 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 59714, 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.615 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.616 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:00.617 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.618 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:00.619 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.620 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.621 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.622 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:00.623 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:00.624 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:00.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48f803ab20 msgr2=0x7f48f805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 --2- 10.20.193.7:0/67110179 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48f803ab20 0x7f48f805afd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f491c004b00 tx=0x7f491c00b040 comp rx=0 tx=0).stop 2026-02-22T20:53:00.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 10 monclient: shutdown 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 msgr2=0x7f492c191410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 --2- 10.20.193.7:0/67110179 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f492c08ff00 0x7f492c191410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f492000c520 tx=0x7f492000c9e0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f492ad76640 1 -- 10.20.193.7:0/67110179 reap_dead start 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f492ad76640 1 -- 10.20.193.7:0/67110179 reap_dead start 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 shutdown_connections 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 >> 10.20.193.7:0/67110179 conn(0x7f492c08cf40 msgr2=0x7f492c08b630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 shutdown_connections 2026-02-22T20:53:00.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.589+0000 7f49309d0640 1 -- 10.20.193.7:0/67110179 wait complete. 2026-02-22T20:53:00.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:00.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:53:00.627 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:53:00.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: get_monmap_and_config 2026-02-22T20:53:00.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: monmap: 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:00.690589+0000 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:00.690589+0000 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.691 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 Processor -- start 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 -- start start 2026-02-22T20:53:00.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: init 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f77a013f290 0x7f77a013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-c con 0x7f77a013f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f77a013fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f77a013c680 0x7f77a01a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-a con 0x7f77a013c680 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a008fd70 con 0x7f77a013fba0 2026-02-22T20:53:00.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f77a008e1f0 con 0x7f77a013c680 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f77a008ec90 con 0x7f77a013f290 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a8774640 10 monclient(hunting): authenticate will time out at 593.163738s 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f77a013c680 0x7f77a01a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a64e9640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f77a013f290 0x7f77a013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f77a013c680 0x7f77a01a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40250/0 (socket says 10.20.193.7:40250) 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 1 -- 10.20.193.7:0/41874855 learned_addr learned my addr 10.20.193.7:0/41874855 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): get_auth_request con 0x7f77a013c680 auth_method 0 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a64e9640 10 monclient(hunting): get_auth_request con 0x7f77a013f290 auth_method 0 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a64e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a64e9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a64e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.685+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): handle_auth_done global_id 4770 payload 274 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 -- 10.20.193.7:0/41874855 >> v2:10.20.193.61:3300/0 conn(0x7f77a013f290 msgr2=0x7f77a013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 --2- 10.20.193.7:0/41874855 >> v2:10.20.193.61:3300/0 conn(0x7f77a013f290 0x7f77a013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 -- 10.20.193.7:0/41874855 >> v1:10.20.193.61:6789/0 conn(0x7f77a013fba0 legacy=0x7f77a013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 -- 10.20.193.7:0/41874855 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a0092bc0 con 0x7f77a013c680 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 --2- 10.20.193.7:0/41874855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a01a17e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77a00947c0 tx=0x7f779c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67a98627b6d3c57 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 1 -- 10.20.193.7:0/41874855 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c0b2070 con 0x7f77a013c680 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: dump: 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.708 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 1 -- 10.20.193.7:0/41874855 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c0a5940 con 0x7f77a013c680 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 5 monclient: authenticate success, global_id 4770 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 1 -- 10.20.193.7:0/41874855 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c0a5d30 con 0x7f77a013c680 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a54e7640 10 monclient: dump: 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 4 set_mon_vals no callback set 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: shutdown 2026-02-22T20:53:00.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/41874855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 msgr2=0x7f77a01a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- 10.20.193.7:0/41874855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a01a17e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77a00947c0 tx=0x7f779c01c880 comp rx=0 tx=0).stop 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/41874855 shutdown_connections 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- 10.20.193.7:0/41874855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a01a17e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- 10.20.193.7:0/41874855 >> v2:10.20.193.61:3300/0 conn(0x7f77a013f290 0x7f77a013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/41874855 >> 10.20.193.7:0/41874855 conn(0x7f77a0093df0 msgr2=0x7f77a00902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/41874855 shutdown_connections 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/41874855 wait complete. 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: monmap: 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.711 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 Processor -- start 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- start start 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: init 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a012c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-a con 0x7f77a013c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a013f290 0x7f77a0129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-b con 0x7f77a013f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f77a013fba0 0x7f77a012a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): picked mon.noname-c con 0x7f77a013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0090de0 con 0x7f77a013c680 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0090c60 con 0x7f77a013f290 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f77a01a4540 con 0x7f77a013fba0 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): authenticate will time out at 593.166465s 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a012c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a012c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40260/0 (socket says 10.20.193.7:40260) 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 -- 10.20.193.7:0/325448957 learned_addr learned my addr 10.20.193.7:0/325448957 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): get_auth_request con 0x7f77a013c680 auth_method 0 2026-02-22T20:53:00.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f77a013fba0 0x7f77a012a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): get_auth_request con 0x7f77a013fba0 auth_method 0 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a013f290 0x7f77a0129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a6cea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): get_auth_request con 0x7f77a013f290 auth_method 0 2026-02-22T20:53:00.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient(hunting): handle_auth_done global_id 4773 payload 824 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f77a013fba0 msgr2=0x7f77a012a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f77a013fba0 0x7f77a012a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a013f290 msgr2=0x7f77a0129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a013f290 0x7f77a0129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a013c340 con 0x7f77a013c680 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a64e9640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a012c170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7790009430 tx=0x7f779000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790017070 con 0x7f77a013c680 2026-02-22T20:53:00.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: dump: 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779000c940 con 0x7f77a013c680 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 5 monclient: authenticate success, global_id 4773 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _renew_subs 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a012d3b0 con 0x7f77a013c680 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779000cd30 con 0x7f77a013c680 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 10 monclient: dump: 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.717 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a4ce6640 4 set_mon_vals no callback set 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _renew_subs 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a012b610 con 0x7f77a013c680 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 0x7f77a00886e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f77a012aca0 con 0x7f77a012a8d0 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 0x7f77a00886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient: get_auth_request con 0x7f77a012a8d0 auth_method 0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7790013470 con 0x7f77a013c680 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 --2- 10.20.193.7:0/325448957 >> v2:10.20.193.61:6800/2336688312 conn(0x7f777003ab20 0x7f777005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_done global_id 34144 payload 824 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.689+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7f779004ef50 con 0x7f77a013c680 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f77a5ce8640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77a013f660 con 0x7f77a012a8d0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f77a6cea640 1 --2- 10.20.193.7:0/325448957 >> v2:10.20.193.61:6800/2336688312 conn(0x7f777003ab20 0x7f777005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f77a6cea640 10 monclient: get_auth_request con 0x7f777003ab20 auth_method 0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f77a5ce8640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 0x7f77a00886e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f779400e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794002ba0 con 0x7f77a012a8d0 2026-02-22T20:53:00.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 10 monclient: dump: 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f77a6cea640 1 --2- 10.20.193.7:0/325448957 >> v2:10.20.193.61:6800/2336688312 conn(0x7f777003ab20 0x7f777005afd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f779c009c00 tx=0x7f779c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f7794002ba0 con 0x7f77a012a8d0 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 msgr2=0x7f77a00886e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 0x7f77a00886e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f779400e960 comp rx=0 tx=0).stop 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 msgr2=0x7f77a00886e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.693+0000 7f7786ffd640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a012a8d0 0x7f77a00886e0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f779400e960 comp rx=0 tx=0).stop 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 0x7f77a0089020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0089560 con 0x7f77a0088c20 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 0x7f77a0089020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient: get_auth_request con 0x7f77a0088c20 auth_method 0 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 10 monclient(hunting): handle_auth_done global_id 34147 payload 824 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 1 -- 10.20.193.7:0/325448957 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77a012d8d0 con 0x7f77a0088c20 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a5ce8640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 0x7f77a0089020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f77940026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77940040d0 con 0x7f77a0088c20 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 10 monclient: dump: 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.722 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7f77940040d0 con 0x7f77a0088c20 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 msgr2=0x7f77a0089020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 0x7f77a0089020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f77940026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 msgr2=0x7f77a0089020 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f7786ffd640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f77a0088c20 0x7f77a0089020 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f77a012c100 tx=0x7f77940026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:00.723 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 10, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 5915, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.724 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.725 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:00.726 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:00.727 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.728 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:00.730 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.731 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:00.732 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 >> v2:10.20.193.61:6800/2336688312 conn(0x7f777003ab20 msgr2=0x7f777005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 --2- 10.20.193.7:0/325448957 >> v2:10.20.193.61:6800/2336688312 conn(0x7f777003ab20 0x7f777005afd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f779c009c00 tx=0x7f779c0a7070 comp rx=0 tx=0).stop 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 10 monclient: shutdown 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 msgr2=0x7f77a012c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 --2- 10.20.193.7:0/325448957 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f77a013c680 0x7f77a012c170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7790009430 tx=0x7f779000ee10 comp rx=0 tx=0).stop 2026-02-22T20:53:00.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a6cea640 1 -- 10.20.193.7:0/325448957 reap_dead start 2026-02-22T20:53:00.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a6cea640 1 -- 10.20.193.7:0/325448957 reap_dead start 2026-02-22T20:53:00.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 shutdown_connections 2026-02-22T20:53:00.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 >> 10.20.193.7:0/325448957 conn(0x7f77a0093df0 msgr2=0x7f77a0055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 shutdown_connections 2026-02-22T20:53:00.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.697+0000 7f77a8774640 1 -- 10.20.193.7:0/325448957 wait complete. 2026-02-22T20:53:00.734 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:00.734 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-22T20:53:00.734 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:53:00.734 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-22T20:53:00.734 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-22T20:53:00.734 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T20:53:00.735 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:53:00.743 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T20:53:00.744 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:53:00.744 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: get_monmap_and_config 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: monmap: 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:00.812528+0000 2026-02-22T20:53:00.811 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:00.812528+0000 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:00.812 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 Processor -- start 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- start start 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: init 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fea8813f780 0x7fea8813fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-a con 0x7fea8813f780 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fea88055a70 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 0x7fea881a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-c con 0x7fea880565b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea88091820 con 0x7fea88055a70 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fea8813f110 con 0x7fea8813f780 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fea88087300 con 0x7fea880565b0 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient(hunting): authenticate will time out at 593.285520s 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fea8813f780 0x7fea8813fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea877fe640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fea88055a70 legacy=0x7fea88055ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8cd41640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 msgr2=0x7fea881a1450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8cd41640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 0x7fea881a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fea8813f780 0x7fea8813fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40266/0 (socket says 10.20.193.7:40266) 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 -- 10.20.193.7:0/643058063 learned_addr learned my addr 10.20.193.7:0/643058063 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): get_auth_request con 0x7fea8813f780 auth_method 0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient(hunting): handle_auth_done global_id 4776 payload 274 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 -- 10.20.193.7:0/643058063 >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 msgr2=0x7fea881a1450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 --2- 10.20.193.7:0/643058063 >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 0x7fea881a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 -- 10.20.193.7:0/643058063 >> v1:10.20.193.61:6789/0 conn(0x7fea88055a70 legacy=0x7fea88055ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 -- 10.20.193.7:0/643058063 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea88091b00 con 0x7fea8813f780 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea87fff640 1 --2- 10.20.193.7:0/643058063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea8813f780 0x7fea8813fb50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea88087500 tx=0x7fea7401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122fa9f425bf50d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 1 -- 10.20.193.7:0/643058063 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740a6040 con 0x7fea8813f780 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: dump: 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.819 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 1 -- 10.20.193.7:0/643058063 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea740af070 con 0x7fea8813f780 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 1 -- 10.20.193.7:0/643058063 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740aa860 con 0x7fea8813f780 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 5 monclient: authenticate success, global_id 4776 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 4 set_mon_vals no callback set 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea86ffd640 10 monclient: dump: 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.820 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 10 monclient: shutdown 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- 10.20.193.7:0/643058063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea8813f780 msgr2=0x7fea8813fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 --2- 10.20.193.7:0/643058063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea8813f780 0x7fea8813fb50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea88087500 tx=0x7fea7401c500 comp rx=0 tx=0).stop 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- 10.20.193.7:0/643058063 shutdown_connections 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 --2- 10.20.193.7:0/643058063 >> v2:10.20.193.61:3300/0 conn(0x7fea880565b0 0x7fea881a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 --2- 10.20.193.7:0/643058063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea8813f780 0x7fea8813fb50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- 10.20.193.7:0/643058063 >> 10.20.193.7:0/643058063 conn(0x7fea880906f0 msgr2=0x7fea88090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- 10.20.193.7:0/643058063 shutdown_connections 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.809+0000 7fea8d542640 1 -- 10.20.193.7:0/643058063 wait complete. 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: build_initial_monmap 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: monmap: 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 Processor -- start 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- start start 2026-02-22T20:53:00.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: init 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-a con 0x7fea88055a70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 0x7fea8812cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-b con 0x7fea880565b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fea8813f780 0x7fea8812d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): picked mon.noname-c con 0x7fea8813f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fea881a4540 con 0x7fea88055a70 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fea881a43c0 con 0x7fea880565b0 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fea881a46c0 con 0x7fea8813f780 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient(hunting): authenticate will time out at 593.289077s 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea877fe640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 msgr2=0x7fea8812cf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40268/0 (socket says 10.20.193.7:40268) 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 -- 10.20.193.7:0/2277105305 learned_addr learned my addr 10.20.193.7:0/2277105305 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): get_auth_request con 0x7fea88055a70 auth_method 0 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea877fe640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 0x7fea8812cf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fea8813f780 0x7fea8812d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): get_auth_request con 0x7fea8813f780 auth_method 0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8cd41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient(hunting): handle_auth_done global_id 4779 payload 824 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 -- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fea8813f780 msgr2=0x7fea8812d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fea8813f780 0x7fea8812d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 -- 10.20.193.7:0/2277105305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 msgr2=0x7fea8812cf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 0x7fea8812cf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 monclient: found mon.noname-a 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 -- 10.20.193.7:0/2277105305 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea88130b10 con 0x7fea88055a70 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea87fff640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea7401abb0 tx=0x7fea7401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740bd3f0 con 0x7fea88055a70 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: dump: 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.823 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: _finish_auth 0 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea740bd590 con 0x7fea88055a70 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740bd940 con 0x7fea88055a70 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea867fc640 4 set_mon_vals no callback set 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 10 monclient: dump: 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:00.824 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 5 monclient: authenticate success, global_id 4779 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _renew_subs 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea88130660 con 0x7fea88055a70 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _renew_subs 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea881300a0 con 0x7fea88055a70 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8813fb50 con 0x7fea88055a70 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fea740c6430 con 0x7fea88055a70 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 --2- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 0x7fea5805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7fea740e8fc0 con 0x7fea88055a70 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea877fe640 1 --2- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 0x7fea5805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea877fe640 10 monclient: get_auth_request con 0x7fea5803aa90 auth_method 0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.813+0000 7fea877fe640 1 --2- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 0x7fea5805af40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea880573e0 tx=0x7fea780092b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:00.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.817+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fea74016210 con 0x7fea88055a70 2026-02-22T20:53:00.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.817+0000 7fea84ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:00.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.817+0000 7fea84ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:00.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea8d542640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:00.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea8d542640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea8d542640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fea88088280 con 0x7fea88055a70 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea84ff9640 1 -- 10.20.193.7:0/2277105305 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fea740c0940 con 0x7fea88055a70 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea84ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.925+0000 7fea84ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:00.931 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 msgr2=0x7fea5805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 0x7fea5805af40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea880573e0 tx=0x7fea780092b0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 10 monclient: shutdown 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 msgr2=0x7fea8812ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea7401abb0 tx=0x7fea7401ad40 comp rx=0 tx=0).stop 2026-02-22T20:53:00.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 shutdown_connections 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fea8813f780 0x7fea8812d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> v2:10.20.193.61:6800/2336688312 conn(0x7fea5803aa90 0x7fea5805af40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fea880565b0 0x7fea8812cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 --2- 10.20.193.7:0/2277105305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fea88055a70 0x7fea8812ca40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 >> 10.20.193.7:0/2277105305 conn(0x7fea880906f0 msgr2=0x7fea8808f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 shutdown_connections 2026-02-22T20:53:00.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:00.929+0000 7fea8d542640 1 -- 10.20.193.7:0/2277105305 wait complete. 2026-02-22T20:53:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:53:01] 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:53:01 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.780488 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Some PGs (0.780488) are unknown; try again later 2026-02-22T20:53:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:53:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:53:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:53:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "ceph_test_rados_delete_pools_parallel.trial061-18959": { 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": {}, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:58.978542+0000", 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:53:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 32769, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,creating", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "45", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 32, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 32, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 32, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 32, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 32, 2026-02-22T20:53:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 12, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "ceph_test_rados_delete_pools_parallel.trial061-18959", 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 1.690000057220459, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 1.690000057220459, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 1.690000057220459, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 1.690000057220459, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:53:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:53:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:53:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1, -1] pools [1, 2, 12] with 6 osds, pg_target 600 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'ceph_test_rados_delete_pools_parallel.trial061-18959' root_id -1 using 0.0 of space, bias 1.0, pg target 0.0 quantized to 32 (current 32) 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:53:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:03.941 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:04.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 10 monclient: get_monmap_and_config 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 10 monclient: build_initial_monmap 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 10 monclient: monmap: 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:04.011244+0000 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:04.011244+0000 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:04.018 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 1 Processor -- start 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 1 -- start start 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.005+0000 7f680a98a640 10 monclient: init 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f680408fd60 0x7f680413ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-b con 0x7f680408fd60 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:04.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f680413b0b0 0x7f680413b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-a con 0x7f680413b0b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 0x7f6804039370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-c con 0x7f6804038f20 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f680413b9c0 con 0x7f680413b0b0 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f680408e9e0 con 0x7f6804038f20 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f680408ec50 con 0x7f680408fd60 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): authenticate will time out at 596.484137s 2026-02-22T20:53:04.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f680413b0b0 0x7f680413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 msgr2=0x7f6804039370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f680408fd60 0x7f680413ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f680413b0b0 0x7f680413b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40272/0 (socket says 10.20.193.7:40272) 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 0x7f6804039370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 -- 10.20.193.7:0/2697753796 learned_addr learned my addr 10.20.193.7:0/2697753796 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): get_auth_request con 0x7f680413b0b0 auth_method 0 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): get_auth_request con 0x7f680408fd60 auth_method 0 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:04.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient(hunting): handle_auth_done global_id 4782 payload 274 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 -- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f680408fd60 msgr2=0x7f680413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f680408fd60 0x7f680413ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 -- 10.20.193.7:0/2697753796 >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 msgr2=0x7f6804039370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- 10.20.193.7:0/2697753796 >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 0x7f6804039370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient: _finish_hunting 0 2026-02-22T20:53:04.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 monclient: found mon.noname-a 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 -- 10.20.193.7:0/2697753796 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680408ef30 con 0x7f680413b0b0 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680413b480 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6804091460 tx=0x7f67f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662df0a70b82755 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 1 -- 10.20.193.7:0/2697753796 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f40ac630 con 0x7f680413b0b0 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: dump: 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.023 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 1 -- 10.20.193.7:0/2697753796 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f40ac7d0 con 0x7f680413b0b0 2026-02-22T20:53:04.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 1 -- 10.20.193.7:0/2697753796 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f40acba0 con 0x7f680413b0b0 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6802ffd640 10 monclient: dump: 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:04.025 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 5 monclient: authenticate success, global_id 4782 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 4 set_mon_vals no callback set 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: shutdown 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 msgr2=0x7f680413b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680413b480 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6804091460 tx=0x7f67f401c510 comp rx=0 tx=0).stop 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/2697753796 shutdown_connections 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- 10.20.193.7:0/2697753796 >> v2:10.20.193.61:3300/0 conn(0x7f6804038f20 0x7f6804039370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680413b480 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- 10.20.193.7:0/2697753796 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f680408fd60 0x7f680413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/2697753796 >> 10.20.193.7:0/2697753796 conn(0x7f680408ced0 msgr2=0x7f680408d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/2697753796 shutdown_connections 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/2697753796 wait complete. 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: build_initial_monmap 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: monmap: 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:04.027 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 Processor -- start 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- start start 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: init 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-c con 0x7f6804038f20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 0x7f6804107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-b con 0x7f680408fd60 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680412a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): picked mon.noname-a con 0x7f680413b0b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68041a32d0 con 0x7f680413b0b0 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f68041a3150 con 0x7f680408fd60 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f68041a3450 con 0x7f6804038f20 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient(hunting): authenticate will time out at 596.487121s 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 msgr2=0x7f6804107ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:04.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51166/0 (socket says 10.20.193.7:51166) 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 -- 10.20.193.7:0/1542415745 learned_addr learned my addr 10.20.193.7:0/1542415745 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): get_auth_request con 0x7f6804038f20 auth_method 0 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680412a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68037fe640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 0x7f6804107ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): get_auth_request con 0x7f680413b0b0 auth_method 0 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:04.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6808f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient(hunting): handle_auth_done global_id 4625 payload 824 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 -- 10.20.193.7:0/1542415745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 msgr2=0x7f6804107ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 0x7f6804107ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 -- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 msgr2=0x7f680412a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680412a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:04.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 monclient: found mon.noname-c 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 -- 10.20.193.7:0/1542415745 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6804109ef0 con 0x7f6804038f20 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6803fff640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009430 tx=0x7f67f000ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0017070 con 0x7f6804038f20 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: dump: 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.032 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: _finish_auth 0 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f000c8e0 con 0x7f6804038f20 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f000ccd0 con 0x7f6804038f20 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:04.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f6800ff9640 10 monclient: dump: 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 5 monclient: authenticate success, global_id 4625 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f68027fc640 4 set_mon_vals no callback set 2026-02-22T20:53:04.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _renew_subs 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68040875c0 con 0x7f6804038f20 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _renew_subs 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.009+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f680410a790 con 0x7f6804038f20 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f680a98a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f680a98a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f680a98a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680413ab70 con 0x7f6804038f20 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f67f0013470 con 0x7f6804038f20 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f6800ff9640 1 --2- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 0x7f67d405af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 3897+0+0 (secure 0 0 0) 0x7f67f004ef80 con 0x7f6804038f20 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f68037fe640 1 --2- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 0x7f67d405af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:04.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f68037fe640 10 monclient: get_auth_request con 0x7f67d403aa80 auth_method 0 2026-02-22T20:53:04.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.013+0000 7f68037fe640 1 --2- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 0x7f67d405af30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67f4006d40 tx=0x7f67f40a6070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:04.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.017+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f6804109ef0 con 0x7f6804038f20 2026-02-22T20:53:04.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.017+0000 7f6800ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:04.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.017+0000 7f6800ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:04.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f680a98a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:04.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f680a98a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:04.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f680a98a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:04.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f680405fd60 con 0x7f6804038f20 2026-02-22T20:53:04.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f6800ff9640 1 -- 10.20.193.7:0/1542415745 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f67f004be20 con 0x7f6804038f20 2026-02-22T20:53:04.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f6800ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:04.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.125+0000 7f6800ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:04.131 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 msgr2=0x7f67d405af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 0x7f67d405af30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67f4006d40 tx=0x7f67f40a6070 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 10 monclient: shutdown 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 msgr2=0x7f6804106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009430 tx=0x7f67f000ee10 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 shutdown_connections 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f680413b0b0 0x7f680412a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f67d403aa80 0x7f67d405af30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f680408fd60 0x7f6804107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 --2- 10.20.193.7:0/1542415745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6804038f20 0x7f6804106f30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:04.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 >> 10.20.193.7:0/1542415745 conn(0x7f680408ced0 msgr2=0x7f680411fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:04.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 shutdown_connections 2026-02-22T20:53:04.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:04.129+0000 7f680a98a640 1 -- 10.20.193.7:0/1542415745 wait complete. 2026-02-22T20:53:06.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:06.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:07.141 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: get_monmap_and_config 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: build_initial_monmap 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: monmap: 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:07.213313+0000 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:07.213313+0000 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:07.212 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:07.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 Processor -- start 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 -- start start 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: init 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6f1c13f430 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6f1c057850 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-c con 0x7f6f1c181c10 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c08d840 con 0x7f6f1c057850 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c055c10 con 0x7f6f1c13f430 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1c08db20 con 0x7f6f1c181c10 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f20c50640 10 monclient(hunting): authenticate will time out at 599.686206s 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f1ad76640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 msgr2=0x7f6f1c1a1ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f1a575640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f6f1c13f430 legacy=0x7f6f1c057140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f19d74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f6f1c057850 0x7f6f1c1804f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:44982/0 (socket says 10.20.193.7:44982) 2026-02-22T20:53:07.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:07.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.209+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 learned_addr learned my addr 10.20.193.7:0/2445166604 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:07.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.413+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 msgr2=0x7f6f1c1a1ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:07.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.413+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6f1c13f430 legacy=0x7f6f1c057140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:07.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.413+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:07.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.817+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6f1c13f430 legacy=0x7f6f1c057140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:07.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.817+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 msgr2=0x7f6f1c1a1ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:07.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:07.817+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:08.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:08.621+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 msgr2=0x7f6f1c1a1ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:08.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:08.621+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:08.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:08.621+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6f1c13f430 legacy=0x7f6f1c057140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): tick 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 msgr2=0x7f6f1c1a1ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6f1c181c10 0x7f6f1c1a1ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:10.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6f1c13f430 legacy=0x7f6f1c057140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.7:6789/0 conn(0x7f6f1c057850 legacy=0x7f6f1c1804f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient: _add_conns ranks=[3,2] 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-a con 0x7f6ef80037c0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-b con 0x7f6ef80242c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1c08db20 con 0x7f6ef80037c0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef8044e30 con 0x7f6ef80242c0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f03fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 10 monclient(hunting): get_auth_request con 0x7f6ef80037c0 auth_method 0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80242c0 auth_method 0 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:10.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.209+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 10 monclient(hunting): get_auth_request con 0x7f6ef80037c0 auth_method 0 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80242c0 auth_method 0 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:10.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.413+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:10.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 10 monclient(hunting): get_auth_request con 0x7f6ef80037c0 auth_method 0 2026-02-22T20:53:10.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80242c0 auth_method 0 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:10.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:10.817+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 10 monclient(hunting): get_auth_request con 0x7f6ef80037c0 auth_method 0 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:11.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80242c0 auth_method 0 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:11.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:11.621+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:11.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:11.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): tick 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 msgr2=0x7f6ef8044750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:13.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80242c0 0x7f6ef8044750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 msgr2=0x7f6ef8023c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef80037c0 0x7f6ef8023c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 reap_dead start 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6ef8024740 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-b con 0x7f6ef80052b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-c con 0x7f6ef8005ca0 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c13f800 con 0x7f6ef8024740 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1c08db20 con 0x7f6ef8005ca0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef8044e30 con 0x7f6ef80052b0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f03fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6ef8024740 legacy=0x7f6ef8003b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 msgr2=0x7f6ef8006140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80052b0 auth_method 0 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:13.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.213+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:13.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6ef8024740 legacy=0x7f6ef8003b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 msgr2=0x7f6ef8006140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80052b0 auth_method 0 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:13.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:13.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:13.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:13.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.417+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:13.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80052b0 auth_method 0 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6ef8024740 legacy=0x7f6ef8003b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 msgr2=0x7f6ef8006140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:13.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:13.821+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6ef80052b0 auth_method 0 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6ef8024740 legacy=0x7f6ef8003b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 msgr2=0x7f6ef8006140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:14.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:14.624+0000 7f6f1ad76640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:15.033 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:15.033 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: starting. 2026-02-22T20:53:15.033 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: creating pool ceph_test_rados_delete_pools_parallel.trial061-18959 2026-02-22T20:53:15.033 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: created object 0... 2026-02-22T20:53:15.034 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: created object 25... 2026-02-22T20:53:15.034 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: created object 49... 2026-02-22T20:53:15.034 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: finishing. 2026-02-22T20:53:15.034 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[18995]: shutting down. 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: starting. 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: listing objects. 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: listed object 0... 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: listed object 25... 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: saw 50 objects 2026-02-22T20:53:15.045 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[18997]: shutting down. 2026-02-22T20:53:15.887 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:15.887 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18996]: starting. 2026-02-22T20:53:15.887 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18996]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-18959 2026-02-22T20:53:15.887 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[18996]: shutting down. 2026-02-22T20:53:15.889 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:15.889 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:15.889 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:53:15.891 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:53:16.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): tick 2026-02-22T20:53:16.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:16.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:16.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 msgr2=0x7f6ef8005700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6ef80052b0 0x7f6ef8005700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 msgr2=0x7f6ef8006140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.61:3300/0 conn(0x7f6ef8005ca0 0x7f6ef8006140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.61:6789/0 conn(0x7f6ef8024740 legacy=0x7f6ef8003b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient: _add_conns ranks=[3,0] 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef8006840 0x7f6ef8006c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-a con 0x7f6ef8006840 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6ef8007310 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c055c10 con 0x7f6ef8007310 2026-02-22T20:53:16.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 1 -- 10.20.193.7:0/2445166604 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1c08db20 con 0x7f6ef8006840 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f03fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> v2:10.20.193.7:3300/0 conn(0x7f6ef8006840 0x7f6ef8006c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): get_auth_request con 0x7f6ef8006840 auth_method 0 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 1 -- 10.20.193.7:0/2445166604 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915014934 0 0) 0x7f6f1c055c10 con 0x7f6ef8007310 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 10 monclient(hunting): _negotiate 2026-02-22T20:53:16.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 10 monclient(hunting): my global_id is 4809 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f19573640 1 -- 10.20.193.7:0/2445166604 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003620 con 0x7f6ef8007310 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient(hunting): handle_auth_done global_id 4806 payload 274 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 >> v1:10.20.193.7:6789/0 conn(0x7f6ef8007310 legacy=0x7f6ef8007a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 1 monclient: found mon.noname-a 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:16.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.208+0000 7f6f1a575640 1 -- 10.20.193.7:0/2445166604 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c13f800 con 0x7f6ef8006840 2026-02-22T20:53:16.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6ef8006840 0x7f6ef8006c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f100039b0 tx=0x7f6f1001db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863032a673dc2cd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 1 -- 10.20.193.7:0/2445166604 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100a7670 con 0x7f6ef8006840 2026-02-22T20:53:16.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:16.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: dump: 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 1 -- 10.20.193.7:0/2445166604 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f100a7810 con 0x7f6ef8006840 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 1 -- 10.20.193.7:0/2445166604 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100a7be0 con 0x7f6ef8006840 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f19573640 10 monclient: dump: 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.226 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 5 monclient: authenticate success, global_id 4806 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 4 set_mon_vals no callback set 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 10 monclient: shutdown 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6ef8006840 msgr2=0x7f6ef8006c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6ef8006840 0x7f6ef8006c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f100039b0 tx=0x7f6f1001db70 comp rx=0 tx=0).stop 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f1ad76640 1 -- 10.20.193.7:0/2445166604 reap_dead start 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- 10.20.193.7:0/2445166604 shutdown_connections 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2445166604 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6ef8006840 0x7f6ef8006c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- 10.20.193.7:0/2445166604 >> 10.20.193.7:0/2445166604 conn(0x7f6f1c091690 msgr2=0x7f6f1c091a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- 10.20.193.7:0/2445166604 shutdown_connections 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- 10.20.193.7:0/2445166604 wait complete. 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 10 monclient: build_initial_monmap 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 10 monclient: monmap: 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:16.228 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 Processor -- start 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 1 -- start start 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.212+0000 7f6f20c50640 10 monclient: init 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:53:16.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 0x7f6f1c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-b con 0x7f6ef8006840 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-c con 0x7f6f1c13e370 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f1c12d0c0 0x7f6f1c12d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): picked mon.noname-a con 0x7f6f1c12d0c0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0903c0 con 0x7f6f1c12d0c0 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c090240 con 0x7f6ef8006840 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1c090540 con 0x7f6f1c13e370 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient(hunting): authenticate will time out at 608.692420s 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1a575640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 msgr2=0x7f6f1c152c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1a575640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 0x7f6f1c152c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:52892/0 (socket says 10.20.193.7:52892) 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 -- 10.20.193.7:0/2270922541 learned_addr learned my addr 10.20.193.7:0/2270922541 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f1c12d0c0 0x7f6f1c12d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): get_auth_request con 0x7f6f1c13e370 auth_method 0 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): get_auth_request con 0x7f6f1c12d0c0 auth_method 0 2026-02-22T20:53:16.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient(hunting): handle_auth_done global_id 4637 payload 824 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 -- 10.20.193.7:0/2270922541 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 msgr2=0x7f6f1c152c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 0x7f6f1c152c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 -- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f1c12d0c0 msgr2=0x7f6f1c12d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f1c12d0c0 0x7f6f1c12d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 monclient: found mon.noname-c 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 -- 10.20.193.7:0/2270922541 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c12ea20 con 0x7f6f1c13e370 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f19d74640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f04004ed0 tx=0x7f6f04007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04018660 con 0x7f6f1c13e370 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: dump: 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.233 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f04018820 con 0x7f6f1c13e370 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04018a10 con 0x7f6f1c13e370 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 5 monclient: authenticate success, global_id 4637 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _renew_subs 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f18d72640 4 set_mon_vals no callback set 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c0879d0 con 0x7f6f1c13e370 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 10 monclient: dump: 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.235 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _renew_subs 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c130d80 con 0x7f6f1c13e370 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f6f04018bb0 con 0x7f6f1c13e370 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c1424e0 con 0x7f6f1c13e370 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 --2- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 0x7f6ee805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 3503+0+0 (secure 0 0 0) 0x7f6f0404ffa0 con 0x7f6f1c13e370 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 0x7f6ee805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1a575640 10 monclient: get_auth_request con 0x7f6ee803aa90 auth_method 0 2026-02-22T20:53:16.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.216+0000 7f6f1a575640 1 --2- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 0x7f6ee805af40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001a780 tx=0x7f6f100a8000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.220+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f6f04007ae0 con 0x7f6f1c13e370 2026-02-22T20:53:16.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.220+0000 7f6f02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.220+0000 7f6f02ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:16.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:16.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:16.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6f1c12f580 con 0x7f6f1c13e370 2026-02-22T20:53:16.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f02ffd640 1 -- 10.20.193.7:0/2270922541 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f6f040202d0 con 0x7f6f1c13e370 2026-02-22T20:53:16.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f02ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:16.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f02ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:16.336 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":14,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:16.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 msgr2=0x7f6ee805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 0x7f6ee805af40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001a780 tx=0x7f6f100a8000 comp rx=0 tx=0).stop 2026-02-22T20:53:16.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 10 monclient: shutdown 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 msgr2=0x7f6f1c13e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f04004ed0 tx=0x7f6f04007430 comp rx=0 tx=0).stop 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 shutdown_connections 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f1c12d0c0 0x7f6f1c12d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f1c13e370 0x7f6f1c13e7e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6ee803aa90 0x7f6ee805af40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 --2- 10.20.193.7:0/2270922541 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6ef8006840 0x7f6f1c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 >> 10.20.193.7:0/2270922541 conn(0x7f6f1c091690 msgr2=0x7f6f1c089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 shutdown_connections 2026-02-22T20:53:16.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.332+0000 7f6f20c50640 1 -- 10.20.193.7:0/2270922541 wait complete. 2026-02-22T20:53:16.347 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:53:16.347 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:53:16.347 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: get_monmap_and_config 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: build_initial_monmap 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: monmap: 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:16.410373+0000 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:16.410373+0000 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:16.409 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:16.410 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 Processor -- start 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 -- start start 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: init 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 0x7fc018139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-c con 0x7fc01808b590 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 0x7fc01813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-b con 0x7fc01813a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc01813d530 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc018089920 con 0x7fc01813d530 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc01808ab40 con 0x7fc01808b590 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc01808a860 con 0x7fc01813a4d0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc01d6c0640 10 monclient(hunting): authenticate will time out at 608.883494s 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc016ffd640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 msgr2=0x7fc018139f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc016ffd640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 0x7fc018139f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 0x7fc01813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0177fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc01813d530 0x7fc01819e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:60068/0 (socket says 10.20.193.7:60068) 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0177fe640 1 -- 10.20.193.7:0/289106075 learned_addr learned my addr 10.20.193.7:0/289106075 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): get_auth_request con 0x7fc01813a4d0 auth_method 0 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient(hunting): handle_auth_done global_id 4640 payload 274 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc015ffb640 1 -- 10.20.193.7:0/289106075 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294850587 0 0) 0x7fc018089920 con 0x7fc01813d530 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 -- 10.20.193.7:0/289106075 >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 msgr2=0x7fc018139f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 --2- 10.20.193.7:0/289106075 >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 0x7fc018139f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 -- 10.20.193.7:0/289106075 >> v1:10.20.193.7:6789/0 conn(0x7fc01813d530 legacy=0x7fc01819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 monclient: found mon.noname-b 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc0167fc640 1 -- 10.20.193.7:0/289106075 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc018089170 con 0x7fc01813a4d0 2026-02-22T20:53:16.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.404+0000 7fc015ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 1 --2- 10.20.193.7:0/289106075 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 0x7fc01813cff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc000004780 tx=0x7fc00001cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=810606ee614c1aaf server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 1 -- 10.20.193.7:0/289106075 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000ab600 con 0x7fc01813a4d0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: dump: 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 1 -- 10.20.193.7:0/289106075 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0000b0070 con 0x7fc01813a4d0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 1 -- 10.20.193.7:0/289106075 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000ab9c0 con 0x7fc01813a4d0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc015ffb640 10 monclient: dump: 2026-02-22T20:53:16.413 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 5 monclient: authenticate success, global_id 4640 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 4 set_mon_vals no callback set 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: shutdown 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- 10.20.193.7:0/289106075 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 msgr2=0x7fc01813cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/289106075 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 0x7fc01813cff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc000004780 tx=0x7fc00001cf50 comp rx=0 tx=0).stop 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- 10.20.193.7:0/289106075 shutdown_connections 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/289106075 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01813a4d0 0x7fc01813cff0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/289106075 >> v2:10.20.193.61:3300/0 conn(0x7fc01808b590 0x7fc018139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- 10.20.193.7:0/289106075 >> 10.20.193.7:0/289106075 conn(0x7fc01808faa0 msgr2=0x7fc01808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- 10.20.193.7:0/289106075 shutdown_connections 2026-02-22T20:53:16.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- 10.20.193.7:0/289106075 wait complete. 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: build_initial_monmap 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: monmap: 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 Processor -- start 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- start start 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: init 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-c con 0x7fc01808b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc01813a4d0 0x7fc018086a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-a con 0x7fc01813a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc01813d530 0x7fc018086f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): picked mon.noname-b con 0x7fc01813d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0181a2440 con 0x7fc01813a4d0 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc0181a22c0 con 0x7fc01813d530 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc0181a25c0 con 0x7fc01808b590 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc01d6c0640 10 monclient(hunting): authenticate will time out at 608.887661s 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc01813a4d0 0x7fc018086a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:52916/0 (socket says 10.20.193.7:52916) 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 -- 10.20.193.7:0/3039300338 learned_addr learned my addr 10.20.193.7:0/3039300338 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): get_auth_request con 0x7fc01808b590 auth_method 0 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): get_auth_request con 0x7fc01813a4d0 auth_method 0 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0177fe640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc01813d530 msgr2=0x7fc018086f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0177fe640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc01813d530 0x7fc018086f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient(hunting): handle_auth_done global_id 4643 payload 824 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc01813d530 msgr2=0x7fc018086f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc01813d530 0x7fc018086f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc01813a4d0 msgr2=0x7fc018086a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc01813a4d0 0x7fc018086a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 monclient: found mon.noname-c 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.408+0000 7fc016ffd640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01812deb0 con 0x7fc01808b590 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc016ffd640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b780 tx=0x7fc00c00bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005070 con 0x7fc01808b590 2026-02-22T20:53:16.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: dump: 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c010070 con 0x7fc01808b590 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c005410 con 0x7fc01808b590 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 5 monclient: authenticate success, global_id 4643 2026-02-22T20:53:16.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 monclient: _renew_subs 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01812d1f0 con 0x7fc01808b590 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0157fa640 4 set_mon_vals no callback set 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: dump: 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 monclient: _renew_subs 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01805c660 con 0x7fc01808b590 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 0x7fc018087870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc01813cbc0 con 0x7fc0180874a0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 0x7fc018087870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient: get_auth_request con 0x7fc0180874a0 auth_method 0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 10 monclient(hunting): handle_auth_done global_id 4821 payload 824 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc018086690 con 0x7fc0180874a0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc00c01d030 con 0x7fc01808b590 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 0x7fc018087870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc00001a120 tx=0x7fc000019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 --2- 10.20.193.7:0/3039300338 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfe403aa90 0x7fbfe405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(47..47 src has 1..47) ==== 3503+0+0 (secure 0 0 0) 0x7fc00c04dca0 con 0x7fc01808b590 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000003c60 con 0x7fc0180874a0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: dump: 2026-02-22T20:53:16.422 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0177fe640 1 --2- 10.20.193.7:0/3039300338 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfe403aa90 0x7fbfe405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fc0000b9070 con 0x7fc0180874a0 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 msgr2=0x7fc018087870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 0x7fc018087870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc00001a120 tx=0x7fc000019290 comp rx=0 tx=0).stop 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 msgr2=0x7fc018087870 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fbff77fe640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc0180874a0 0x7fc018087870 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc00001a120 tx=0x7fc000019290 comp rx=0 tx=0).stop 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0177fe640 10 monclient: get_auth_request con 0x7fbfe403aa90 auth_method 0 2026-02-22T20:53:16.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.412+0000 7fc0177fe640 1 --2- 10.20.193.7:0/3039300338 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfe403aa90 0x7fbfe405af40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc008002d20 tx=0x7fc008002ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc01d6c0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:16.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc01d6c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc018087db0 con 0x7fc018058c80 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient: get_auth_request con 0x7fc018058c80 auth_method 0 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 10 monclient(hunting): handle_auth_done global_id 4824 payload 824 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 -- 10.20.193.7:0/3039300338 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc01805fc70 con 0x7fc018058c80 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 msgr2=0x7fc018059080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 msgr2=0x7fc018059080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fc00001a120 tx=0x7fc0000a7000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:16.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.416+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: get_auth_request con 0x7fc018058c80 auth_method 0 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: _init_auth method 2 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: _init_auth already have auth, reseting 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: handle_auth_reply_more payload 9 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 10 monclient: handle_auth_done global_id 4824 payload 293 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0167fc640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc000004780 tx=0x7fc000007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000003c60 con 0x7fc018058c80 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 10 monclient: dump: 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5038 (secure 0 0 0) 0x7fc0000b0040 con 0x7fc018058c80 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 msgr2=0x7fc018059080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc000004780 tx=0x7fc000007000 comp rx=0 tx=0).stop 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 msgr2=0x7fc018059080 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fbff77fe640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc018058c80 0x7fc018059080 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc000004780 tx=0x7fc000007000 comp rx=0 tx=0).stop 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 14, 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 75750, 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:16.625 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.626 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.627 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.629 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.630 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfe403aa90 msgr2=0x7fbfe405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/3039300338 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfe403aa90 0x7fbfe405af40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc008002d20 tx=0x7fc008002ed0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 10 monclient: shutdown 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 msgr2=0x7fc018150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b780 tx=0x7fc00c00bc40 comp rx=0 tx=0).stop 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc0177fe640 1 -- 10.20.193.7:0/3039300338 reap_dead start 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 shutdown_connections 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 --2- 10.20.193.7:0/3039300338 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc01808b590 0x7fc018150860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 >> 10.20.193.7:0/3039300338 conn(0x7fc01808faa0 msgr2=0x7fc01805cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 shutdown_connections 2026-02-22T20:53:16.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.620+0000 7fc01d6c0640 1 -- 10.20.193.7:0/3039300338 wait complete. 2026-02-22T20:53:16.637 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:53:16.637 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:53:16.637 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:53:16.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: get_monmap_and_config 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: build_initial_monmap 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: monmap: 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:16.707972+0000 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:16.707972+0000 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:16.707 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 Processor -- start 2026-02-22T20:53:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- start start 2026-02-22T20:53:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: init 2026-02-22T20:53:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:16.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1f0813d8b0 0x7f1f08139f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-a con 0x7f1f0813d8b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 0x7f1f08038f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-c con 0x7f1f0813a460 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1f08039460 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f08086ea0 con 0x7f1f08039460 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0808e3e0 con 0x7f1f0813d8b0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0808e6c0 con 0x7f1f0813a460 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient(hunting): authenticate will time out at 609.181119s 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f067fc640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 msgr2=0x7f1f08038f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f067fc640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 0x7f1f08038f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f077fe640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f1f08039460 legacy=0x7f1f0819e220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1f0813d8b0 0x7f1f08139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1f0813d8b0 0x7f1f08139f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:58450/0 (socket says 10.20.193.7:58450) 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 -- 10.20.193.7:0/2735705349 learned_addr learned my addr 10.20.193.7:0/2735705349 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): get_auth_request con 0x7f1f0813d8b0 auth_method 0 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_done global_id 4827 payload 274 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 -- 10.20.193.7:0/2735705349 >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 msgr2=0x7f1f08038f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 --2- 10.20.193.7:0/2735705349 >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 0x7f1f08038f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 -- 10.20.193.7:0/2735705349 >> v1:10.20.193.61:6789/0 conn(0x7f1f08039460 legacy=0x7f1f0819e220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 monclient: found mon.noname-a 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:16.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 -- 10.20.193.7:0/2735705349 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0808e9a0 con 0x7f1f0813d8b0 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f06ffd640 1 --2- 10.20.193.7:0/2735705349 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f0813d8b0 0x7f1f08139f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f08089d80 tx=0x7f1efc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e26e2191d04877 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 1 -- 10.20.193.7:0/2735705349 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0ab650 con 0x7f1f0813d8b0 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: dump: 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 1 -- 10.20.193.7:0/2735705349 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc0b0070 con 0x7f1f0813d8b0 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 1 -- 10.20.193.7:0/2735705349 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0aba10 con 0x7f1f0813d8b0 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 5 monclient: authenticate success, global_id 4827 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 4 set_mon_vals no callback set 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f05ffb640 10 monclient: dump: 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: shutdown 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- 10.20.193.7:0/2735705349 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f0813d8b0 msgr2=0x7f1f08139f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 --2- 10.20.193.7:0/2735705349 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f0813d8b0 0x7f1f08139f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f08089d80 tx=0x7f1efc01c500 comp rx=0 tx=0).stop 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- 10.20.193.7:0/2735705349 shutdown_connections 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 --2- 10.20.193.7:0/2735705349 >> v2:10.20.193.61:3300/0 conn(0x7f1f0813a460 0x7f1f08038f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 --2- 10.20.193.7:0/2735705349 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f0813d8b0 0x7f1f08139f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- 10.20.193.7:0/2735705349 >> 10.20.193.7:0/2735705349 conn(0x7f1f0808cf40 msgr2=0x7f1f0808d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- 10.20.193.7:0/2735705349 shutdown_connections 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 1 -- 10.20.193.7:0/2735705349 wait complete. 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: build_initial_monmap 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.704+0000 7f1f0d585640 10 monclient: monmap: 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 Processor -- start 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- start start 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: init 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-a con 0x7f1f08039460 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f0813a460 0x7f1f0814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-b con 0x7f1f0813a460 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f0813d8b0 0x7f1f08127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): picked mon.noname-c con 0x7f1f0813d8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081a22e0 con 0x7f1f08039460 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081a2160 con 0x7f1f0813a460 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1f081a2460 con 0x7f1f0813d8b0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): authenticate will time out at 609.184529s 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f0813a460 msgr2=0x7f1f0814e880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:58452/0 (socket says 10.20.193.7:58452) 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 -- 10.20.193.7:0/703818414 learned_addr learned my addr 10.20.193.7:0/703818414 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): get_auth_request con 0x7f1f08039460 auth_method 0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f0813a460 0x7f1f0814e880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f0813d8b0 0x7f1f08127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): get_auth_request con 0x7f1f0813d8b0 auth_method 0 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient(hunting): handle_auth_done global_id 4830 payload 824 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f0813d8b0 msgr2=0x7f1f08127780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f0813d8b0 0x7f1f08127780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f0813a460 msgr2=0x7f1f0814e880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f0813a460 0x7f1f0814e880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 monclient: found mon.noname-a 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0808c8c0 con 0x7f1f08039460 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f06ffd640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1efc002410 tx=0x7f1efc01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc004220 con 0x7f1f08039460 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: dump: 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.717 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: _finish_auth 0 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: _check_auth_tickets 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc0043c0 con 0x7f1f08039460 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 5 monclient: authenticate success, global_id 4830 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc003910 con 0x7f1f08039460 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: dump: 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _renew_subs 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f057fa640 4 set_mon_vals no callback set 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f080875c0 con 0x7f1f08039460 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _renew_subs 2026-02-22T20:53:16.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0812b410 con 0x7f1f08039460 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 0x7f1f08058bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0812afe0 con 0x7f1f08128480 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 0x7f1f08058bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient: get_auth_request con 0x7f1f08128480 auth_method 0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1efc003ab0 con 0x7f1f08039460 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 10 monclient(hunting): handle_auth_done global_id 4649 payload 824 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f081399c0 con 0x7f1f08128480 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 --2- 10.20.193.7:0/703818414 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ed403aa90 0x7f1ed405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3503+0+0 (secure 0 0 0) 0x7f1efc0e9280 con 0x7f1f08039460 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f067fc640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 0x7f1f08058bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0003a30 tx=0x7f1ef000bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000c9e0 con 0x7f1f08128480 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 1 --2- 10.20.193.7:0/703818414 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ed403aa90 0x7f1ed405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: dump: 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 10 monclient: get_auth_request con 0x7f1ed403aa90 auth_method 0 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f1ef0010070 con 0x7f1f08128480 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 msgr2=0x7f1f08058bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 0x7f1f08058bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0003a30 tx=0x7f1ef000bd00 comp rx=0 tx=0).stop 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 msgr2=0x7f1f08058bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1ee77fe640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128480 0x7f1f08058bf0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0003a30 tx=0x7f1ef000bd00 comp rx=0 tx=0).stop 2026-02-22T20:53:16.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.708+0000 7f1f077fe640 1 --2- 10.20.193.7:0/703818414 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ed403aa90 0x7f1ed405af40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8003cc0 tx=0x7f1ef8009580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 0x7f1f08059130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0805fcd0 con 0x7f1f08128850 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 0x7f1f08059130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient: get_auth_request con 0x7f1f08128850 auth_method 0 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:16.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 10 monclient(hunting): handle_auth_done global_id 4652 payload 824 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 1 -- 10.20.193.7:0/703818414 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f08129c10 con 0x7f1f08128850 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f067fc640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 0x7f1f08059130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0002410 tx=0x7f1ef0005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef001a3b0 con 0x7f1f08128850 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 10 monclient: dump: 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4869 (secure 0 0 0) 0x7f1ef001a3b0 con 0x7f1f08128850 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 msgr2=0x7f1f08059130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 0x7f1f08059130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0002410 tx=0x7f1ef0005b20 comp rx=0 tx=0).stop 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 msgr2=0x7f1f08059130 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:16.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1ee77fe640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f08128850 0x7f1f08059130 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0002410 tx=0x7f1ef0005b20 comp rx=0 tx=0).stop 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 14, 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 75838, 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.723 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:16.724 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:16.725 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:16.726 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:16.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:16.729 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ed403aa90 msgr2=0x7f1ed405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 --2- 10.20.193.7:0/703818414 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ed403aa90 0x7f1ed405af40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8003cc0 tx=0x7f1ef8009580 comp rx=0 tx=0).stop 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 10 monclient: shutdown 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 msgr2=0x7f1f0814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1efc002410 tx=0x7f1efc01ad40 comp rx=0 tx=0).stop 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f077fe640 1 -- 10.20.193.7:0/703818414 reap_dead start 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 shutdown_connections 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 --2- 10.20.193.7:0/703818414 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f08039460 0x7f1f0814e340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 >> 10.20.193.7:0/703818414 conn(0x7f1f0808cf40 msgr2=0x7f1f0813c970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:16.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 shutdown_connections 2026-02-22T20:53:16.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:16.712+0000 7f1f0d585640 1 -- 10.20.193.7:0/703818414 wait complete. 2026-02-22T20:53:16.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:53:16.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:53:16.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:16.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: starting. 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19047 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: created object 0... 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: created object 25... 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: created object 49... 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: finishing. 2026-02-22T20:53:17.941 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19048]: shutting down. 2026-02-22T20:53:18.897 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19049]: starting. 2026-02-22T20:53:18.897 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19049]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19047 2026-02-22T20:53:18.897 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19049]: shutting down. 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: starting. 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19047 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: created object 0... 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: created object 25... 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: created object 49... 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: finishing. 2026-02-22T20:53:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19084]: shutting down. 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: starting. 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: listing objects. 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: listed object 0... 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: listed object 25... 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: saw 50 objects 2026-02-22T20:53:20.967 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19086]: shutting down. 2026-02-22T20:53:21.906 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:21.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19085]: starting. 2026-02-22T20:53:21.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19085]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19047 2026-02-22T20:53:21.906 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19085]: shutting down. 2026-02-22T20:53:21.909 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:21.909 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:21.909 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:53:21.911 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:53:21.953 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:21.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: starting. 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19138 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: created object 0... 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: created object 25... 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: created object 49... 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: finishing. 2026-02-22T20:53:23.967 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19139]: shutting down. 2026-02-22T20:53:24.920 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19140]: starting. 2026-02-22T20:53:24.920 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19140]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19138 2026-02-22T20:53:24.920 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19140]: shutting down. 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: starting. 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19138 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: created object 0... 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: created object 25... 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: created object 49... 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: finishing. 2026-02-22T20:53:26.939 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19173]: shutting down. 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: starting. 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: listing objects. 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: listed object 0... 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: listed object 25... 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: saw 50 objects 2026-02-22T20:53:26.950 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19175]: shutting down. 2026-02-22T20:53:26.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:26.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:27.889 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:27.889 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19174]: starting. 2026-02-22T20:53:27.889 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19174]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19138 2026-02-22T20:53:27.889 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19174]: shutting down. 2026-02-22T20:53:27.892 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:27.892 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:27.892 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:53:27.895 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: starting. 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19225 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: created object 0... 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: created object 25... 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: created object 49... 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: finishing. 2026-02-22T20:53:29.945 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19226]: shutting down. 2026-02-22T20:53:30.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19227]: starting. 2026-02-22T20:53:30.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19227]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19225 2026-02-22T20:53:30.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19227]: shutting down. 2026-02-22T20:53:31.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:31.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:53:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: starting. 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19225 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: created object 0... 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: created object 25... 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: created object 49... 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: finishing. 2026-02-22T20:53:32.959 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19260]: shutting down. 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: starting. 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: listing objects. 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: listed object 0... 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: listed object 25... 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: saw 50 objects 2026-02-22T20:53:32.970 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19262]: shutting down. 2026-02-22T20:53:33.907 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:33.907 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19261]: starting. 2026-02-22T20:53:33.908 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19261]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19225 2026-02-22T20:53:33.908 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19261]: shutting down. 2026-02-22T20:53:33.910 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:33.910 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:53:33.910 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:53:33.913 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: starting. 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19312 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: created object 0... 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: created object 25... 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: created object 49... 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: finishing. 2026-02-22T20:53:35.937 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19313]: shutting down. 2026-02-22T20:53:36.732 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-22T20:53:36.732 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T20:53:36.732 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T20:53:36.734 INFO:tasks.ceph.mon.b:Started 2026-02-22T20:53:36.734 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:53:36.734 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: get_monmap_and_config 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: build_initial_monmap 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: monmap: 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:36.797255+0000 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:36.797255+0000 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:36.796 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:36.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 Processor -- start 2026-02-22T20:53:36.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 -- start start 2026-02-22T20:53:36.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: init 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-a con 0x7f4b9013f780 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b90055a70 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-b con 0x7f4b900565b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b90091820 con 0x7f4b90055a70 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9013f110 con 0x7f4b9013f780 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4b90087300 con 0x7f4b900565b0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b955ea640 10 monclient(hunting): authenticate will time out at 629.270450s 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:41032/0 (socket says 10.20.193.7:41032) 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 learned_addr learned my addr 10.20.193.7:0/2852806325 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b9013f780 auth_method 0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b900565b0 auth_method 0 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:36.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:36.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:36.792+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:36.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:36.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b9013f780 auth_method 0 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b900565b0 auth_method 0 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:37.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.000+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b900565b0 auth_method 0 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b9013f780 auth_method 0 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:37.408 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:37.404+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:38.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b900565b0 auth_method 0 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b9013f780 auth_method 0 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:38.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:38.208+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:39.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): tick 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 msgr2=0x7f4b901a1450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b900565b0 0x7f4b901a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 msgr2=0x7f4b9013fb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b9013f780 0x7f4b9013fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v1:10.20.193.7:6789/0 conn(0x7f4b90055a70 legacy=0x7f4b90055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient: _add_conns ranks=[1,4] 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4b6c0037a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-c con 0x7f4b6c0254e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b90091b00 con 0x7f4b6c0037a0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4b90087300 con 0x7f4b6c0254e0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8dffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c0254e0 auth_method 0 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:39.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c0254e0 auth_method 0 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:39.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:39.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c0254e0 auth_method 0 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:40.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:40.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:41.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:41.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c0254e0 auth_method 0 2026-02-22T20:53:41.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:41.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:41.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:41.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:41.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:41.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:41.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:41.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:41.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:41.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:42.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): tick 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 msgr2=0x7f4b6c045970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c0254e0 0x7f4b6c045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v1:10.20.193.61:6789/0 conn(0x7f4b6c0037a0 legacy=0x7f4b6c023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 reap_dead start 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4b6c046120 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-c con 0x7f4b6c045970 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-b con 0x7f4b6c047430 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c047100 con 0x7f4b6c046120 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4b90087300 con 0x7f4b6c045970 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c046e30 con 0x7f4b6c047430 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8dffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b6c047430 auth_method 0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c045970 auth_method 0 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:42.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:42.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:42.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:42.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:42.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.792+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b6c047430 auth_method 0 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c045970 auth_method 0 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:42.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:42.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:42.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:42.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:42.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:42.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:42.996+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b6c047430 auth_method 0 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c045970 auth_method 0 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:43.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:43.400+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b6c047430 auth_method 0 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:53:44.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b6c045970 auth_method 0 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:44.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:44.204+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): tick 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 monclient(hunting): continuing hunt 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 msgr2=0x7f4b6c067810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c047430 0x7f4b6c067810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 msgr2=0x7f4b6c023b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.61:3300/0 conn(0x7f4b6c045970 0x7f4b6c023b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 >> v1:10.20.193.61:6789/0 conn(0x7f4b6c046120 legacy=0x7f4b6c0464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient: _add_conns ranks=[3,0] 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b6c067f30 0x7f4b6c068330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-a con 0x7f4b6c067f30 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b6c088fe0 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c068d60 con 0x7f4b6c088fe0 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 1 -- 10.20.193.7:0/2852806325 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4b90087300 con 0x7f4b6c067f30 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8dffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> v2:10.20.193.7:3300/0 conn(0x7f4b6c067f30 0x7f4b6c068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b6c067f30 auth_method 0 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient(hunting): handle_auth_done global_id 4938 payload 274 2026-02-22T20:53:45.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 >> v1:10.20.193.7:6789/0 conn(0x7f4b6c088fe0 legacy=0x7f4b6c0a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:45.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:45.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 1 monclient: found mon.noname-a 2026-02-22T20:53:45.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:45.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.792+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2852806325 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c068b50 con 0x7f4b6c067f30 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b6c067f30 0x7f4b6c068330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c006fd0 tx=0x7f4b7c01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd283d78c5197f32 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 1 -- 10.20.193.7:0/2852806325 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0b4070 con 0x7f4b6c067f30 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: dump: 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:45.801 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: _finish_auth 0 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 1 -- 10.20.193.7:0/2852806325 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0af670 con 0x7f4b6c067f30 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 1 -- 10.20.193.7:0/2852806325 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00f040 con 0x7f4b6c067f30 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b8effd640 10 monclient: dump: 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:45.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 5 monclient: authenticate success, global_id 4938 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 4 set_mon_vals no callback set 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: shutdown 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b6c067f30 msgr2=0x7f4b6c068330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b6c067f30 0x7f4b6c068330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c006fd0 tx=0x7f4b7c01d4d0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b94de9640 1 -- 10.20.193.7:0/2852806325 reap_dead start 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- 10.20.193.7:0/2852806325 shutdown_connections 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2852806325 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b6c067f30 0x7f4b6c068330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- 10.20.193.7:0/2852806325 >> 10.20.193.7:0/2852806325 conn(0x7f4b900906f0 msgr2=0x7f4b90090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- 10.20.193.7:0/2852806325 shutdown_connections 2026-02-22T20:53:45.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- 10.20.193.7:0/2852806325 wait complete. 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: build_initial_monmap 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: monmap: 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:45.805 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 Processor -- start 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- start start 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: init 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-c con 0x7f4b6c067f30 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 0x7f4b90127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-a con 0x7f4b90115ae0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): picked mon.noname-b con 0x7f4b90115f50 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900563d0 con 0x7f4b90115ae0 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90056250 con 0x7f4b90115f50 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4b900865b0 con 0x7f4b6c067f30 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.796+0000 7f4b955ea640 10 monclient(hunting): authenticate will time out at 638.275974s 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:45.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46318/0 (socket says 10.20.193.7:46318) 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2254847386 learned_addr learned my addr 10.20.193.7:0/2254847386 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request con 0x7f4b6c067f30 auth_method 0 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 0x7f4b90127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b90115ae0 auth_method 0 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 msgr2=0x7f4b901155a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 msgr2=0x7f4b901155a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 10 monclient(hunting): get_auth_request con 0x7f4b90115f50 auth_method 0 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 msgr2=0x7f4b90127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 msgr2=0x7f4b90127950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:45.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b94de9640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient(hunting): handle_auth_done global_id 4944 payload 824 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 msgr2=0x7f4b901155a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 msgr2=0x7f4b90127950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 monclient: found mon.noname-a 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 -- 10.20.193.7:0/2254847386 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9012a0f0 con 0x7f4b90115ae0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8f7fe640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 0x7f4b90127410 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b80002410 tx=0x7f4b800137c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80012650 con 0x7f4b90115ae0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: dump: 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: _finish_auth 0 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: _check_auth_tickets 2026-02-22T20:53:45.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b800127f0 con 0x7f4b90115ae0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80012be0 con 0x7f4b90115ae0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 10 monclient: dump: 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8e7fc640 4 set_mon_vals no callback set 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 5 monclient: authenticate success, global_id 4944 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _renew_subs 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b90128ed0 con 0x7f4b90115ae0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _renew_subs 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9012a990 con 0x7f4b90115ae0 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:45.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90142c30 con 0x7f4b90115ae0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4b8001e430 con 0x7f4b90115ae0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 --2- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 0x7f4b6005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3897+0+0 (secure 0 0 0) 0x7f4b8004eb50 con 0x7f4b90115ae0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 0x7f4b6005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 10 monclient: get_auth_request con 0x7f4b6003ab20 auth_method 0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.800+0000 7f4b8ffff640 1 --2- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 0x7f4b6005afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01a0e0 tx=0x7f4b7c0a8000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.804+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f4b8000c5e0 con 0x7f4b90115ae0 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.804+0000 7f4b8cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:45.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.804+0000 7f4b8cff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:45.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.912+0000 7f4b955ea640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:45.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.912+0000 7f4b955ea640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:45.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.912+0000 7f4b955ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:45.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.912+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4b90056b30 con 0x7f4b90115ae0 2026-02-22T20:53:45.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b8cff9640 1 -- 10.20.193.7:0/2254847386 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f4b8004d900 con 0x7f4b90115ae0 2026-02-22T20:53:45.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b8cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:45.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b8cff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:45.919 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 msgr2=0x7f4b6005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 0x7f4b6005afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01a0e0 tx=0x7f4b7c0a8000 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 10 monclient: shutdown 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 msgr2=0x7f4b90127410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 0x7f4b90127410 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b80002410 tx=0x7f4b800137c0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 shutdown_connections 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4b6003ab20 0x7f4b6005afd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4b90115f50 0x7f4b90127950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4b90115ae0 0x7f4b90127410 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 --2- 10.20.193.7:0/2254847386 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4b6c067f30 0x7f4b901155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 >> 10.20.193.7:0/2254847386 conn(0x7f4b900906f0 msgr2=0x7f4b9013e630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 shutdown_connections 2026-02-22T20:53:45.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.916+0000 7f4b955ea640 1 -- 10.20.193.7:0/2254847386 wait complete. 2026-02-22T20:53:45.930 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:53:45.930 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:53:45.930 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: get_monmap_and_config 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: build_initial_monmap 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: monmap: 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:45.992784+0000 2026-02-22T20:53:45.992 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:45.992784+0000 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:45.993 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 Processor -- start 2026-02-22T20:53:46.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 -- start start 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: init 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ee013f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-a con 0x7f0ee013fd70 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ee0180d00 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee008fd70 con 0x7f0ee0180d00 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee0092bc0 con 0x7f0ee013f290 2026-02-22T20:53:46.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee008e1f0 con 0x7f0ee013fd70 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee7dba640 10 monclient(hunting): authenticate will time out at 638.466089s 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee6330640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f0ee0180d00 0x7f0ee01a10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48536/0 (socket says 10.20.193.7:48536) 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34804/0 (socket says 10.20.193.7:34804) 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee6330640 1 -- 10.20.193.7:0/48233295 learned_addr learned my addr 10.20.193.7:0/48233295 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): get_auth_request con 0x7f0ee013fd70 auth_method 0 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient(hunting): handle_auth_done global_id 4947 payload 274 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 -- 10.20.193.7:0/48233295 >> v1:10.20.193.61:6789/0 conn(0x7f0ee013f290 legacy=0x7f0ee013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 -- 10.20.193.7:0/48233295 >> v1:10.20.193.7:6789/0 conn(0x7f0ee0180d00 legacy=0x7f0ee01a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 -- 10.20.193.7:0/48233295 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee008e6d0 con 0x7f0ee013fd70 2026-02-22T20:53:46.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.988+0000 7f0ee532e640 1 --2- 10.20.193.7:0/48233295 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4004780 tx=0x7f0ed401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa48a04f831289d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 1 -- 10.20.193.7:0/48233295 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b1070 con 0x7f0ee013fd70 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: dump: 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.009 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 1 -- 10.20.193.7:0/48233295 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40a8050 con 0x7f0ee013fd70 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 5 monclient: authenticate success, global_id 4947 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 1 -- 10.20.193.7:0/48233295 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40ac860 con 0x7f0ee013fd70 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee4b2d640 10 monclient: dump: 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.011 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 4 set_mon_vals no callback set 2026-02-22T20:53:46.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: shutdown 2026-02-22T20:53:46.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/48233295 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013fd70 msgr2=0x7f0ee01807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/48233295 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4004780 tx=0x7f0ed401c4d0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/48233295 shutdown_connections 2026-02-22T20:53:46.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/48233295 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/48233295 >> 10.20.193.7:0/48233295 conn(0x7f0ee0093df0 msgr2=0x7f0ee00902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/48233295 shutdown_connections 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/48233295 wait complete. 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: monmap: 2026-02-22T20:53:46.014 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.015 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:46.016 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:46.016 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:46.016 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 Processor -- start 2026-02-22T20:53:46.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- start start 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: init 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 0x7f0ee012b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-a con 0x7f0ee013f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:46.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-c con 0x7f0ee013fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0ee0180d00 0x7f0ee01275c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): picked mon.noname-b con 0x7f0ee0180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee01a5870 con 0x7f0ee013f290 2026-02-22T20:53:46.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee01a56f0 con 0x7f0ee0180d00 2026-02-22T20:53:46.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee01a59f0 con 0x7f0ee013fd70 2026-02-22T20:53:46.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): authenticate will time out at 638.469456s 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 0x7f0ee012b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 0x7f0ee012b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34814/0 (socket says 10.20.193.7:34814) 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 -- 10.20.193.7:0/1927994591 learned_addr learned my addr 10.20.193.7:0/1927994591 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): get_auth_request con 0x7f0ee013f290 auth_method 0 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): get_auth_request con 0x7f0ee013fd70 auth_method 0 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient(hunting): handle_auth_done global_id 4953 payload 824 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0ee013fd70 msgr2=0x7f0ee01807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0ee013fd70 0x7f0ee01807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0ee0180d00 msgr2=0x7f0ee01275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0ee0180d00 0x7f0ee01275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0ee0180d00 0x7f0ee01275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee010c4b0 con 0x7f0ee013f290 2026-02-22T20:53:46.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 10 monclient: get_auth_request con 0x7f0ee0180d00 auth_method 0 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0ee0180d00 0x7f0ee01275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee5b2f640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 0x7f0ee012b380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c700 tx=0x7f0ed000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0006ad0 con 0x7f0ee013f290 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: dump: 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.026 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed0006c70 con 0x7f0ee013f290 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0007230 con 0x7f0ee013f290 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: dump: 2026-02-22T20:53:46.028 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.029 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 5 monclient: authenticate success, global_id 4953 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _renew_subs 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ecffff640 4 set_mon_vals no callback set 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee00575b0 con 0x7f0ee013f290 2026-02-22T20:53:46.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _renew_subs 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee010bef0 con 0x7f0ee013f290 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 0x7f0ee0127f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0128440 con 0x7f0ee0127b00 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 0x7f0ee0127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0ed0023060 con 0x7f0ee013f290 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient: get_auth_request con 0x7f0ee0127b00 auth_method 0 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 10 monclient(hunting): handle_auth_done global_id 4956 payload 824 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ee013f660 con 0x7f0ee0127b00 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 --2- 10.20.193.7:0/1927994591 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0eb003ab20 0x7f0eb005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3897+0+0 (secure 0 0 0) 0x7f0ed004e870 con 0x7f0ee013f290 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee532e640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 0x7f0ee0127f00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 1 --2- 10.20.193.7:0/1927994591 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0eb003ab20 0x7f0eb005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40bb020 con 0x7f0ee0127b00 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: dump: 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.034 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 10 monclient: get_auth_request con 0x7f0eb003ab20 auth_method 0 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f0ed4003910 con 0x7f0ee0127b00 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 msgr2=0x7f0ee0127f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 0x7f0ee0127f00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed401ad10 comp rx=0 tx=0).stop 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 msgr2=0x7f0ee0127f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ece7fc640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee0127b00 0x7f0ee0127f00 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed401ad10 comp rx=0 tx=0).stop 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.992+0000 7f0ee6330640 1 --2- 10.20.193.7:0/1927994591 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0eb003ab20 0x7f0eb005afd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0edc002af0 tx=0x7f0edc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 0x7f0ee0087ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee010af80 con 0x7f0ee00876d0 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 0x7f0ee0087ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient: get_auth_request con 0x7f0ee00876d0 auth_method 0 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 10 monclient(hunting): handle_auth_done global_id 4959 payload 824 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 1 -- 10.20.193.7:0/1927994591 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ee005fb70 con 0x7f0ee00876d0 2026-02-22T20:53:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee532e640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 0x7f0ee0087ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40bb070 con 0x7f0ee00876d0 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 10 monclient: dump: 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.038 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f0ed40a8040 con 0x7f0ee00876d0 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 msgr2=0x7f0ee0087ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 0x7f0ee0087ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed4019270 comp rx=0 tx=0).stop 2026-02-22T20:53:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 msgr2=0x7f0ee0087ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ece7fc640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee00876d0 0x7f0ee0087ad0 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a100 tx=0x7f0ed4019270 comp rx=0 tx=0).stop 2026-02-22T20:53:46.040 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:46.040 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 105126, 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:46.041 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.042 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.043 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.044 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:46.045 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:46.046 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.047 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:46.048 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:46.049 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.050 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.051 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:46.052 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.053 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.054 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:46.055 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.056 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:46.057 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0eb003ab20 msgr2=0x7f0eb005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/1927994591 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0eb003ab20 0x7f0eb005afd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0edc002af0 tx=0x7f0edc009040 comp rx=0 tx=0).stop 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 10 monclient: shutdown 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 msgr2=0x7f0ee012b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 --2- 10.20.193.7:0/1927994591 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0ee013f290 0x7f0ee012b380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c700 tx=0x7f0ed000cbc0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee6330640 1 -- 10.20.193.7:0/1927994591 reap_dead start 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee6330640 1 -- 10.20.193.7:0/1927994591 reap_dead start 2026-02-22T20:53:46.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 shutdown_connections 2026-02-22T20:53:46.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 >> 10.20.193.7:0/1927994591 conn(0x7f0ee0093df0 msgr2=0x7f0ee0055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 shutdown_connections 2026-02-22T20:53:46.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:45.996+0000 7f0ee7dba640 1 -- 10.20.193.7:0/1927994591 wait complete. 2026-02-22T20:53:46.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:46.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:53:46.059 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:53:46.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: get_monmap_and_config 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: monmap: 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:46.121750+0000 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:46.121750+0000 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:46.121 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 Processor -- start 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 -- start start 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: init 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f649408c7a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6494090b70 0x7f64941806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-c con 0x7f6494090b70 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6494090f70 0x7f64941a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-a con 0x7f6494090f70 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649408d840 con 0x7f649408c7a0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f649408db20 con 0x7f6494090f70 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f64940851e0 con 0x7f6494090b70 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6499b56640 10 monclient(hunting): authenticate will time out at 638.594614s 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6494090f70 0x7f64941a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6494090f70 0x7f64941a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34846/0 (socket says 10.20.193.7:34846) 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 -- 10.20.193.7:0/3268089110 learned_addr learned my addr 10.20.193.7:0/3268089110 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f64937fe640 1 --1- 10.20.193.7:0/3268089110 >> v1:10.20.193.61:6789/0 conn(0x7f649408c7a0 0x7f6494090460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:54830/0 (socket says 10.20.193.7:54830) 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): get_auth_request con 0x7f6494090f70 auth_method 0 2026-02-22T20:53:46.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6492ffd640 1 --2- 10.20.193.7:0/3268089110 >> v2:10.20.193.61:3300/0 conn(0x7f6494090b70 0x7f64941806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6492ffd640 10 monclient(hunting): get_auth_request con 0x7f6494090b70 auth_method 0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6492ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6492ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6492ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient(hunting): handle_auth_done global_id 4962 payload 274 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 -- 10.20.193.7:0/3268089110 >> v2:10.20.193.61:3300/0 conn(0x7f6494090b70 msgr2=0x7f64941806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 --2- 10.20.193.7:0/3268089110 >> v2:10.20.193.61:3300/0 conn(0x7f6494090b70 0x7f64941806e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 -- 10.20.193.7:0/3268089110 >> v1:10.20.193.61:6789/0 conn(0x7f649408c7a0 legacy=0x7f6494090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.116+0000 7f6493fff640 1 -- 10.20.193.7:0/3268089110 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649408ed90 con 0x7f6494090f70 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 1 --2- 10.20.193.7:0/3268089110 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090f70 0x7f64941a0c30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6494084f60 tx=0x7f648801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f902af5e5e5f92 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 1 -- 10.20.193.7:0/3268089110 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64880b2070 con 0x7f6494090f70 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: dump: 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.129 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 1 -- 10.20.193.7:0/3268089110 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64880a5880 con 0x7f6494090f70 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 1 -- 10.20.193.7:0/3268089110 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64880a5c70 con 0x7f6494090f70 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64927fc640 10 monclient: dump: 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 5 monclient: authenticate success, global_id 4962 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 4 set_mon_vals no callback set 2026-02-22T20:53:46.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: shutdown 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/3268089110 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090f70 msgr2=0x7f64941a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- 10.20.193.7:0/3268089110 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090f70 0x7f64941a0c30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6494084f60 tx=0x7f648801c8b0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/3268089110 shutdown_connections 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- 10.20.193.7:0/3268089110 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090f70 0x7f64941a0c30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- 10.20.193.7:0/3268089110 >> v2:10.20.193.61:3300/0 conn(0x7f6494090b70 0x7f64941806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/3268089110 >> 10.20.193.7:0/3268089110 conn(0x7f649408e050 msgr2=0x7f649408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/3268089110 shutdown_connections 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/3268089110 wait complete. 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: monmap: 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 Processor -- start 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- start start 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: init 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f649408c7a0 0x7f64941d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-b con 0x7f649408c7a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 0x7f6494059eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-a con 0x7f6494090b70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6494090f70 0x7f649405a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): picked mon.noname-c con 0x7f6494090f70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64941a3d20 con 0x7f6494090b70 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f64941a3ba0 con 0x7f649408c7a0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f64941a3ea0 con 0x7f6494090f70 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): authenticate will time out at 638.598009s 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 0x7f6494059eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 0x7f6494059eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34850/0 (socket says 10.20.193.7:34850) 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 -- 10.20.193.7:0/769417543 learned_addr learned my addr 10.20.193.7:0/769417543 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): get_auth_request con 0x7f6494090b70 auth_method 0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6494090f70 0x7f649405a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): get_auth_request con 0x7f6494090f70 auth_method 0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f649408c7a0 0x7f64941d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): get_auth_request con 0x7f649408c7a0 auth_method 0 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient(hunting): handle_auth_done global_id 4965 payload 824 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6494090f70 msgr2=0x7f649405a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6494090f70 0x7f649405a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f649408c7a0 msgr2=0x7f64941d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f649408c7a0 0x7f64941d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649405daa0 con 0x7f6494090b70 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6492ffd640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 0x7f6494059eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6484006b80 tx=0x7f648400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484017070 con 0x7f6494090b70 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: dump: 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648400ee50 con 0x7f6494090b70 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 5 monclient: authenticate success, global_id 4965 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _renew_subs 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649408b990 con 0x7f6494090b70 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648400f040 con 0x7f6494090b70 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: dump: 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6491ffb640 4 set_mon_vals no callback set 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _renew_subs 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649405d4e0 con 0x7f6494090b70 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 0x7f649405a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6494090460 con 0x7f64941d9e30 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 0x7f649405a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient: get_auth_request con 0x7f64941d9e30 auth_method 0 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f6484012050 con 0x7f6494090b70 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 10 monclient(hunting): handle_auth_done global_id 4733 payload 824 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f649405bfe0 con 0x7f64941d9e30 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f64937fe640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 0x7f649405a930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6480002810 tx=0x7f64800030a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 --2- 10.20.193.7:0/769417543 >> v2:10.20.193.61:6800/2336688312 conn(0x7f646403ab20 0x7f646405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3897+0+0 (secure 0 0 0) 0x7f648404e5a0 con 0x7f6494090b70 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480019070 con 0x7f64941d9e30 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: dump: 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.135 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 1 --2- 10.20.193.7:0/769417543 >> v2:10.20.193.61:6800/2336688312 conn(0x7f646403ab20 0x7f646405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f6493fff640 10 monclient: get_auth_request con 0x7f646403ab20 auth_method 0 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f6480010510 con 0x7f64941d9e30 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 msgr2=0x7f649405a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 0x7f649405a930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6480002810 tx=0x7f64800030a0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 msgr2=0x7f649405a930 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.120+0000 7f646ffff640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f64941d9e30 0x7f649405a930 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6480002810 tx=0x7f64800030a0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f6493fff640 1 --2- 10.20.193.7:0/769417543 >> v2:10.20.193.61:6800/2336688312 conn(0x7f646403ab20 0x7f646405afd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6488009c00 tx=0x7f64880a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f6499b56640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f6499b56640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 0x7f649419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f6499b56640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f649405d310 con 0x7f649405ae70 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 0x7f649419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient: get_auth_request con 0x7f649405ae70 auth_method 0 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 10 monclient(hunting): handle_auth_done global_id 4736 payload 824 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 1 -- 10.20.193.7:0/769417543 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f649405b270 con 0x7f649405ae70 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f64937fe640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 0x7f649419d260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6480013000 tx=0x7f64800026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480019050 con 0x7f649405ae70 2026-02-22T20:53:46.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 10 monclient: dump: 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7f648001a040 con 0x7f649405ae70 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 msgr2=0x7f649419d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 0x7f649419d260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6480013000 tx=0x7f64800026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 msgr2=0x7f649419d260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.124+0000 7f646ffff640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f649405ae70 0x7f649419d260 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6480013000 tx=0x7f64800026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:46.138 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 105250, 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.139 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:46.140 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.141 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.142 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.143 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:46.144 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 >> v2:10.20.193.61:6800/2336688312 conn(0x7f646403ab20 msgr2=0x7f646405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 --2- 10.20.193.7:0/769417543 >> v2:10.20.193.61:6800/2336688312 conn(0x7f646403ab20 0x7f646405afd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6488009c00 tx=0x7f64880a7070 comp rx=0 tx=0).stop 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 10 monclient: shutdown 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 msgr2=0x7f6494059eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 --2- 10.20.193.7:0/769417543 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6494090b70 0x7f6494059eb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6484006b80 tx=0x7f648400ec00 comp rx=0 tx=0).stop 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6493fff640 1 -- 10.20.193.7:0/769417543 reap_dead start 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6493fff640 1 -- 10.20.193.7:0/769417543 reap_dead start 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 shutdown_connections 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 >> 10.20.193.7:0/769417543 conn(0x7f649408e050 msgr2=0x7f6494089700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 shutdown_connections 2026-02-22T20:53:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.128+0000 7f6499b56640 1 -- 10.20.193.7:0/769417543 wait complete. 2026-02-22T20:53:46.146 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:46.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:53:46.146 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: get_monmap_and_config 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: monmap: 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:46.213687+0000 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:46.213687+0000 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:46.214 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 Processor -- start 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 -- start start 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: init 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f357013f780 0x7f357013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-a con 0x7f357013f780 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3570055a70 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f35700565b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3570091820 con 0x7f3570055a70 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3570091b00 con 0x7f35700565b0 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f357013f110 con 0x7f357013f780 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3576c03640 10 monclient(hunting): authenticate will time out at 638.686640s 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f357013f780 0x7f357013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f357013f780 0x7f357013fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34858/0 (socket says 10.20.193.7:34858) 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 -- 10.20.193.7:0/40426399 learned_addr learned my addr 10.20.193.7:0/40426399 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): get_auth_request con 0x7f357013f780 auth_method 0 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient(hunting): handle_auth_done global_id 4968 payload 274 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 -- 10.20.193.7:0/40426399 >> v1:10.20.193.61:6789/0 conn(0x7f35700565b0 legacy=0x7f35701a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 -- 10.20.193.7:0/40426399 >> v1:10.20.193.7:6789/0 conn(0x7f3570055a70 legacy=0x7f3570055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 -- 10.20.193.7:0/40426399 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35700931e0 con 0x7f357013f780 2026-02-22T20:53:46.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.208+0000 7f3575c01640 1 --2- 10.20.193.7:0/40426399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357013fb50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f35600090a0 tx=0x7f356001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d56d926ec56910 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 1 -- 10.20.193.7:0/40426399 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600aa680 con 0x7f357013f780 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: dump: 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 1 -- 10.20.193.7:0/40426399 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35600af070 con 0x7f357013f780 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 1 -- 10.20.193.7:0/40426399 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35600aaa40 con 0x7f357013f780 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3574bff640 10 monclient: dump: 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 5 monclient: authenticate success, global_id 4968 2026-02-22T20:53:46.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 4 set_mon_vals no callback set 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: shutdown 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/40426399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 msgr2=0x7f357013fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- 10.20.193.7:0/40426399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357013fb50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f35600090a0 tx=0x7f356001c500 comp rx=0 tx=0).stop 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/40426399 shutdown_connections 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- 10.20.193.7:0/40426399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357013fb50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/40426399 >> 10.20.193.7:0/40426399 conn(0x7f35700906f0 msgr2=0x7f3570090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/40426399 shutdown_connections 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/40426399 wait complete. 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: monmap: 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.224 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 Processor -- start 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- start start 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: init 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-c con 0x7f3570055a70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35700565b0 0x7f3570150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-b con 0x7f35700565b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357012cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): picked mon.noname-a con 0x7f357013f780 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35701a59b0 con 0x7f357013f780 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3570087300 con 0x7f35700565b0 2026-02-22T20:53:46.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35701a5b30 con 0x7f3570055a70 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): authenticate will time out at 638.689959s 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46342/0 (socket says 10.20.193.7:46342) 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 -- 10.20.193.7:0/3046658204 learned_addr learned my addr 10.20.193.7:0/3046658204 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): get_auth_request con 0x7f3570055a70 auth_method 0 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357012cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): get_auth_request con 0x7f357013f780 auth_method 0 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35700565b0 0x7f3570150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient(hunting): handle_auth_done global_id 4739 payload 824 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35700565b0 msgr2=0x7f3570150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35700565b0 0x7f3570150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 msgr2=0x7f357012cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f357013f780 0x7f357012cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 monclient: found mon.noname-c 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3570057630 con 0x7f3570055a70 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575c01640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f356001c540 tx=0x7f356001ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560004220 con 0x7f3570055a70 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: dump: 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.228 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35600043c0 con 0x7f3570055a70 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560003910 con 0x7f3570055a70 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: dump: 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.229 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 5 monclient: authenticate success, global_id 4739 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _renew_subs 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355ffff640 4 set_mon_vals no callback set 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357012fd50 con 0x7f3570055a70 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _renew_subs 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3570130010 con 0x7f3570055a70 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 0x7f357012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3570130480 con 0x7f357012d160 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f3560003ab0 con 0x7f3570055a70 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 0x7f357012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient: get_auth_request con 0x7f357012d160 auth_method 0 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 --2- 10.20.193.7:0/3046658204 >> v2:10.20.193.61:6800/2336688312 conn(0x7f354003ab20 0x7f354005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 3897+0+0 (secure 0 0 0) 0x7f35600e9340 con 0x7f3570055a70 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 10 monclient(hunting): handle_auth_done global_id 54106 payload 824 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f357013fb50 con 0x7f357012d160 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 1 --2- 10.20.193.7:0/3046658204 >> v2:10.20.193.61:6800/2336688312 conn(0x7f354003ab20 0x7f354005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 10 monclient: get_auth_request con 0x7f354003ab20 auth_method 0 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3575400640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 0x7f357012d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3564002770 tx=0x7f356400d880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35640052d0 con 0x7f357012d160 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f355e7fc640 10 monclient: dump: 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.231 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.212+0000 7f3576402640 1 --2- 10.20.193.7:0/3046658204 >> v2:10.20.193.61:6800/2336688312 conn(0x7f354003ab20 0x7f354005afd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f357012ee40 tx=0x7f356c00d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f35640052d0 con 0x7f357012d160 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 msgr2=0x7f357012d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 0x7f357012d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3564002770 tx=0x7f356400d880 comp rx=0 tx=0).stop 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 msgr2=0x7f357012d530 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f355e7fc640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012d160 0x7f357012d530 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3564002770 tx=0x7f356400d880 comp rx=0 tx=0).stop 2026-02-22T20:53:46.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3576c03640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:46.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3576c03640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 0x7f357008bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3576c03640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3570056b30 con 0x7f357012da70 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 0x7f357008bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient: get_auth_request con 0x7f357012da70 auth_method 0 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.216+0000 7f3575400640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3575400640 10 monclient(hunting): handle_auth_done global_id 54109 payload 824 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3575400640 1 -- 10.20.193.7:0/3046658204 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f357013ee60 con 0x7f357012da70 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3575400640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 0x7f357008bc00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35640027e0 tx=0x7f35640026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356401b640 con 0x7f357012da70 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 10 monclient: dump: 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.236 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7f356401b640 con 0x7f357012da70 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 msgr2=0x7f357008bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 0x7f357008bc00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35640027e0 tx=0x7f35640026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 9447, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:46.238 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.239 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:46.240 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:46.241 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:46.242 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.243 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:46.244 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.245 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:46.246 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:46.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 msgr2=0x7f357008bc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f355e7fc640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f357012da70 0x7f357008bc00 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35640027e0 tx=0x7f35640026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 >> v2:10.20.193.61:6800/2336688312 conn(0x7f354003ab20 msgr2=0x7f354005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 --2- 10.20.193.7:0/3046658204 >> v2:10.20.193.61:6800/2336688312 conn(0x7f354003ab20 0x7f354005afd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f357012ee40 tx=0x7f356c00d040 comp rx=0 tx=0).stop 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 10 monclient: shutdown 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 msgr2=0x7f3570150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576402640 1 -- 10.20.193.7:0/3046658204 reap_dead start 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f356001c540 tx=0x7f356001ad40 comp rx=0 tx=0).stop 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 shutdown_connections 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 --2- 10.20.193.7:0/3046658204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3570055a70 0x7f3570150510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 >> 10.20.193.7:0/3046658204 conn(0x7f35700906f0 msgr2=0x7f357008f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 shutdown_connections 2026-02-22T20:53:46.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.220+0000 7f3576c03640 1 -- 10.20.193.7:0/3046658204 wait complete. 2026-02-22T20:53:46.248 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:46.249 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:53:46.249 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: get_monmap_and_config 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: monmap: 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:46.310150+0000 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:46.310150+0000 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:46.320 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 Processor -- start 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 -- start start 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: init 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient: _add_conns ranks=[3,4,0,1,2] 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb66c091c70 0x7fb66c092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-a con 0x7fb66c091c70 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fb66c13f1b0 0x7fb66c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-c con 0x7fb66c13f1b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb66c13fb10 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c08e6a0 con 0x7fb66c13fb10 2026-02-22T20:53:46.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c08e910 con 0x7fb66c091c70 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c08ebf0 con 0x7fb66c13f1b0 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb6727a2640 10 monclient(hunting): authenticate will time out at 638.783232s 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb66c091c70 0x7fb66c092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb66c091c70 0x7fb66c092040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34872/0 (socket says 10.20.193.7:34872) 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 -- 10.20.193.7:0/485763340 learned_addr learned my addr 10.20.193.7:0/485763340 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): get_auth_request con 0x7fb66c091c70 auth_method 0 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66b7fe640 1 --2- 10.20.193.7:0/485763340 >> v2:10.20.193.61:3300/0 conn(0x7fb66c13f1b0 0x7fb66c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66b7fe640 10 monclient(hunting): get_auth_request con 0x7fb66c13f1b0 auth_method 0 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient(hunting): handle_auth_done global_id 4974 payload 274 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 -- 10.20.193.7:0/485763340 >> v2:10.20.193.61:3300/0 conn(0x7fb66c13f1b0 msgr2=0x7fb66c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 --2- 10.20.193.7:0/485763340 >> v2:10.20.193.61:3300/0 conn(0x7fb66c13f1b0 0x7fb66c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 -- 10.20.193.7:0/485763340 >> v1:10.20.193.7:6789/0 conn(0x7fb66c13fb10 legacy=0x7fb66c1a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.304+0000 7fb66bfff640 1 -- 10.20.193.7:0/485763340 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c08eed0 con 0x7fb66c091c70 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66bfff640 1 --2- 10.20.193.7:0/485763340 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c091c70 0x7fb66c092040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb66c090110 tx=0x7fb65801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc4dc8223c09e7d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 1 -- 10.20.193.7:0/485763340 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580a7070 con 0x7fb66c091c70 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: dump: 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 1 -- 10.20.193.7:0/485763340 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6580b0070 con 0x7fb66c091c70 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 1 -- 10.20.193.7:0/485763340 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580ab890 con 0x7fb66c091c70 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66affd640 10 monclient: dump: 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 5 monclient: authenticate success, global_id 4974 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 4 set_mon_vals no callback set 2026-02-22T20:53:46.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: shutdown 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/485763340 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c091c70 msgr2=0x7fb66c092040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- 10.20.193.7:0/485763340 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c091c70 0x7fb66c092040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb66c090110 tx=0x7fb65801c4a0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/485763340 shutdown_connections 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- 10.20.193.7:0/485763340 >> v2:10.20.193.61:3300/0 conn(0x7fb66c13f1b0 0x7fb66c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- 10.20.193.7:0/485763340 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c091c70 0x7fb66c092040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/485763340 >> 10.20.193.7:0/485763340 conn(0x7fb66c093d80 msgr2=0x7fb66c090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/485763340 shutdown_connections 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/485763340 wait complete. 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: build_initial_monmap 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: monmap: 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:46.326 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 Processor -- start 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- start start 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: init 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 0x7fb66c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-b con 0x7fb66c091c70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-a con 0x7fb66c13f1b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb66c13fb10 0x7fb66c12aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): picked mon.noname-c con 0x7fb66c13fb10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c091700 con 0x7fb66c13f1b0 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c091580 con 0x7fb66c091c70 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c1a4440 con 0x7fb66c13fb10 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient(hunting): authenticate will time out at 638.786696s 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb66c13fb10 0x7fb66c12aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34888/0 (socket says 10.20.193.7:34888) 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 -- 10.20.193.7:0/2739394901 learned_addr learned my addr 10.20.193.7:0/2739394901 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): get_auth_request con 0x7fb66c13f1b0 auth_method 0 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): get_auth_request con 0x7fb66c13fb10 auth_method 0 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:46.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66bfff640 1 -- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 msgr2=0x7fb66c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66bfff640 1 -- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 msgr2=0x7fb66c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66bfff640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 0x7fb66c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66bfff640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 0x7fb66c1504e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb670d18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient(hunting): handle_auth_done global_id 4980 payload 824 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 -- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb66c13fb10 msgr2=0x7fb66c12aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb66c13fb10 0x7fb66c12aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 -- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 msgr2=0x7fb66c1504e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 0x7fb66c1504e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 monclient: found mon.noname-a 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 -- 10.20.193.7:0/2739394901 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c12c440 con 0x7fb66c13f1b0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66b7fe640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb65c006b80 tx=0x7fb65c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c017070 con 0x7fb66c13f1b0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: dump: 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.330 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: _finish_auth 0 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c00ee50 con 0x7fb66c13f1b0 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c00f040 con 0x7fb66c13f1b0 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb668ff9640 10 monclient: dump: 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:46.331 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb66a7fc640 4 set_mon_vals no callback set 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 5 monclient: authenticate success, global_id 4980 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _renew_subs 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c13dae0 con 0x7fb66c13f1b0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _renew_subs 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c12cfa0 con 0x7fb66c13f1b0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.308+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c092040 con 0x7fb66c13f1b0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fb65c012050 con 0x7fb66c13f1b0 2026-02-22T20:53:46.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb668ff9640 1 --2- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 0x7fb63c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3897+0+0 (secure 0 0 0) 0x7fb65c04e4f0 con 0x7fb66c13f1b0 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb66bfff640 1 --2- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 0x7fb63c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb66bfff640 10 monclient: get_auth_request con 0x7fb63c03ab20 auth_method 0 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.312+0000 7fb66bfff640 1 --2- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 0x7fb63c05afd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb65801a0d0 tx=0x7fb658004820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.316+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fb65c016170 con 0x7fb66c13f1b0 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.316+0000 7fb668ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:46.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.316+0000 7fb668ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb66c092890 con 0x7fb66c13f1b0 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb668ff9640 1 -- 10.20.193.7:0/2739394901 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb65c00a0d0 con 0x7fb66c13f1b0 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb668ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:53:46.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb668ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=1,health=13,kv=10,logm=65} crc {auth=1479953513,config=1228700967,health=918762077,kv=3991984195,logm=1031712391}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=10,kv=10,logm=66} crc {auth=3865664511,config=3140514009,health=3455930338,kv=3991984195,logm=1332032194}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=1,health=13,kv=10,logm=65} crc {auth=1479953513,config=1228700967,health=918762077,kv=3991984195,logm=1031712391}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=13,kv=10,logm=64} crc {auth=4294299115,config=3140514009,health=2358046931,kv=3991984195,logm=3468213793}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635408314}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1140850595}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635408314}) 2026-02-22T20:53:46.432 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4010102203}) 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 msgr2=0x7fb63c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 0x7fb63c05afd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb65801a0d0 tx=0x7fb658004820 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 10 monclient: shutdown 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 msgr2=0x7fb66c150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb65c006b80 tx=0x7fb65c00ec00 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 shutdown_connections 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb66c13fb10 0x7fb66c12aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb66c13f1b0 0x7fb66c150a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb63c03ab20 0x7fb63c05afd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 --2- 10.20.193.7:0/2739394901 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb66c091c70 0x7fb66c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 >> 10.20.193.7:0/2739394901 conn(0x7fb66c093d80 msgr2=0x7fb66c08ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 shutdown_connections 2026-02-22T20:53:46.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:46.428+0000 7fb6727a2640 1 -- 10.20.193.7:0/2739394901 wait complete. 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081824729}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=366972953}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081824729}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1007430381}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764954637}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=290935866}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764954637}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1409061939}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580003860}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3535221898}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580003860}) 2026-02-22T20:53:46.434 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.428+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=48457974}) 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=1181762680,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2654940597,mon_config_key=2504319980,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1371034381,osd_snap=4133920409,osdmap=2879518944}) 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=5,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=27} crc {logm=3193105468,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2654940597,mon_config_key=675997818,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1371034381,osd_snap=4133920409,osdmap=2343112208}) 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=1181762680,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2654940597,mon_config_key=2504319980,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1371034381,osd_snap=4133920409,osdmap=2879518944}) 2026-02-22T20:53:46.435 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=33,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=5,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=2277800046,mdsmap=1256979633,mgr=2953091486,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2654940597,mon_config_key=1612314950,monmap=639966935,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1371034381,osd_snap=4133920409,osdmap=2003615156}) 2026-02-22T20:53:46.436 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.437 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=88} crc {osdmap=2298416285}) 2026-02-22T20:53:46.437 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=90} crc {osdmap=3290937563}) 2026-02-22T20:53:46.437 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:53:46.437 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=88} crc {osdmap=2298416285}) 2026-02-22T20:53:46.437 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:53:46.432+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=91} crc {osdmap=1817646357}) 2026-02-22T20:53:46.442 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:53:46.928 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19314]: starting. 2026-02-22T20:53:46.928 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19314]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19312 2026-02-22T20:53:46.929 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19314]: shutting down. 2026-02-22T20:53:46.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:46.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:47.443 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:53:47.443 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.496+0000 7fe246ca4640 10 monclient: get_monmap_and_config 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.496+0000 7fe246ca4640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.496+0000 7fe246ca4640 10 monclient: monmap: 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:47.503444+0000 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:47.503444+0000 2026-02-22T20:53:47.503 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.496+0000 7fe246ca4640 1 Processor -- start 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- start start 2026-02-22T20:53:47.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: init 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-b con 0x7fe24013be70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe24013c780 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 0x7fe24019e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-c con 0x7fe2401392d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2400875d0 con 0x7fe24013c780 2026-02-22T20:53:47.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400878b0 con 0x7fe2401392d0 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe24008b780 con 0x7fe24013be70 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient(hunting): authenticate will time out at 639.976583s 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe237fff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fe24013c780 0x7fe240138bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48564/0 (socket says 10.20.193.7:48564) 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe237fff640 1 -- 10.20.193.7:0/2602631486 learned_addr learned my addr 10.20.193.7:0/2602631486 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46364/0 (socket says 10.20.193.7:46364) 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): get_auth_request con 0x7fe24013be70 auth_method 0 2026-02-22T20:53:47.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient(hunting): handle_auth_done global_id 4754 payload 274 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 -- 10.20.193.7:0/2602631486 >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 msgr2=0x7fe24019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe24521a640 1 --2- 10.20.193.7:0/2602631486 >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 0x7fe24019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 1 -- 10.20.193.7:0/2602631486 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825608008 0 0) 0x7fe2400875d0 con 0x7fe24013c780 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 --2- 10.20.193.7:0/2602631486 >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 0x7fe24019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 -- 10.20.193.7:0/2602631486 >> v1:10.20.193.7:6789/0 conn(0x7fe24013c780 legacy=0x7fe240138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 monclient: found mon.noname-b 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 -- 10.20.193.7:0/2602631486 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400872f0 con 0x7fe24013be70 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe24521a640 10 monclient: get_auth_request con 0x7fe2401392d0 auth_method 0 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe24521a640 1 --2- 10.20.193.7:0/2602631486 >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 0x7fe24019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe244a19640 1 --2- 10.20.193.7:0/2602631486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe230004780 tx=0x7fe23001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe1802cfbc87323 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 1 -- 10.20.193.7:0/2602631486 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2300b4070 con 0x7fe24013be70 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: dump: 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 1 -- 10.20.193.7:0/2602631486 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2300a7c70 con 0x7fe24013be70 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 1 -- 10.20.193.7:0/2602631486 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2300af660 con 0x7fe24013be70 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe2377fe640 10 monclient: dump: 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.518 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 5 monclient: authenticate success, global_id 4754 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 4 set_mon_vals no callback set 2026-02-22T20:53:47.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: shutdown 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- 10.20.193.7:0/2602631486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 msgr2=0x7fe24013c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2602631486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe230004780 tx=0x7fe23001ec90 comp rx=0 tx=0).stop 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- 10.20.193.7:0/2602631486 shutdown_connections 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2602631486 >> v2:10.20.193.61:3300/0 conn(0x7fe2401392d0 0x7fe24019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2602631486 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24013c240 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- 10.20.193.7:0/2602631486 >> 10.20.193.7:0/2602631486 conn(0x7fe24008f860 msgr2=0x7fe24008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- 10.20.193.7:0/2602631486 shutdown_connections 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- 10.20.193.7:0/2602631486 wait complete. 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: monmap: 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 Processor -- start 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 1 -- start start 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: init 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.500+0000 7fe246ca4640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe2401392d0 0x7fe24014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-b con 0x7fe2401392d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-c con 0x7fe24013be70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): picked mon.noname-a con 0x7fe24013c780 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe24008ea30 con 0x7fe24013c780 2026-02-22T20:53:47.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe240086b40 con 0x7fe2401392d0 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe24008ebb0 con 0x7fe24013be70 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient(hunting): authenticate will time out at 639.980062s 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34904/0 (socket says 10.20.193.7:34904) 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 1 -- 10.20.193.7:0/2100056240 learned_addr learned my addr 10.20.193.7:0/2100056240 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): get_auth_request con 0x7fe24013c780 auth_method 0 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46368/0 (socket says 10.20.193.7:46368) 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): get_auth_request con 0x7fe24013be70 auth_method 0 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe2401392d0 0x7fe24014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 10 monclient(hunting): get_auth_request con 0x7fe2401392d0 auth_method 0 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient(hunting): handle_auth_done global_id 4757 payload 824 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 -- 10.20.193.7:0/2100056240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe2401392d0 msgr2=0x7fe24014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe2401392d0 0x7fe24014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 -- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 msgr2=0x7fe240126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 monclient: found mon.noname-c 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 -- 10.20.193.7:0/2100056240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240138eb0 con 0x7fe24013be70 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe24521a640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe237fff640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c500 tx=0x7fe22800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228018070 con 0x7fe24013be70 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: dump: 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.526 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe228004cf0 con 0x7fe24013be70 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228007350 con 0x7fe24013be70 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 10 monclient: dump: 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.528 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe236ffd640 4 set_mon_vals no callback set 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 5 monclient: authenticate success, global_id 4757 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _renew_subs 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24012a900 con 0x7fe24013be70 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _renew_subs 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24012a620 con 0x7fe24013be70 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2400382a0 con 0x7fe24013be70 2026-02-22T20:53:47.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe2280074f0 con 0x7fe24013be70 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 --2- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 0x7fe21005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(68..68 src has 1..68) ==== 3503+0+0 (secure 0 0 0) 0x7fe22804d9b0 con 0x7fe24013be70 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 1 --2- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 0x7fe21005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 10 monclient: get_auth_request con 0x7fe21003ab20 auth_method 0 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.504+0000 7fe244a19640 1 --2- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 0x7fe21005afd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe23001c8c0 tx=0x7fe2300a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.508+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fe228011360 con 0x7fe24013be70 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.508+0000 7fe2357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.508+0000 7fe2357fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:47.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe246ca4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe246ca4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe246ca4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe240086620 con 0x7fe24013be70 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe2357fa640 1 -- 10.20.193.7:0/2100056240 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fe2280090e0 con 0x7fe24013be70 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe2357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.616+0000 7fe2357fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 msgr2=0x7fe21005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 0x7fe21005afd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe23001c8c0 tx=0x7fe2300a9070 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 10 monclient: shutdown 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 msgr2=0x7fe24014d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c500 tx=0x7fe22800c9c0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 shutdown_connections 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24013c780 0x7fe240126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe24013be70 0x7fe24014d800 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21003ab20 0x7fe21005afd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 --2- 10.20.193.7:0/2100056240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe2401392d0 0x7fe24014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 >> 10.20.193.7:0/2100056240 conn(0x7fe24008f860 msgr2=0x7fe240089d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 shutdown_connections 2026-02-22T20:53:47.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.620+0000 7fe246ca4640 1 -- 10.20.193.7:0/2100056240 wait complete. 2026-02-22T20:53:47.632 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:53:47.632 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:53:47.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:53:47.632 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: get_monmap_and_config 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: monmap: 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.703 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:47.702310+0000 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:47.702310+0000 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 Processor -- start 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 -- start start 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: init 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-b con 0x7f9d0008b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 0x7f9d0013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-a con 0x7f9d0013a4d0 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9d0013d530 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d00089920 con 0x7f9d0013d530 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0008ab40 con 0x7f9d0013a4d0 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0008a860 con 0x7f9d0008b590 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9d06756640 10 monclient(hunting): authenticate will time out at 640.175214s 2026-02-22T20:53:47.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 0x7f9d0013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46380/0 (socket says 10.20.193.7:46380) 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 -- 10.20.193.7:0/926757708 learned_addr learned my addr 10.20.193.7:0/926757708 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): get_auth_request con 0x7f9d0008b590 auth_method 0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request con 0x7f9d0013a4d0 auth_method 0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient(hunting): handle_auth_done global_id 4760 payload 274 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 -- 10.20.193.7:0/926757708 >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 msgr2=0x7f9d0013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 --2- 10.20.193.7:0/926757708 >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 0x7f9d0013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 -- 10.20.193.7:0/926757708 >> v1:10.20.193.7:6789/0 conn(0x7f9d0013d530 legacy=0x7f9d0019e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 monclient: found mon.noname-b 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cfffff640 1 -- 10.20.193.7:0/926757708 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00089170 con 0x7f9d0008b590 2026-02-22T20:53:47.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.696+0000 7f9cff7fe640 1 --2- 10.20.193.7:0/926757708 >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 0x7f9d0013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:53:47.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 1 --2- 10.20.193.7:0/926757708 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec01c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc24fea5f103efe0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 1 -- 10.20.193.7:0/926757708 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0ab610 con 0x7f9d0008b590 2026-02-22T20:53:47.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:53:47.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: dump: 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 1 -- 10.20.193.7:0/926757708 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec0b0070 con 0x7f9d0008b590 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 1 -- 10.20.193.7:0/926757708 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0ab9d0 con 0x7f9d0008b590 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfeffd640 10 monclient: dump: 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 5 monclient: authenticate success, global_id 4760 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 4 set_mon_vals no callback set 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: shutdown 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/926757708 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 msgr2=0x7f9d00139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- 10.20.193.7:0/926757708 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec01c590 comp rx=0 tx=0).stop 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/926757708 shutdown_connections 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- 10.20.193.7:0/926757708 >> v2:10.20.193.7:3300/0 conn(0x7f9d0013a4d0 0x7f9d0013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- 10.20.193.7:0/926757708 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0008b590 0x7f9d00139f90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/926757708 >> 10.20.193.7:0/926757708 conn(0x7f9d0008faa0 msgr2=0x7f9d0008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/926757708 shutdown_connections 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/926757708 wait complete. 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: monmap: 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 Processor -- start 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- start start 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: init 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9d0008b590 0x7f9d000869d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-b con 0x7f9d0008b590 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-c con 0x7f9d0013a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 0x7f9d00087450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): picked mon.noname-a con 0x7f9d0013d530 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001a22c0 con 0x7f9d0013d530 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0013aab0 con 0x7f9d0008b590 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9d001a2440 con 0x7f9d0013a4d0 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): authenticate will time out at 640.178456s 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 0x7f9d00087450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 0x7f9d00087450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34928/0 (socket says 10.20.193.7:34928) 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46382/0 (socket says 10.20.193.7:46382) 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 learned_addr learned my addr 10.20.193.7:0/2810683651 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): get_auth_request con 0x7f9d0013d530 auth_method 0 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request con 0x7f9d0013a4d0 auth_method 0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 msgr2=0x7f9d00086f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 msgr2=0x7f9d00086f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9d0008b590 0x7f9d000869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): get_auth_request con 0x7f9d0008b590 auth_method 0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient(hunting): handle_auth_done global_id 5007 payload 824 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 msgr2=0x7f9d00086f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9d0013a4d0 0x7f9d00086f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9d0008b590 msgr2=0x7f9d000869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9d0008b590 0x7f9d000869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 monclient: found mon.noname-a 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0012d4d0 con 0x7f9d0013d530 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d04ccc640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 0x7f9d00087450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400cbe0 tx=0x7f9cf400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ad40 con 0x7f9d0013d530 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: dump: 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.710 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf4003a30 con 0x7f9d0013d530 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4003de0 con 0x7f9d0013d530 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: dump: 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 5 monclient: authenticate success, global_id 5007 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _renew_subs 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfe7fc640 4 set_mon_vals no callback set 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0012d7b0 con 0x7f9d0013d530 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _renew_subs 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0012bfb0 con 0x7f9d0013d530 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 0x7f9d00150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00139f90 con 0x7f9d001509e0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 0x7f9d00150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient: get_auth_request con 0x7f9d001509e0 auth_method 0 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9cf4023060 con 0x7f9d0013d530 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 10 monclient(hunting): handle_auth_done global_id 5010 payload 824 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d0012bd00 con 0x7f9d001509e0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 --2- 10.20.193.7:0/2810683651 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9cd003ab20 0x7f9cd005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3503+0+0 (secure 0 0 0) 0x7f9cf404ecd0 con 0x7f9d0013d530 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfffff640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 0x7f9d00150db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec004020 con 0x7f9d001509e0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cfcff9640 10 monclient: dump: 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 1 --2- 10.20.193.7:0/2810683651 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9cd003ab20 0x7f9cd005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.700+0000 7f9cff7fe640 10 monclient: get_auth_request con 0x7f9cd003ab20 auth_method 0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f9cec0b0040 con 0x7f9d001509e0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 msgr2=0x7f9d00150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 0x7f9d00150db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec019330 comp rx=0 tx=0).stop 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 msgr2=0x7f9d00150db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfcff9640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d001509e0 0x7f9d00150db0 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec019330 comp rx=0 tx=0).stop 2026-02-22T20:53:47.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cff7fe640 1 --2- 10.20.193.7:0/2810683651 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9cd003ab20 0x7f9cd005afd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d00139d10 tx=0x7f9cf0009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9d06756640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9d06756640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 0x7f9d00059230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9d06756640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0012d150 con 0x7f9d00058e30 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 0x7f9d00059230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient: get_auth_request con 0x7f9d00058e30 auth_method 0 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 10 monclient(hunting): handle_auth_done global_id 5013 payload 824 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 1 -- 10.20.193.7:0/2810683651 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d0012d300 con 0x7f9d00058e30 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.704+0000 7f9cfffff640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 0x7f9d00059230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0c4660 con 0x7f9d00058e30 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 10 monclient: dump: 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f9cec0c4660 con 0x7f9d00058e30 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 msgr2=0x7f9d00059230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 0x7f9d00059230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec009300 comp rx=0 tx=0).stop 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 msgr2=0x7f9d00059230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9cfcff9640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d00058e30 0x7f9d00059230 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0090a0 tx=0x7f9cec009300 comp rx=0 tx=0).stop 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 106838, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.714 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.715 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.716 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.717 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:47.718 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9cd003ab20 msgr2=0x7f9cd005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 --2- 10.20.193.7:0/2810683651 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9cd003ab20 0x7f9cd005afd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d00139d10 tx=0x7f9cf0009290 comp rx=0 tx=0).stop 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 10 monclient: shutdown 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 msgr2=0x7f9d00087450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 --2- 10.20.193.7:0/2810683651 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9d0013d530 0x7f9d00087450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400cbe0 tx=0x7f9cf400a430 comp rx=0 tx=0).stop 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 reap_dead start 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d04ccc640 1 -- 10.20.193.7:0/2810683651 reap_dead start 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 shutdown_connections 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 >> 10.20.193.7:0/2810683651 conn(0x7f9d0008faa0 msgr2=0x7f9d0013b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 shutdown_connections 2026-02-22T20:53:47.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.708+0000 7f9d06756640 1 -- 10.20.193.7:0/2810683651 wait complete. 2026-02-22T20:53:47.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:47.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:53:47.719 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:53:47.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.776+0000 7f41dda08640 10 monclient: get_monmap_and_config 2026-02-22T20:53:47.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.776+0000 7f41dda08640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.776+0000 7f41dda08640 10 monclient: monmap: 2026-02-22T20:53:47.782 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.782 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:47.783528+0000 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:47.783528+0000 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:47.783 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 Processor -- start 2026-02-22T20:53:47.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- start start 2026-02-22T20:53:47.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: init 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f41d813f290 0x7f41d813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-c con 0x7f41d813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f41d813fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f41d813c680 0x7f41d81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-a con 0x7f41d813c680 addr v2:10.20.193.7:3300/0 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d808fd70 con 0x7f41d813fba0 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f41d808e1f0 con 0x7f41d813c680 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f41d808ec90 con 0x7f41d813f290 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): authenticate will time out at 640.256800s 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f41d813c680 0x7f41d81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f41d813c680 0x7f41d81a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34954/0 (socket says 10.20.193.7:34954) 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 -- 10.20.193.7:0/2657588945 learned_addr learned my addr 10.20.193.7:0/2657588945 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): get_auth_request con 0x7f41d813c680 auth_method 0 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 1 --2- 10.20.193.7:0/2657588945 >> v2:10.20.193.61:3300/0 conn(0x7f41d813f290 0x7f41d813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request con 0x7f41d813f290 auth_method 0 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient(hunting): handle_auth_done global_id 5016 payload 274 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 -- 10.20.193.7:0/2657588945 >> v2:10.20.193.61:3300/0 conn(0x7f41d813f290 msgr2=0x7f41d813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 --2- 10.20.193.7:0/2657588945 >> v2:10.20.193.61:3300/0 conn(0x7f41d813f290 0x7f41d813f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 -- 10.20.193.7:0/2657588945 >> v1:10.20.193.61:6789/0 conn(0x7f41d813fba0 legacy=0x7f41d813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 monclient: found mon.noname-a 2026-02-22T20:53:47.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 -- 10.20.193.7:0/2657588945 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d8092bc0 con 0x7f41d813c680 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d77fe640 1 --2- 10.20.193.7:0/2657588945 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813c680 0x7f41d81a17e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41d80947c0 tx=0x7f41c801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5f35c9620f7cba server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 1 -- 10.20.193.7:0/2657588945 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b2070 con 0x7f41d813c680 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: dump: 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 1 -- 10.20.193.7:0/2657588945 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c80a5940 con 0x7f41d813c680 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 1 -- 10.20.193.7:0/2657588945 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a5d30 con 0x7f41d813c680 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41d5ffb640 10 monclient: dump: 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 5 monclient: authenticate success, global_id 5016 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 4 set_mon_vals no callback set 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: shutdown 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- 10.20.193.7:0/2657588945 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813c680 msgr2=0x7f41d81a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- 10.20.193.7:0/2657588945 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813c680 0x7f41d81a17e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41d80947c0 tx=0x7f41c801c880 comp rx=0 tx=0).stop 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- 10.20.193.7:0/2657588945 shutdown_connections 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- 10.20.193.7:0/2657588945 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813c680 0x7f41d81a17e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- 10.20.193.7:0/2657588945 >> v2:10.20.193.61:3300/0 conn(0x7f41d813f290 0x7f41d813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- 10.20.193.7:0/2657588945 >> 10.20.193.7:0/2657588945 conn(0x7f41d8093df0 msgr2=0x7f41d80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- 10.20.193.7:0/2657588945 shutdown_connections 2026-02-22T20:53:47.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- 10.20.193.7:0/2657588945 wait complete. 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: monmap: 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:47.794 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 Processor -- start 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 -- start start 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: init 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-c con 0x7f41d813c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41d813f290 0x7f41d8129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-b con 0x7f41d813f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.780+0000 7f41dda08640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 0x7f41d812a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): picked mon.noname-a con 0x7f41d813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41d8090de0 con 0x7f41d813fba0 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f41d8090c60 con 0x7f41d813f290 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f41d81a4540 con 0x7f41d813c680 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): authenticate will time out at 640.260015s 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 0x7f41d812a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:46388/0 (socket says 10.20.193.7:46388) 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 0x7f41d812a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34970/0 (socket says 10.20.193.7:34970) 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 -- 10.20.193.7:0/1630898260 learned_addr learned my addr 10.20.193.7:0/1630898260 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request con 0x7f41d813c680 auth_method 0 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): get_auth_request con 0x7f41d813fba0 auth_method 0 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41d813f290 0x7f41d8129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_done global_id 4766 payload 824 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41d813f290 msgr2=0x7f41d8129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41d813f290 0x7f41d8129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 msgr2=0x7f41d812a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 0x7f41d812a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 monclient: found mon.noname-c 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d813c340 con 0x7f41d813c680 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient: get_auth_request con 0x7f41d813f290 auth_method 0 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41d813f290 0x7f41d8129e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41d813fba0 0x7f41d812a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d6ffd640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009430 tx=0x7f41cc00ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc017070 con 0x7f41d813c680 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: dump: 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.798 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc00c940 con 0x7f41d813c680 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00cd30 con 0x7f41d813c680 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: dump: 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.799 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 5 monclient: authenticate success, global_id 4766 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient: _renew_subs 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d57fa640 4 set_mon_vals no callback set 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d812d3b0 con 0x7f41d813c680 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient: _renew_subs 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d812cb00 con 0x7f41d813c680 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 0x7f41d80886e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f41d808a9e0 con 0x7f41d812a8d0 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 0x7f41d80886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient: get_auth_request con 0x7f41d812a8d0 auth_method 0 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 10 monclient(hunting): handle_auth_done global_id 4769 payload 824 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41d812aca0 con 0x7f41d812a8d0 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f41cc013470 con 0x7f41d813c680 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 0x7f41d80886e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c000db80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 --2- 10.20.193.7:0/1630898260 >> v2:10.20.193.61:6800/2336688312 conn(0x7f41a803ab20 0x7f41a805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(68..68 src has 1..68) ==== 3503+0+0 (secure 0 0 0) 0x7f41cc04edc0 con 0x7f41d813c680 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0005270 con 0x7f41d812a8d0 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: dump: 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.801 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f41c0005270 con 0x7f41d812a8d0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 msgr2=0x7f41d80886e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 0x7f41d80886e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c000db80 comp rx=0 tx=0).stop 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 msgr2=0x7f41d80886e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41affff640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d812a8d0 0x7f41d80886e0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c000db80 comp rx=0 tx=0).stop 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 1 --2- 10.20.193.7:0/1630898260 >> v2:10.20.193.61:6800/2336688312 conn(0x7f41a803ab20 0x7f41a805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 10 monclient: get_auth_request con 0x7f41a803ab20 auth_method 0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.784+0000 7f41d77fe640 1 --2- 10.20.193.7:0/1630898260 >> v2:10.20.193.61:6800/2336688312 conn(0x7f41a803ab20 0x7f41a805afd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009c00 tx=0x7f41c80a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 0x7f41d8089020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f41d805fb70 con 0x7f41d8088c20 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 0x7f41d8089020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient: get_auth_request con 0x7f41d8088c20 auth_method 0 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 10 monclient(hunting): handle_auth_done global_id 4772 payload 824 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 1 -- 10.20.193.7:0/1630898260 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41d8089560 con 0x7f41d8088c20 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d67fc640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 0x7f41d8089020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c00026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c001b640 con 0x7f41d8088c20 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 10 monclient: dump: 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7f41c001b640 con 0x7f41d8088c20 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:47.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 msgr2=0x7f41d8089020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 0x7f41d8089020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c00026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 msgr2=0x7f41d8089020 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41affff640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d8088c20 0x7f41d8089020 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41d812c100 tx=0x7f41c00026e0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 106914, 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:47.804 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.805 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:47.806 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.807 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.808 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.809 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.810 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.811 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:47.812 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:47.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 >> v2:10.20.193.61:6800/2336688312 conn(0x7f41a803ab20 msgr2=0x7f41a805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 --2- 10.20.193.7:0/1630898260 >> v2:10.20.193.61:6800/2336688312 conn(0x7f41a803ab20 0x7f41a805afd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009c00 tx=0x7f41c80a7070 comp rx=0 tx=0).stop 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 10 monclient: shutdown 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 msgr2=0x7f41d812c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009430 tx=0x7f41cc00ee10 comp rx=0 tx=0).stop 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41d77fe640 1 -- 10.20.193.7:0/1630898260 reap_dead start 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 shutdown_connections 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 --2- 10.20.193.7:0/1630898260 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41d813c680 0x7f41d812c170 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 >> 10.20.193.7:0/1630898260 conn(0x7f41d8093df0 msgr2=0x7f41d8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 shutdown_connections 2026-02-22T20:53:47.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.788+0000 7f41dda08640 1 -- 10.20.193.7:0/1630898260 wait complete. 2026-02-22T20:53:47.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:47.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:53:47.814 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:53:47.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: get_monmap_and_config 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: monmap: 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:53:47.876812+0000 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:53:47.876812+0000 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.876 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:53:47.877 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:53:47.877 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:53:47.877 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:53:47.877 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:53:47.877 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 Processor -- start 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 -- start start 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: init 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 0x7f479413f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): picked mon.noname-b con 0x7f479413f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f479413fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f479413c680 addr v1:10.20.193.61:6789/0 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479408fd70 con 0x7f479413fba0 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4794092bc0 con 0x7f479413c680 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f479408e1f0 con 0x7f479413f290 2026-02-22T20:53:47.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient(hunting): authenticate will time out at 640.349768s 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 0x7f479413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478bfff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f479413fba0 0x7f479413bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48578/0 (socket says 10.20.193.7:48578) 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478bfff640 1 -- 10.20.193.7:0/881493100 learned_addr learned my addr 10.20.193.7:0/881493100 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): get_auth_request con 0x7f479413f290 auth_method 0 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 1 -- 10.20.193.7:0/881493100 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314142844 0 0) 0x7f477c002920 con 0x7f479413fba0 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient(hunting): _negotiate 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient(hunting): my global_id is 5022 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 1 -- 10.20.193.7:0/881493100 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4780003620 con 0x7f479413fba0 2026-02-22T20:53:47.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient(hunting): handle_auth_done global_id 4775 payload 274 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 -- 10.20.193.7:0/881493100 >> v1:10.20.193.61:6789/0 conn(0x7f479413c680 legacy=0x7f47941a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 -- 10.20.193.7:0/881493100 >> v1:10.20.193.7:6789/0 conn(0x7f479413fba0 legacy=0x7f479413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 monclient: found mon.noname-b 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 -- 10.20.193.7:0/881493100 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479408e6d0 con 0x7f479413f290 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f4798fb5640 1 --2- 10.20.193.7:0/881493100 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 0x7f479413f660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4784009840 tx=0x7f478401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c92f005534dc8f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 1 -- 10.20.193.7:0/881493100 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840aa600 con 0x7f479413f290 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: dump: 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.885 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 1 -- 10.20.193.7:0/881493100 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840af070 con 0x7f479413f290 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 1 -- 10.20.193.7:0/881493100 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840aa9c0 con 0x7f479413f290 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 5 monclient: authenticate success, global_id 4775 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: get_monmap_and_config success 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 4 set_mon_vals no callback set 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f478b7fe640 10 monclient: dump: 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.886 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 10 monclient: shutdown 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 -- 10.20.193.7:0/881493100 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 msgr2=0x7f479413f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.872+0000 7f479b240640 1 --2- 10.20.193.7:0/881493100 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 0x7f479413f660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4784009840 tx=0x7f478401c4c0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/881493100 shutdown_connections 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 --2- 10.20.193.7:0/881493100 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413f290 0x7f479413f660 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/881493100 >> 10.20.193.7:0/881493100 conn(0x7f4794093df0 msgr2=0x7f47940902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/881493100 shutdown_connections 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/881493100 wait complete. 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: build_initial_monmap 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: monmap: 2026-02-22T20:53:47.887 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 Processor -- start 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- start start 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: init 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _reopen_session rank -1 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): picked mon.noname-a con 0x7f479413c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479413f290 0x7f4794151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): picked mon.noname-b con 0x7f479413f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:53:47.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413fba0 0x7f479412a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): picked mon.noname-c con 0x7f479413fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f47941a58a0 con 0x7f479413c680 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f47941a5720 con 0x7f479413f290 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f47941a5a20 con 0x7f479413fba0 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): _renew_subs 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): authenticate will time out at 640.353312s 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:34980/0 (socket says 10.20.193.7:34980) 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 -- 10.20.193.7:0/2705236987 learned_addr learned my addr 10.20.193.7:0/2705236987 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): get_auth_request con 0x7f479413c680 auth_method 0 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413fba0 0x7f479412a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): get_auth_request con 0x7f479413fba0 auth_method 0 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479413f290 0x7f4794151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): get_auth_request con 0x7f479413f290 auth_method 0 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413fba0 msgr2=0x7f479412a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f479413fba0 0x7f479412a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479413f290 msgr2=0x7f4794151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479413f290 0x7f4794151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient: _finish_hunting 0 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 monclient: found mon.noname-a 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479412dcb0 con 0x7f479413c680 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f4798fb5640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f478401ca30 tx=0x7f4784019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840b8020 con 0x7f479413c680 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: dump: 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.891 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: _finish_auth 0 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: _check_auth_tickets 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4784003c60 con 0x7f479413c680 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840aa600 con 0x7f479413c680 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: dump: 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.892 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 5 monclient: authenticate success, global_id 5025 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478affd640 4 set_mon_vals no callback set 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _renew_subs 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479413c260 con 0x7f479413c680 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _renew_subs 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479412d410 con 0x7f479413c680 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 0x7f479412a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f479413f660 con 0x7f479412a5c0 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f47840aa7a0 con 0x7f479413c680 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 0x7f479412a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient: get_auth_request con 0x7f479412a5c0 auth_method 0 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 --2- 10.20.193.7:0/2705236987 >> v2:10.20.193.61:6800/2336688312 conn(0x7f476403ab20 0x7f476405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3503+0+0 (secure 0 0 0) 0x7f47840e8eb0 con 0x7f479413c680 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 10 monclient(hunting): handle_auth_done global_id 54145 payload 824 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 1 --2- 10.20.193.7:0/2705236987 >> v2:10.20.193.61:6800/2336688312 conn(0x7f476403ab20 0x7f476405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f479408a9e0 con 0x7f479412a5c0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 10 monclient: get_auth_request con 0x7f476403ab20 auth_method 0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f478bfff640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 0x7f479412a990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f479412c440 tx=0x7f477c00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0059b0 con 0x7f479412a5c0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: dump: 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.894 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47997b6640 1 --2- 10.20.193.7:0/2705236987 >> v2:10.20.193.61:6800/2336688312 conn(0x7f476403ab20 0x7f476405afd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4790003b30 tx=0x7f4790004270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f477c018070 con 0x7f479412a5c0 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 msgr2=0x7f479412a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 0x7f479412a990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f479412c440 tx=0x7f477c00eb90 comp rx=0 tx=0).stop 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 msgr2=0x7f479412a990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.876+0000 7f47897fa640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412a5c0 0x7f479412a990 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f479412c440 tx=0x7f477c00eb90 comp rx=0 tx=0).stop 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f479b240640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f479b240640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 0x7f479408bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f479b240640 10 monclient(hunting): start opening mon connection 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f479405fb70 con 0x7f479412aed0 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 0x7f479408bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient: get_auth_request con 0x7f479412aed0 auth_method 0 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:53:47.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 10 monclient(hunting): handle_auth_done global_id 54148 payload 824 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 1 -- 10.20.193.7:0/2705236987 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f479412c4b0 con 0x7f479412aed0 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f478bfff640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 0x7f479408bce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f477c007c00 tx=0x7f477c0058f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c005bc0 con 0x7f479412aed0 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 10 monclient: dump: 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:53:47.898 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7f477c005bc0 con 0x7f479412aed0 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 msgr2=0x7f479408bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 0x7f479408bce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f477c007c00 tx=0x7f477c0058f0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 msgr2=0x7f479408bce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.880+0000 7f47897fa640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f479412aed0 0x7f479408bce0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f477c007c00 tx=0x7f477c0058f0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:47.899 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 20, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 11111, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.900 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.901 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:53:47.902 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:53:47.903 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.904 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.905 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.906 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:53:47.907 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:53:47.908 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 >> v2:10.20.193.61:6800/2336688312 conn(0x7f476403ab20 msgr2=0x7f476405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 --2- 10.20.193.7:0/2705236987 >> v2:10.20.193.61:6800/2336688312 conn(0x7f476403ab20 0x7f476405afd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4790003b30 tx=0x7f4790004270 comp rx=0 tx=0).stop 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 10 monclient: shutdown 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 msgr2=0x7f4794150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f478401ca30 tx=0x7f4784019260 comp rx=0 tx=0).stop 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f47997b6640 1 -- 10.20.193.7:0/2705236987 reap_dead start 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 shutdown_connections 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 --2- 10.20.193.7:0/2705236987 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f479413c680 0x7f4794150b00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 >> 10.20.193.7:0/2705236987 conn(0x7f4794093df0 msgr2=0x7f4794055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 shutdown_connections 2026-02-22T20:53:47.909 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:53:47.884+0000 7f479b240640 1 -- 10.20.193.7:0/2705236987 wait complete. 2026-02-22T20:53:47.910 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:53:47.910 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-22T20:53:47.910 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-22T20:53:47.910 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-22T20:53:47.910 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-22T20:53:47.910 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T20:53:47.910 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:53:47.922 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T20:53:47.922 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T20:53:47.922 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T20:53:47.923 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2026-02-22T20:53:51.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:51.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:53:56.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:53:56.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:01.944 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:54:01] 2026-02-22T20:54:01.944 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:54:01 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['.mgr', 'rbd'] 2026-02-22T20:54:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T20:54:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:54:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:54:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:54:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:54:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:54:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:54:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:54:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:54:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:54:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:54:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:54:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:54:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:54:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:54:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:54:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:54:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1] pools [1, 2] with 6 osds, pg_target 600 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:54:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:06.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:06.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:07.923 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T20:54:07.923 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T20:54:07.924 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:54:07.924 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:54:07.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: get_monmap_and_config 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: build_initial_monmap 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: monmap: 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:07.986973+0000 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:07.986973+0000 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:07.986 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 Processor -- start 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 -- start start 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: init 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26d813cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-c con 0x7f26d813d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26d817e9a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d805d510 con 0x7f26d817e9a0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d808b800 con 0x7f26d813cef0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f26d808a720 con 0x7f26d813d9d0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.980+0000 7f26dcc30640 10 monclient(hunting): authenticate will time out at 660.459879s 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d6d76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 0x7f26d819ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:58992/0 (socket says 10.20.193.7:58992) 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 learned_addr learned my addr 10.20.193.7:0/2475358673 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 10 monclient(hunting): get_auth_request con 0x7f26d813d9d0 auth_method 0 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:54:07.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:07.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:07.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:07.984+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:08.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:08.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 10 monclient(hunting): get_auth_request con 0x7f26d813d9d0 auth_method 0 2026-02-22T20:54:08.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:08.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:08.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:08.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:54:08.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:08.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:08.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.192+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:54:08.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:08.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 10 monclient(hunting): get_auth_request con 0x7f26d813d9d0 auth_method 0 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:08.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:08.596+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:54:09.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 10 monclient(hunting): get_auth_request con 0x7f26d813d9d0 auth_method 0 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:09.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:09.400+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:54:10.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.880+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 legacy=0x7f26d819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-22T20:54:10.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.880+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 legacy=0x7f26d819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:54:10.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.880+0000 7f26d6d76640 1 --1- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 0x7f26d819ed80 :-1 s=OPENED pgs=273 cs=1 l=1).handle_message read tag failed 2026-02-22T20:54:10.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.880+0000 7f26d6d76640 1 --1- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 0x7f26d819ed80 :-1 s=OPENED pgs=273 cs=1 l=1).fault on lossy channel, failing 2026-02-22T20:54:10.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.880+0000 7f26d5573640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.7:6789/0 2026-02-22T20:54:10.889 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:54:10.889 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:54:10.896 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:54:10.896 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:54:10.897 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.898 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:54:10.899 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:54:10.900 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:54:10.901 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:54:10.902 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:54:10.903 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:54:10.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): tick 2026-02-22T20:54:10.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:54:10.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 monclient(hunting): continuing hunt 2026-02-22T20:54:10.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:54:10.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 msgr2=0x7f26d817e460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.61:3300/0 conn(0x7f26d813d9d0 0x7f26d817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.61:6789/0 conn(0x7f26d813cef0 legacy=0x7f26d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26d817e9a0 legacy=0x7f26d819ed80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient: _add_conns ranks=[3,2] 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): picked mon.noname-a con 0x7f26b40036f0 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): picked mon.noname-b con 0x7f26b4024220 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f26d808a720 con 0x7f26b40036f0 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:10.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f26b4044e00 con 0x7f26b4024220 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.980+0000 7f26bffff640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 msgr2=0x7f26b40446d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 10 monclient(hunting): get_auth_request con 0x7f26b40036f0 auth_method 0 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:10.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:54:10.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:10.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:10.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:10.984+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:11.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 msgr2=0x7f26b40446d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 10 monclient(hunting): get_auth_request con 0x7f26b40036f0 auth_method 0 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:11.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.188+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:54:11.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 msgr2=0x7f26b40446d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:11.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:54:11.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:11.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 10 monclient(hunting): get_auth_request con 0x7f26b40036f0 auth_method 0 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:11.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:11.592+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:54:11.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:11.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:12.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d5d74640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 msgr2=0x7f26b40446d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:12.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d5d74640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 10 monclient(hunting): get_auth_request con 0x7f26b40036f0 auth_method 0 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:54:12.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:12.396+0000 7f26d6575640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): tick 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 monclient(hunting): continuing hunt 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 msgr2=0x7f26b40446d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4024220 0x7f26b40446d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 msgr2=0x7f26b4023b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b40036f0 0x7f26b4023b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 reap_dead start 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26b40246a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26b40051e0 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b4006e00 0x7f26b4007280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): picked mon.noname-a con 0x7f26b4006e00 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d808aa00 con 0x7f26b40051e0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b4008980 con 0x7f26b40246a0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 1 -- 10.20.193.7:0/2475358673 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f26d808a720 con 0x7f26b4006e00 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26bffff640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 --2- 10.20.193.7:0/2475358673 >> v2:10.20.193.7:3300/0 conn(0x7f26b4006e00 0x7f26b4007280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): get_auth_request con 0x7f26b4006e00 auth_method 0 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:13.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient(hunting): handle_auth_done global_id 5028 payload 274 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.61:6789/0 conn(0x7f26b40246a0 legacy=0x7f26b4003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 >> v1:10.20.193.7:6789/0 conn(0x7f26b40051e0 legacy=0x7f26b4005680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient: _finish_hunting 0 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 monclient: found mon.noname-a 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 -- 10.20.193.7:0/2475358673 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b4009c20 con 0x7f26b4006e00 2026-02-22T20:54:13.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d6d76640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b4006e00 0x7f26b4007280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26d813ddf0 tx=0x7f26c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c389637a1360d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 1 -- 10.20.193.7:0/2475358673 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c80ac630 con 0x7f26b4006e00 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: dump: 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: _finish_auth 0 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: _check_auth_tickets 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 1 -- 10.20.193.7:0/2475358673 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c80ac7d0 con 0x7f26b4006e00 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 1 -- 10.20.193.7:0/2475358673 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c80acba0 con 0x7f26b4006e00 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26d5573640 10 monclient: dump: 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 5 monclient: authenticate success, global_id 5028 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:13.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 4 set_mon_vals no callback set 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 10 monclient: shutdown 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 -- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b4006e00 msgr2=0x7f26b4007280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b4006e00 0x7f26b4007280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26d813ddf0 tx=0x7f26c801c9d0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 -- 10.20.193.7:0/2475358673 shutdown_connections 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 --2- 10.20.193.7:0/2475358673 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b4006e00 0x7f26b4007280 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 -- 10.20.193.7:0/2475358673 >> 10.20.193.7:0/2475358673 conn(0x7f26d808f860 msgr2=0x7f26d808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 -- 10.20.193.7:0/2475358673 shutdown_connections 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 1 -- 10.20.193.7:0/2475358673 wait complete. 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 10 monclient: build_initial_monmap 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.983+0000 7f26dcc30640 10 monclient: monmap: 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:13.990 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 Processor -- start 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- start start 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: init 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26b40051e0 0x7f26d8125430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-b con 0x7f26b40051e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 0x7f26d810e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-c con 0x7f26b4006e00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): picked mon.noname-a con 0x7f26b40246a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26d813a560 con 0x7f26b40246a0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f26d813a3e0 con 0x7f26b40051e0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f26d813a6e0 con 0x7f26b4006e00 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient(hunting): authenticate will time out at 666.464456s 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d5d74640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 msgr2=0x7f26d810e180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d5d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 0x7f26d810e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60242/0 (socket says 10.20.193.7:60242) 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 -- 10.20.193.7:0/797140874 learned_addr learned my addr 10.20.193.7:0/797140874 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): get_auth_request con 0x7f26b40246a0 auth_method 0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26b40051e0 0x7f26d8125430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 10 monclient(hunting): get_auth_request con 0x7f26b40051e0 auth_method 0 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient(hunting): handle_auth_done global_id 5031 payload 824 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 -- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 msgr2=0x7f26d810e180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:54:13.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 0x7f26d810e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 -- 10.20.193.7:0/797140874 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26b40051e0 msgr2=0x7f26d8125430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26b40051e0 0x7f26d8125430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient: _finish_hunting 0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 monclient: found mon.noname-a 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 -- 10.20.193.7:0/797140874 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d8120ac0 con 0x7f26b40246a0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6d76640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26c801cf40 tx=0x7f26c8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c80bb070 con 0x7f26b40246a0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: dump: 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: _finish_auth 0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c80acb80 con 0x7f26b40246a0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c80b63f0 con 0x7f26b40246a0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d4d72640 4 set_mon_vals no callback set 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 10 monclient: dump: 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 5 monclient: authenticate success, global_id 5031 2026-02-22T20:54:13.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _renew_subs 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d8086620 con 0x7f26b40246a0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _renew_subs 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d8126c30 con 0x7f26b40246a0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d8140450 con 0x7f26b40246a0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f26c80b5030 con 0x7f26b40246a0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 --2- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 0x7f26a405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3897+0+0 (secure 0 0 0) 0x7f26c80e7dc0 con 0x7f26b40246a0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 1 --2- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 0x7f26a405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 10 monclient: get_auth_request con 0x7f26a403aa90 auth_method 0 2026-02-22T20:54:13.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.987+0000 7f26d6575640 1 --2- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 0x7f26a405af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26cc002410 tx=0x7f26cc004040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.991+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f26d8120ac0 con 0x7f26b40246a0 2026-02-22T20:54:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.991+0000 7f26beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:13.991+0000 7f26beffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26dcc30640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26dcc30640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26dcc30640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f26d8124310 con 0x7f26b40246a0 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26beffd640 1 -- 10.20.193.7:0/797140874 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f26c80b3070 con 0x7f26b40246a0 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:14.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.099+0000 7f26beffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:14.108 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":22,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 msgr2=0x7f26a405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 0x7f26a405af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26cc002410 tx=0x7f26cc004040 comp rx=0 tx=0).stop 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 10 monclient: shutdown 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 msgr2=0x7f26d810e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26c801cf40 tx=0x7f26c8019770 comp rx=0 tx=0).stop 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 shutdown_connections 2026-02-22T20:54:14.109 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f26b40246a0 0x7f26d810e6c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f26b4006e00 0x7f26d810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26a403aa90 0x7f26a405af40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 --2- 10.20.193.7:0/797140874 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f26b40051e0 0x7f26d8125430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 >> 10.20.193.7:0/797140874 conn(0x7f26d808f860 msgr2=0x7f26d813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 shutdown_connections 2026-02-22T20:54:14.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.103+0000 7f26dcc30640 1 -- 10.20.193.7:0/797140874 wait complete. 2026-02-22T20:54:14.118 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:54:14.118 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:54:14.118 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:54:14.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.175+0000 7f2c4c9dc640 10 monclient: get_monmap_and_config 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.175+0000 7f2c4c9dc640 10 monclient: build_initial_monmap 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.175+0000 7f2c4c9dc640 10 monclient: monmap: 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:14.183789+0000 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:14.183789+0000 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:14.183 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:14.184 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:14.184 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:14.184 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:14.184 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 Processor -- start 2026-02-22T20:54:14.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- start start 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient: init 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f2c4813f290 0x7f2c4813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-c con 0x7f2c4813f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 0x7f2c4813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-b con 0x7f2c4813fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2c4813c4b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4808fd70 con 0x7f2c4813c4b0 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4808e1f0 con 0x7f2c4813f290 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4808ec90 con 0x7f2c4813fba0 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:14.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient(hunting): authenticate will time out at 666.657018s 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45d74640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 msgr2=0x7f2c4813bf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 0x7f2c4813bf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46d76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f2c4813c4b0 0x7f2c481a07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33904/0 (socket says 10.20.193.7:33904) 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46d76640 1 -- 10.20.193.7:0/2194097487 learned_addr learned my addr 10.20.193.7:0/2194097487 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 --2- 10.20.193.7:0/2194097487 >> v2:10.20.193.61:3300/0 conn(0x7f2c4813f290 0x7f2c4813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): get_auth_request con 0x7f2c4813f290 auth_method 0 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693183399 0 0) 0x7f2c38002ca0 con 0x7f2c4813c4b0 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient(hunting): _negotiate 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient(hunting): my global_id is 5034 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c34003620 con 0x7f2c4813c4b0 2026-02-22T20:54:14.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient(hunting): handle_auth_done global_id 54157 payload 274 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 -- 10.20.193.7:0/2194097487 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 msgr2=0x7f2c4813bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 --2- 10.20.193.7:0/2194097487 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 0x7f2c4813bf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2607829005 0 0) 0x7f2c34003620 con 0x7f2c4813c4b0 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 -- 10.20.193.7:0/2194097487 >> v1:10.20.193.7:6789/0 conn(0x7f2c4813c4b0 legacy=0x7f2c481a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient: _finish_hunting 0 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 monclient: found mon.noname-c 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 -- 10.20.193.7:0/2194097487 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48092bc0 con 0x7f2c4813f290 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c46575640 1 --2- 10.20.193.7:0/2194097487 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c4813f660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c480947c0 tx=0x7f2c3c01ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87bf67e82f8217d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b0070 con 0x7f2c4813f290 2026-02-22T20:54:14.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: dump: 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.206 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: _finish_auth 0 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: _check_auth_tickets 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:14.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 5 monclient: authenticate success, global_id 54157 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0ab400 con 0x7f2c4813f290 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 1 -- 10.20.193.7:0/2194097487 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380033b0 con 0x7f2c4813f290 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:14.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c45573640 10 monclient: dump: 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 4 set_mon_vals no callback set 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 10 monclient: shutdown 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2194097487 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 msgr2=0x7f2c4813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2194097487 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c4813f660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c480947c0 tx=0x7f2c3c01ceb0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2194097487 shutdown_connections 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2194097487 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813fba0 0x7f2c4813bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2194097487 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c4813f660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2194097487 >> 10.20.193.7:0/2194097487 conn(0x7f2c48093df0 msgr2=0x7f2c480902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2194097487 shutdown_connections 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.179+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2194097487 wait complete. 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: build_initial_monmap 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: monmap: 2026-02-22T20:54:14.211 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:14.212 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 Processor -- start 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- start start 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: init 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813c4b0 0x7f2c48150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.213 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-c con 0x7f2c4813c4b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c48151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-b con 0x7f2c4813f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 0x7f2c48129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): picked mon.noname-a con 0x7f2c4813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48090e20 con 0x7f2c4813fba0 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.214 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48090ca0 con 0x7f2c4813f290 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2c481a4710 con 0x7f2c4813c4b0 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): authenticate will time out at 666.660871s 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813c4b0 msgr2=0x7f2c48150b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813c4b0 0x7f2c48150b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 0x7f2c48129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 0x7f2c48129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60248/0 (socket says 10.20.193.7:60248) 2026-02-22T20:54:14.215 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 learned_addr learned my addr 10.20.193.7:0/2701250745 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): get_auth_request con 0x7f2c4813fba0 auth_method 0 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c48151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 10 monclient(hunting): get_auth_request con 0x7f2c4813f290 auth_method 0 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient(hunting): handle_auth_done global_id 5037 payload 824 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813c4b0 msgr2=0x7f2c48150b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2c4813c4b0 0x7f2c48150b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 msgr2=0x7f2c48151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2c4813f290 0x7f2c48151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient: _finish_hunting 0 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 monclient: found mon.noname-a 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4812d8a0 con 0x7f2c4813fba0 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46d76640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 0x7f2c48129e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800cbb0 tx=0x7f2c3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38017070 con 0x7f2c4813fba0 2026-02-22T20:54:14.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: dump: 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: _finish_auth 0 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:14.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3800ad40 con 0x7f2c4813fba0 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 5 monclient: authenticate success, global_id 5037 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _renew_subs 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4813c130 con 0x7f2c4813fba0 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38012600 con 0x7f2c4813fba0 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: dump: 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.219 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c44d72640 4 set_mon_vals no callback set 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _renew_subs 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4812c380 con 0x7f2c4813fba0 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 0x7f2c4812a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4812d520 con 0x7f2c4812a390 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 0x7f2c4812a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient: get_auth_request con 0x7f2c4812a390 auth_method 0 2026-02-22T20:54:14.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 10 monclient(hunting): handle_auth_done global_id 5040 payload 824 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c4813f660 con 0x7f2c4812a390 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c46575640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 0x7f2c4812a760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c002410 tx=0x7f2c3c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2c3801b3b0 con 0x7f2c4813fba0 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 --2- 10.20.193.7:0/2701250745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2c1403aa50 0x7f2c1405af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3897+0+0 (secure 0 0 0) 0x7f2c3804e860 con 0x7f2c4813fba0 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b8020 con 0x7f2c4812a390 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: dump: 2026-02-22T20:54:14.221 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f2c3c009440 con 0x7f2c4812a390 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 msgr2=0x7f2c4812a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 0x7f2c4812a760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c002410 tx=0x7f2c3c01ac90 comp rx=0 tx=0).stop 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 msgr2=0x7f2c4812a760 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:14.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c2effd640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812a390 0x7f2c4812a760 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c002410 tx=0x7f2c3c01ac90 comp rx=0 tx=0).stop 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 1 --2- 10.20.193.7:0/2701250745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2c1403aa50 0x7f2c1405af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 10 monclient: get_auth_request con 0x7f2c1403aa50 auth_method 0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.183+0000 7f2c45d74640 1 --2- 10.20.193.7:0/2701250745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2c1403aa50 0x7f2c1405af00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006fd0 tx=0x7f2c30004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 0x7f2c480886c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4812cfb0 con 0x7f2c4812aca0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 0x7f2c480886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient: get_auth_request con 0x7f2c4812aca0 auth_method 0 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 10 monclient(hunting): handle_auth_done global_id 5043 payload 824 2026-02-22T20:54:14.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 1 -- 10.20.193.7:0/2701250745 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c4805fb50 con 0x7f2c4812aca0 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46575640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 0x7f2c480886c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c01ccf0 tx=0x7f2c3c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b8030 con 0x7f2c4812aca0 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 10 monclient: dump: 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f2c3c0b4640 con 0x7f2c4812aca0 2026-02-22T20:54:14.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 msgr2=0x7f2c480886c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 0x7f2c480886c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c01ccf0 tx=0x7f2c3c0191f0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 msgr2=0x7f2c480886c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c2effd640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4812aca0 0x7f2c480886c0 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c01ccf0 tx=0x7f2c3c0191f0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:54:14.225 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 22, 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 133317, 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.226 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.227 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:14.228 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.229 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.230 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:14.231 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.232 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.233 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.234 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:14.235 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:14.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2c1403aa50 msgr2=0x7f2c1405af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2701250745 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2c1403aa50 0x7f2c1405af00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006fd0 tx=0x7f2c30004ac0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 10 monclient: shutdown 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 msgr2=0x7f2c48129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 --2- 10.20.193.7:0/2701250745 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2c4813fba0 0x7f2c48129e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800cbb0 tx=0x7f2c3800a430 comp rx=0 tx=0).stop 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 reap_dead start 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c46d76640 1 -- 10.20.193.7:0/2701250745 reap_dead start 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 shutdown_connections 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 >> 10.20.193.7:0/2701250745 conn(0x7f2c48093df0 msgr2=0x7f2c48055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 shutdown_connections 2026-02-22T20:54:14.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.187+0000 7f2c4c9dc640 1 -- 10.20.193.7:0/2701250745 wait complete. 2026-02-22T20:54:14.236 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:54:14.236 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T20:54:14.237 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: get_monmap_and_config 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: build_initial_monmap 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: monmap: 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:14.309977+0000 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:14.309977+0000 2026-02-22T20:54:14.309 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 Processor -- start 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 -- start start 2026-02-22T20:54:14.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: init 2026-02-22T20:54:14.317 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:14.317 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe98405d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-b con 0x7fe98405d0c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 0x7fe98408c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-c con 0x7fe98408bde0 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fe98408c750 0x7fe9841a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-a con 0x7fe98408c750 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fe98408a4c0 con 0x7fe98408c750 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe98408a790 con 0x7fe98408bde0 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe98408b560 con 0x7fe98405d0c0 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a920640 10 monclient(hunting): authenticate will time out at 666.782892s 2026-02-22T20:54:14.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98991e640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 msgr2=0x7fe98405d490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98991e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe98405d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fe98408c750 0x7fe9841a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fe98408c750 0x7fe9841a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60268/0 (socket says 10.20.193.7:60268) 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 -- 10.20.193.7:0/341047479 learned_addr learned my addr 10.20.193.7:0/341047479 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): get_auth_request con 0x7fe98408c750 auth_method 0 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 1 --2- 10.20.193.7:0/341047479 >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 0x7fe98408c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 10 monclient(hunting): get_auth_request con 0x7fe98408bde0 auth_method 0 2026-02-22T20:54:14.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient(hunting): handle_auth_done global_id 5046 payload 274 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 -- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 msgr2=0x7fe98405d490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 --2- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe98405d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 -- 10.20.193.7:0/341047479 >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 msgr2=0x7fe98408c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 --2- 10.20.193.7:0/341047479 >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 0x7fe98408c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient: _finish_hunting 0 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 monclient: found mon.noname-a 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98a11f640 1 -- 10.20.193.7:0/341047479 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98408b840 con 0x7fe98408c750 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.303+0000 7fe98911d640 1 --2- 10.20.193.7:0/341047479 >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 0x7fe98408c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe9841a0420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe984056960 tx=0x7fe98001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1310128abee8e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 1 -- 10.20.193.7:0/341047479 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800b2070 con 0x7fe98408c750 2026-02-22T20:54:14.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: dump: 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: _finish_auth 0 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: _check_auth_tickets 2026-02-22T20:54:14.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 1 -- 10.20.193.7:0/341047479 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9800a57e0 con 0x7fe98408c750 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 1 -- 10.20.193.7:0/341047479 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800a5bd0 con 0x7fe98408c750 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98891c640 10 monclient: dump: 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.322 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 5 monclient: authenticate success, global_id 5046 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 4 set_mon_vals no callback set 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: shutdown 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 msgr2=0x7fe9841a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe9841a0420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe984056960 tx=0x7fe98001c8d0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/341047479 shutdown_connections 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe9841a0420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- 10.20.193.7:0/341047479 >> v2:10.20.193.61:3300/0 conn(0x7fe98408bde0 0x7fe98408c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- 10.20.193.7:0/341047479 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe98405d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/341047479 >> 10.20.193.7:0/341047479 conn(0x7fe98408d850 msgr2=0x7fe984051980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/341047479 shutdown_connections 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/341047479 wait complete. 2026-02-22T20:54:14.323 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: build_initial_monmap 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: monmap: 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 Processor -- start 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- start start 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: init 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:14.324 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe984150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-c con 0x7fe98405d0c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98408bde0 0x7fe984150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-b con 0x7fe98408bde0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): picked mon.noname-a con 0x7fe98408c750 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840522f0 con 0x7fe98408c750 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe98405d9d0 con 0x7fe98408bde0 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe984052470 con 0x7fe98405d0c0 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): authenticate will time out at 666.786093s 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 msgr2=0x7fe984150500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:54:14.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe984150500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60278/0 (socket says 10.20.193.7:60278) 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 -- 10.20.193.7:0/4266583710 learned_addr learned my addr 10.20.193.7:0/4266583710 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): get_auth_request con 0x7fe98408c750 auth_method 0 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98408bde0 0x7fe984150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): get_auth_request con 0x7fe98408bde0 auth_method 0 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient(hunting): handle_auth_done global_id 5049 payload 824 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 msgr2=0x7fe984150500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe98405d0c0 0x7fe984150500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98408bde0 msgr2=0x7fe984150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98408bde0 0x7fe984150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient: _finish_hunting 0 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 monclient: found mon.noname-a 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98412ec80 con 0x7fe98408c750 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a11f640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe9800b0040 tx=0x7fe980019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800ba020 con 0x7fe98408c750 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: dump: 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: _finish_auth 0 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: _check_auth_tickets 2026-02-22T20:54:14.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 5 monclient: authenticate success, global_id 5049 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _renew_subs 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9800a5b90 con 0x7fe98408c750 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98412dfc0 con 0x7fe98408c750 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800b2040 con 0x7fe98408c750 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 10 monclient: dump: 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.329 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe973fff640 4 set_mon_vals no callback set 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _renew_subs 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98413c850 con 0x7fe98408c750 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 0x7fe9841259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe98412dc40 con 0x7fe98412b1d0 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 0x7fe9841259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe980004040 con 0x7fe98408c750 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient: get_auth_request con 0x7fe98412b1d0 auth_method 0 2026-02-22T20:54:14.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 --2- 10.20.193.7:0/4266583710 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe95403aa80 0x7fe95405af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3897+0+0 (secure 0 0 0) 0x7fe9800e9400 con 0x7fe98408c750 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 10 monclient(hunting): handle_auth_done global_id 54169 payload 824 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 1 --2- 10.20.193.7:0/4266583710 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe95403aa80 0x7fe95405af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe98405d490 con 0x7fe98412b1d0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98911d640 10 monclient: get_auth_request con 0x7fe95403aa80 auth_method 0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.307+0000 7fe98991e640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 0x7fe9841259b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe97400b450 tx=0x7fe97400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98911d640 1 --2- 10.20.193.7:0/4266583710 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe95403aa80 0x7fe95405af30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe98412d0c0 tx=0x7fe978008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974005070 con 0x7fe98412b1d0 2026-02-22T20:54:14.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 10 monclient: dump: 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fe974015070 con 0x7fe98412b1d0 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:14.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 msgr2=0x7fe9841259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 0x7fe9841259b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe97400b450 tx=0x7fe97400b910 comp rx=0 tx=0).stop 2026-02-22T20:54:14.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 msgr2=0x7fe9841259b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:14.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe9727fc640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b1d0 0x7fe9841259b0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe97400b450 tx=0x7fe97400b910 comp rx=0 tx=0).stop 2026-02-22T20:54:14.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98a920640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:14.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98a920640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 0x7fe984125ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98a920640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe98412da00 con 0x7fe98412b5a0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98991e640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 0x7fe984125ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98991e640 10 monclient: get_auth_request con 0x7fe98412b5a0 auth_method 0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98991e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98991e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.311+0000 7fe98991e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 10 monclient(hunting): handle_auth_done global_id 54172 payload 824 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 1 -- 10.20.193.7:0/4266583710 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe98405fbe0 con 0x7fe98412b5a0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98991e640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 0x7fe984125ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe974002410 tx=0x7fe974005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974005760 con 0x7fe98412b5a0 2026-02-22T20:54:14.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 10 monclient: dump: 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:14.336 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4869 (secure 0 0 0) 0x7fe974005760 con 0x7fe98412b5a0 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 msgr2=0x7fe984125ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 0x7fe984125ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe974002410 tx=0x7fe974005ad0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 msgr2=0x7fe984125ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:14.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe9727fc640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe98412b5a0 0x7fe984125ef0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe974002410 tx=0x7fe974005ad0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 22, 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 37543, 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.338 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.339 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:14.340 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.341 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:14.342 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:14.343 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.344 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.345 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.346 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:14.347 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:14.348 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.349 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.350 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T20:54:14.351 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:14.352 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:14.352 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:14.352 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:14.352 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:14.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe95403aa80 msgr2=0x7fe95405af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 --2- 10.20.193.7:0/4266583710 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe95403aa80 0x7fe95405af30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe98412d0c0 tx=0x7fe978008040 comp rx=0 tx=0).stop 2026-02-22T20:54:14.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 10 monclient: shutdown 2026-02-22T20:54:14.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a11f640 1 -- 10.20.193.7:0/4266583710 reap_dead start 2026-02-22T20:54:14.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 msgr2=0x7fe98412a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe9800b0040 tx=0x7fe980019670 comp rx=0 tx=0).stop 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 shutdown_connections 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 --2- 10.20.193.7:0/4266583710 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe98408c750 0x7fe98412a4d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 >> 10.20.193.7:0/4266583710 conn(0x7fe98408d850 msgr2=0x7fe98413de50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 shutdown_connections 2026-02-22T20:54:14.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:14.315+0000 7fe98a920640 1 -- 10.20.193.7:0/4266583710 wait complete. 2026-02-22T20:54:14.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:54:14.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: starting. 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19312 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: created object 0... 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: created object 25... 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: created object 49... 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: finishing. 2026-02-22T20:54:15.012 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19390]: shutting down. 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: starting. 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: listing objects. 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: listed object 0... 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: listed object 25... 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: saw 50 objects 2026-02-22T20:54:15.023 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19392]: shutting down. 2026-02-22T20:54:15.893 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:15.893 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19391]: starting. 2026-02-22T20:54:15.894 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19391]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19312 2026-02-22T20:54:15.894 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19391]: shutting down. 2026-02-22T20:54:15.895 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:15.895 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:15.896 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:54:15.898 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:54:16.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:16.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:17.946 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: starting. 2026-02-22T20:54:17.946 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19445 2026-02-22T20:54:17.947 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: created object 0... 2026-02-22T20:54:17.947 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: created object 25... 2026-02-22T20:54:17.947 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: created object 49... 2026-02-22T20:54:17.947 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: finishing. 2026-02-22T20:54:17.947 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19446]: shutting down. 2026-02-22T20:54:18.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19447]: starting. 2026-02-22T20:54:18.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19447]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19445 2026-02-22T20:54:18.899 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19447]: shutting down. 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: starting. 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19445 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: created object 0... 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: created object 25... 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: created object 49... 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: finishing. 2026-02-22T20:54:20.955 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19480]: shutting down. 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: starting. 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: listing objects. 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: listed object 0... 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: listed object 25... 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: saw 50 objects 2026-02-22T20:54:20.966 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19482]: shutting down. 2026-02-22T20:54:21.908 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:21.908 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19481]: starting. 2026-02-22T20:54:21.908 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19481]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19445 2026-02-22T20:54:21.908 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19481]: shutting down. 2026-02-22T20:54:21.910 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:21.910 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:21.910 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:54:21.912 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:54:21.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:21.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: starting. 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19532 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: created object 0... 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: created object 25... 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: created object 49... 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: finishing. 2026-02-22T20:54:23.965 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19533]: shutting down. 2026-02-22T20:54:24.919 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19534]: starting. 2026-02-22T20:54:24.919 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19534]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19532 2026-02-22T20:54:24.919 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19534]: shutting down. 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: starting. 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19532 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: created object 0... 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: created object 25... 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: created object 49... 2026-02-22T20:54:26.948 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: finishing. 2026-02-22T20:54:26.949 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19567]: shutting down. 2026-02-22T20:54:26.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:26.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: starting. 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: listing objects. 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: listed object 0... 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: listed object 25... 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: saw 50 objects 2026-02-22T20:54:26.960 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19569]: shutting down. 2026-02-22T20:54:27.898 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:27.899 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19568]: starting. 2026-02-22T20:54:27.899 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19568]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19532 2026-02-22T20:54:27.899 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19568]: shutting down. 2026-02-22T20:54:27.901 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:27.901 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:27.901 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:54:27.904 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:54:29.953 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: starting. 2026-02-22T20:54:29.953 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19619 2026-02-22T20:54:29.953 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: created object 0... 2026-02-22T20:54:29.953 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: created object 25... 2026-02-22T20:54:29.953 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: created object 49... 2026-02-22T20:54:29.954 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: finishing. 2026-02-22T20:54:29.954 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19620]: shutting down. 2026-02-22T20:54:30.909 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19621]: starting. 2026-02-22T20:54:30.909 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19621]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19619 2026-02-22T20:54:30.910 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19621]: shutting down. 2026-02-22T20:54:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:31.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:31.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:54:31.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:54:31.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:31.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:32.966 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:32.966 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: starting. 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19619 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: created object 0... 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: created object 25... 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: created object 49... 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: finishing. 2026-02-22T20:54:32.967 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19654]: shutting down. 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: starting. 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: listing objects. 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: listed object 0... 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: listed object 25... 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: saw 50 objects 2026-02-22T20:54:32.978 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19656]: shutting down. 2026-02-22T20:54:33.917 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:33.918 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19655]: starting. 2026-02-22T20:54:33.918 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19655]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19619 2026-02-22T20:54:33.918 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19655]: shutting down. 2026-02-22T20:54:33.919 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:33.919 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:54:33.919 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:54:33.921 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:54:34.356 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-22T20:54:34.356 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T20:54:34.356 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T20:54:34.357 INFO:tasks.ceph.mon.c:Started 2026-02-22T20:54:34.357 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T20:54:34.358 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T20:54:34.358 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2026-02-22T20:54:36.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:36.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:41.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:41.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:46.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:46.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:51.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:51.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:54.359 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T20:54:54.359 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T20:54:54.360 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:54:54.360 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: get_monmap_and_config 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: monmap: 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:54.429931+0000 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:54.429931+0000 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:54.429 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 Processor -- start 2026-02-22T20:54:54.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 -- start start 2026-02-22T20:54:54.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: init 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f4e20092c20 0x7f4e2013f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-c con 0x7f4e20092c20 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4e2013f7d0 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-b con 0x7f4e2013fc30 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e20056c10 con 0x7f4e2013f7d0 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200919a0 con 0x7f4e20092c20 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4e20091c80 con 0x7f4e2013fc30 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1f577640 10 monclient(hunting): authenticate will time out at 706.903378s 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41018/0 (socket says 10.20.193.7:41018) 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 -- 10.20.193.7:0/482845128 learned_addr learned my addr 10.20.193.7:0/482845128 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): get_auth_request con 0x7f4e2013fc30 auth_method 0 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient(hunting): handle_auth_done global_id 64100 payload 274 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 -- 10.20.193.7:0/482845128 >> v2:10.20.193.61:3300/0 conn(0x7f4e20092c20 msgr2=0x7f4e2013f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 --2- 10.20.193.7:0/482845128 >> v2:10.20.193.61:3300/0 conn(0x7f4e20092c20 0x7f4e2013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 -- 10.20.193.7:0/482845128 >> v1:10.20.193.61:6789/0 conn(0x7f4e2013f7d0 legacy=0x7f4e2013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 monclient: found mon.noname-b 2026-02-22T20:54:54.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.426+0000 7f4e1ed76640 1 -- 10.20.193.7:0/482845128 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e20091f60 con 0x7f4e2013fc30 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 1 --2- 10.20.193.7:0/482845128 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009580 tx=0x7f4e1001c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52192d4a9da899f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 1 -- 10.20.193.7:0/482845128 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100b2070 con 0x7f4e2013fc30 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: dump: 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.436 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 1 -- 10.20.193.7:0/482845128 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e100a5840 con 0x7f4e2013fc30 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 1 -- 10.20.193.7:0/482845128 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100a5c30 con 0x7f4e2013fc30 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 5 monclient: authenticate success, global_id 64100 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 4 set_mon_vals no callback set 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1d573640 10 monclient: dump: 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: shutdown 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/482845128 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 msgr2=0x7f4e2013c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- 10.20.193.7:0/482845128 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009580 tx=0x7f4e1001c8f0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/482845128 shutdown_connections 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- 10.20.193.7:0/482845128 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e2013fc30 0x7f4e2013c680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- 10.20.193.7:0/482845128 >> v2:10.20.193.61:3300/0 conn(0x7f4e20092c20 0x7f4e2013f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/482845128 >> 10.20.193.7:0/482845128 conn(0x7f4e200906f0 msgr2=0x7f4e20090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/482845128 shutdown_connections 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/482845128 wait complete. 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: monmap: 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 Processor -- start 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- start start 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: init 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-c con 0x7f4e20092c20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 0x7f4e2013be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-a con 0x7f4e2013f7d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e2013fc30 0x7f4e2013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): picked mon.noname-b con 0x7f4e2013fc30 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e201a4180 con 0x7f4e2013f7d0 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4e201a4000 con 0x7f4e2013fc30 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4e201a4300 con 0x7f4e20092c20 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient(hunting): authenticate will time out at 706.906076s 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 0x7f4e2013be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41026/0 (socket says 10.20.193.7:41026) 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): get_auth_request con 0x7f4e2013f7d0 auth_method 0 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 1 -- 10.20.193.7:0/3725273065 learned_addr learned my addr 10.20.193.7:0/3725273065 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): get_auth_request con 0x7f4e20092c20 auth_method 0 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e2013fc30 0x7f4e2013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 10 monclient(hunting): get_auth_request con 0x7f4e2013fc30 auth_method 0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient(hunting): handle_auth_done global_id 5130 payload 824 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 -- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 msgr2=0x7f4e2014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 -- 10.20.193.7:0/3725273065 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e2013fc30 msgr2=0x7f4e2013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e2013fc30 0x7f4e2013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 monclient: found mon.noname-a 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 -- 10.20.193.7:0/3725273065 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2008a9e0 con 0x7f4e2013f7d0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1dd74640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 0x7f4e2013be70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800b450 tx=0x7f4e0800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08004480 con 0x7f4e2013f7d0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: dump: 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08015070 con 0x7f4e2013f7d0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 5 monclient: authenticate success, global_id 5130 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _renew_subs 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2008fdd0 con 0x7f4e2013f7d0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e080029c0 con 0x7f4e2013f7d0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1cd72640 4 set_mon_vals no callback set 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 10 monclient: dump: 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _renew_subs 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2012cfd0 con 0x7f4e2013f7d0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2013f290 con 0x7f4e2013f7d0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4e08002b60 con 0x7f4e2013f7d0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 --2- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 0x7f4dec05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(89..89 src has 64..89) ==== 3503+0+0 (secure 0 0 0) 0x7f4e0804e2d0 con 0x7f4e2013f7d0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 1 --2- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 0x7f4dec05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.430+0000 7f4e1e575640 10 monclient: get_auth_request con 0x7f4dec03ab20 auth_method 0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.434+0000 7f4e1e575640 1 --2- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 0x7f4dec05afd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e140094c0 tx=0x7f4e14009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.434+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f4e0800d040 con 0x7f4e2013f7d0 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.434+0000 7f4e06ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.434+0000 7f4e06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4e2012d930 con 0x7f4e2013f7d0 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e06ffd640 1 -- 10.20.193.7:0/3725273065 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f4e08013120 con 0x7f4e2013f7d0 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e06ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:54.561 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:54:54.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 msgr2=0x7f4dec05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 0x7f4dec05afd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e140094c0 tx=0x7f4e14009290 comp rx=0 tx=0).stop 2026-02-22T20:54:54.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 10 monclient: shutdown 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 msgr2=0x7f4e2013be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 0x7f4e2013be70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800b450 tx=0x7f4e0800b910 comp rx=0 tx=0).stop 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 shutdown_connections 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dec03ab20 0x7f4dec05afd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e2013fc30 0x7f4e2013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e2013f7d0 0x7f4e2013be70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 --2- 10.20.193.7:0/3725273065 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e20092c20 0x7f4e2014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 >> 10.20.193.7:0/3725273065 conn(0x7f4e200906f0 msgr2=0x7f4e2008e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 shutdown_connections 2026-02-22T20:54:54.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.558+0000 7f4e1f577640 1 -- 10.20.193.7:0/3725273065 wait complete. 2026-02-22T20:54:54.572 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:54:54.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:54:54.572 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:54:54.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 10 monclient: get_monmap_and_config 2026-02-22T20:54:54.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 10 monclient: monmap: 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:54.639287+0000 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:54.639287+0000 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:54.640 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 1 Processor -- start 2026-02-22T20:54:54.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 1 -- start start 2026-02-22T20:54:54.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.634+0000 7f1aa9f86640 10 monclient: init 2026-02-22T20:54:54.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1aa4091c70 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 0x7f1aa41808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-b con 0x7f1aa41604e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 0x7f1aa41a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-a con 0x7f1aa4180e00 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa408e6a0 con 0x7f1aa4091c70 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa408e910 con 0x7f1aa4180e00 2026-02-22T20:54:54.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa408ebf0 con 0x7f1aa41604e0 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient(hunting): authenticate will time out at 707.112451s 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa37fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1aa4091c70 0x7f1aa4092040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39064/0 (socket says 10.20.193.7:39064) 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa37fe640 1 -- 10.20.193.7:0/4255894397 learned_addr learned my addr 10.20.193.7:0/4255894397 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/4255894397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 0x7f1aa41808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 1 --2- 10.20.193.7:0/4255894397 >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 0x7f1aa41a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): get_auth_request con 0x7f1aa4180e00 auth_method 0 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request con 0x7f1aa41604e0 auth_method 0 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 1 -- 10.20.193.7:0/4255894397 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603098373 0 0) 0x7f1aa408e6a0 con 0x7f1aa4091c70 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient(hunting): _negotiate 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient(hunting): my global_id is 5136 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 1 -- 10.20.193.7:0/4255894397 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a88003620 con 0x7f1aa4091c70 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_done global_id 64106 payload 274 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 -- 10.20.193.7:0/4255894397 >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 msgr2=0x7f1aa41a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/4255894397 >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 0x7f1aa41a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 -- 10.20.193.7:0/4255894397 >> v1:10.20.193.7:6789/0 conn(0x7f1aa4091c70 legacy=0x7f1aa4092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 monclient: found mon.noname-b 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 -- 10.20.193.7:0/4255894397 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa408eed0 con 0x7f1aa41604e0 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa3fff640 1 --2- 10.20.193.7:0/4255894397 >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 0x7f1aa41a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:54.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/4255894397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 0x7f1aa41808c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a94004780 tx=0x7f1a9401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a488f48a24bc03da server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 1 -- 10.20.193.7:0/4255894397 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940b0070 con 0x7f1aa41604e0 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: dump: 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.656 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 1 -- 10.20.193.7:0/4255894397 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a940ab600 con 0x7f1aa41604e0 2026-02-22T20:54:54.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 1 -- 10.20.193.7:0/4255894397 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940ab9b0 con 0x7f1aa41604e0 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa27fc640 10 monclient: dump: 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.658 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 5 monclient: authenticate success, global_id 64106 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 4 set_mon_vals no callback set 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: shutdown 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- 10.20.193.7:0/4255894397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 msgr2=0x7f1aa41808c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/4255894397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 0x7f1aa41808c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a94004780 tx=0x7f1a9401c440 comp rx=0 tx=0).stop 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- 10.20.193.7:0/4255894397 shutdown_connections 2026-02-22T20:54:54.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/4255894397 >> v2:10.20.193.7:3300/0 conn(0x7f1aa4180e00 0x7f1aa41a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/4255894397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa41604e0 0x7f1aa41808c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- 10.20.193.7:0/4255894397 >> 10.20.193.7:0/4255894397 conn(0x7f1aa4093d80 msgr2=0x7f1aa4090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- 10.20.193.7:0/4255894397 shutdown_connections 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 1 -- 10.20.193.7:0/4255894397 wait complete. 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.638+0000 7f1aa9f86640 10 monclient: monmap: 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.660 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 Processor -- start 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- start start 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: init 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1aa4091c70 0x7f1aa417f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-b con 0x7f1aa4091c70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 0x7f1aa417fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-a con 0x7f1aa41604e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 0x7f1aa41801c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): picked mon.noname-c con 0x7f1aa4180e00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41a42d0 con 0x7f1aa41604e0 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41a4150 con 0x7f1aa4091c70 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa41a4450 con 0x7f1aa4180e00 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): authenticate will time out at 707.116724s 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 0x7f1aa417fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 0x7f1aa417fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60232/0 (socket says 10.20.193.7:60232) 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 0x7f1aa41801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 -- 10.20.193.7:0/1587294977 learned_addr learned my addr 10.20.193.7:0/1587294977 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request con 0x7f1aa41604e0 auth_method 0 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): get_auth_request con 0x7f1aa4180e00 auth_method 0 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1aa4091c70 0x7f1aa417f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request con 0x7f1aa4091c70 auth_method 0 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient(hunting): handle_auth_done global_id 64109 payload 824 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1aa4091c70 msgr2=0x7f1aa417f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1aa4091c70 0x7f1aa417f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 msgr2=0x7f1aa417fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 0x7f1aa417fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 monclient: found mon.noname-c 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa4163010 con 0x7f1aa4180e00 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41604e0 0x7f1aa417fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa3fff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 0x7f1aa41801c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009d80 tx=0x7f1a9800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98018020 con 0x7f1aa4180e00 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: dump: 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.666 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a98014480 con 0x7f1aa4180e00 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98014870 con 0x7f1aa4180e00 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: dump: 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.667 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa1ffb640 4 set_mon_vals no callback set 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 5 monclient: authenticate success, global_id 64109 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _renew_subs 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa408b460 con 0x7f1aa4180e00 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _renew_subs 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41621a0 con 0x7f1aa4180e00 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 0x7f1aa410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4092040 con 0x7f1aa41634c0 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 0x7f1aa410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient: get_auth_request con 0x7f1aa41634c0 auth_method 0 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1a98014a10 con 0x7f1aa4180e00 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_done global_id 5142 payload 824 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1aa4092890 con 0x7f1aa41634c0 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 --2- 10.20.193.7:0/1587294977 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1a7403ab20 0x7f1a7405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(89..89 src has 64..89) ==== 3503+0+0 (secure 0 0 0) 0x7f1a98005e00 con 0x7f1aa4180e00 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa37fe640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 0x7f1aa410f770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005980 tx=0x7f1a9000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900059b0 con 0x7f1aa41634c0 2026-02-22T20:54:54.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: dump: 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/1587294977 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1a7403ab20 0x7f1a7405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 10 monclient: get_auth_request con 0x7f1a7403ab20 auth_method 0 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f1a90018070 con 0x7f1aa41634c0 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 msgr2=0x7f1aa410f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 0x7f1aa410f770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005980 tx=0x7f1a9000fc00 comp rx=0 tx=0).stop 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 msgr2=0x7f1aa410f770 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1a7ffff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa41634c0 0x7f1aa410f770 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005980 tx=0x7f1a9000fc00 comp rx=0 tx=0).stop 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.642+0000 7f1aa2ffd640 1 --2- 10.20.193.7:0/1587294977 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1a7403ab20 0x7f1a7405afd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4180d80 tx=0x7f1a940ad040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 0x7f1aa4087b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4092d10 con 0x7f1aa4087760 2026-02-22T20:54:54.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 0x7f1aa4087b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient: get_auth_request con 0x7f1aa4087760 auth_method 0 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_done global_id 5145 payload 824 2026-02-22T20:54:54.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 1 -- 10.20.193.7:0/1587294977 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1aa405fb50 con 0x7f1aa4087760 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa37fe640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 0x7f1aa4087b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a900036e0 tx=0x7f1a900058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900072e0 con 0x7f1aa4087760 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 10 monclient: dump: 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.674 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f1a900072e0 con 0x7f1aa4087760 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:54.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 msgr2=0x7f1aa4087b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 0x7f1aa4087b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a900036e0 tx=0x7f1a900058f0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 msgr2=0x7f1aa4087b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1a7ffff640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1aa4087760 0x7f1aa4087b60 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a900036e0 tx=0x7f1a900058f0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:54.676 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 173776, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:54.677 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:54.678 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.679 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:54.680 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.681 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.682 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.683 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.684 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.685 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.686 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.687 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:54.688 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1a7403ab20 msgr2=0x7f1a7405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/1587294977 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1a7403ab20 0x7f1a7405afd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4180d80 tx=0x7f1a940ad040 comp rx=0 tx=0).stop 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 10 monclient: shutdown 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 msgr2=0x7f1aa41801c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa3fff640 1 -- 10.20.193.7:0/1587294977 reap_dead start 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 0x7f1aa41801c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009d80 tx=0x7f1a9800c490 comp rx=0 tx=0).stop 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 shutdown_connections 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 --2- 10.20.193.7:0/1587294977 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa4180e00 0x7f1aa41801c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 >> 10.20.193.7:0/1587294977 conn(0x7f1aa4093d80 msgr2=0x7f1aa408b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 shutdown_connections 2026-02-22T20:54:54.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.646+0000 7f1aa9f86640 1 -- 10.20.193.7:0/1587294977 wait complete. 2026-02-22T20:54:54.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:54.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:54:54.690 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:54:54.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.746+0000 7f54d3c22640 10 monclient: get_monmap_and_config 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.746+0000 7f54d3c22640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.746+0000 7f54d3c22640 10 monclient: monmap: 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:54.751651+0000 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:54.751651+0000 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.752 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 Processor -- start 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- start start 2026-02-22T20:54:54.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient: init 2026-02-22T20:54:54.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T20:54:54.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f54cc13f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-b con 0x7f54cc13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54cc180d00 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc08fd70 con 0x7f54cc180d00 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc092bc0 con 0x7f54cc13f290 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc08e1f0 con 0x7f54cc13fd70 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient(hunting): authenticate will time out at 707.224878s 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41050/0 (socket says 10.20.193.7:41050) 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 -- 10.20.193.7:0/2920353857 learned_addr learned my addr 10.20.193.7:0/2920353857 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): get_auth_request con 0x7f54cc13fd70 auth_method 0 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102679566 0 0) 0x7f54c8002ca0 con 0x7f54cc180d00 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient(hunting): _negotiate 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient(hunting): my global_id is 5148 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54b4003620 con 0x7f54cc180d00 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604089718 0 0) 0x7f54cc092bc0 con 0x7f54cc13f290 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient(hunting): handle_auth_done global_id 64112 payload 274 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 -- 10.20.193.7:0/2920353857 >> v1:10.20.193.61:6789/0 conn(0x7f54cc13f290 legacy=0x7f54cc13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 -- 10.20.193.7:0/2920353857 >> v1:10.20.193.7:6789/0 conn(0x7f54cc180d00 legacy=0x7f54cc1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 monclient: found mon.noname-b 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 -- 10.20.193.7:0/2920353857 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc08e6d0 con 0x7f54cc13fd70 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:54:54.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d1196640 1 --2- 10.20.193.7:0/2920353857 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009910 tx=0x7f54c001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219fb4dc71b78161 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c00ab650 con 0x7f54cc13fd70 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: dump: 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c00b0070 con 0x7f54cc13fd70 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 1 -- 10.20.193.7:0/2920353857 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c00aba10 con 0x7f54cc13fd70 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 5 monclient: authenticate success, global_id 64112 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 4 set_mon_vals no callback set 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d0995640 10 monclient: dump: 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.763 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 10 monclient: shutdown 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- 10.20.193.7:0/2920353857 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 msgr2=0x7f54cc1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 --2- 10.20.193.7:0/2920353857 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009910 tx=0x7f54c001c540 comp rx=0 tx=0).stop 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- 10.20.193.7:0/2920353857 shutdown_connections 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 --2- 10.20.193.7:0/2920353857 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- 10.20.193.7:0/2920353857 >> 10.20.193.7:0/2920353857 conn(0x7f54cc093df0 msgr2=0x7f54cc0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- 10.20.193.7:0/2920353857 shutdown_connections 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.750+0000 7f54d3c22640 1 -- 10.20.193.7:0/2920353857 wait complete. 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: monmap: 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 Processor -- start 2026-02-22T20:54:54.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- start start 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: init 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f54cc13f290 0x7f54cc08d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-b con 0x7f54cc13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-a con 0x7f54cc13fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): picked mon.noname-c con 0x7f54cc180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1a5870 con 0x7f54cc13fd70 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1a56f0 con 0x7f54cc13f290 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc1a59f0 con 0x7f54cc180d00 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): authenticate will time out at 707.228759s 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41056/0 (socket says 10.20.193.7:41056) 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60250/0 (socket says 10.20.193.7:60250) 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 -- 10.20.193.7:0/3764014282 learned_addr learned my addr 10.20.193.7:0/3764014282 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): get_auth_request con 0x7f54cc180d00 auth_method 0 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): get_auth_request con 0x7f54cc13fd70 auth_method 0 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient(hunting): handle_auth_done global_id 64115 payload 824 2026-02-22T20:54:54.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f54cc13f290 msgr2=0x7f54cc08d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f54cc13f290 0x7f54cc08d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 msgr2=0x7f54cc1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 monclient: found mon.noname-c 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc08a9e0 con 0x7f54cc180d00 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f54cc13fd70 0x7f54cc1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d2198640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54c800cbb0 tx=0x7f54c800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800ad40 con 0x7f54cc180d00 2026-02-22T20:54:54.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: dump: 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.770 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 5 monclient: authenticate success, global_id 64115 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8003a70 con 0x7f54cc180d00 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _renew_subs 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc109fb0 con 0x7f54cc180d00 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8003e20 con 0x7f54cc180d00 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54bbfff640 4 set_mon_vals no callback set 2026-02-22T20:54:54.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: dump: 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _renew_subs 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc10af50 con 0x7f54cc180d00 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 0x7f54cc1279f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc12b980 con 0x7f54cc10ab10 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 0x7f54cc1279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient: get_auth_request con 0x7f54cc10ab10 auth_method 0 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 10 monclient(hunting): handle_auth_done global_id 64118 payload 824 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f54c80050d0 con 0x7f54cc180d00 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54cc13f660 con 0x7f54cc10ab10 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1997640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 0x7f54cc1279f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 --2- 10.20.193.7:0/3764014282 >> v2:10.20.193.61:6800/2336688312 conn(0x7f549c03ab20 0x7f549c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(89..89 src has 64..89) ==== 3503+0+0 (secure 0 0 0) 0x7f54c804e9f0 con 0x7f54cc180d00 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc017070 con 0x7f54cc10ab10 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: dump: 2026-02-22T20:54:54.774 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f54bc0054e0 con 0x7f54cc10ab10 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 msgr2=0x7f54cc1279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 0x7f54cc1279f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc00c8e0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 msgr2=0x7f54cc1279f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54ba7fc640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc10ab10 0x7f54cc1279f0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc00c8e0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 1 --2- 10.20.193.7:0/3764014282 >> v2:10.20.193.61:6800/2336688312 conn(0x7f549c03ab20 0x7f549c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 10 monclient: get_auth_request con 0x7f549c03ab20 auth_method 0 2026-02-22T20:54:54.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.754+0000 7f54d1196640 1 --2- 10.20.193.7:0/3764014282 >> v2:10.20.193.61:6800/2336688312 conn(0x7f549c03ab20 0x7f549c05afd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54c0002410 tx=0x7f54c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:54.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 0x7f54cc0876d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc128330 con 0x7f54cc127f30 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 0x7f54cc0876d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient: get_auth_request con 0x7f54cc127f30 auth_method 0 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 10 monclient(hunting): handle_auth_done global_id 64121 payload 824 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 1 -- 10.20.193.7:0/3764014282 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f54cc10be10 con 0x7f54cc127f30 2026-02-22T20:54:54.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d1997640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 0x7f54cc0876d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc002890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc017030 con 0x7f54cc127f30 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 10 monclient: dump: 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f54bc0039e0 con 0x7f54cc127f30 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:54.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 msgr2=0x7f54cc0876d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 0x7f54cc0876d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc002890 comp rx=0 tx=0).stop 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 msgr2=0x7f54cc0876d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54ba7fc640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc127f30 0x7f54cc0876d0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0029e0 tx=0x7f54bc002890 comp rx=0 tx=0).stop 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 20362, 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:54.781 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.782 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.783 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:54.784 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.785 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.786 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.787 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.788 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:54.789 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:54.790 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 >> v2:10.20.193.61:6800/2336688312 conn(0x7f549c03ab20 msgr2=0x7f549c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 --2- 10.20.193.7:0/3764014282 >> v2:10.20.193.61:6800/2336688312 conn(0x7f549c03ab20 0x7f549c05afd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54c0002410 tx=0x7f54c00a7000 comp rx=0 tx=0).stop 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 10 monclient: shutdown 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 msgr2=0x7f54cc1274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54c800cbb0 tx=0x7f54c800a430 comp rx=0 tx=0).stop 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d2198640 1 -- 10.20.193.7:0/3764014282 reap_dead start 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 shutdown_connections 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 --2- 10.20.193.7:0/3764014282 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f54cc180d00 0x7f54cc1274b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 >> 10.20.193.7:0/3764014282 conn(0x7f54cc093df0 msgr2=0x7f54cc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 shutdown_connections 2026-02-22T20:54:54.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.758+0000 7f54d3c22640 1 -- 10.20.193.7:0/3764014282 wait complete. 2026-02-22T20:54:54.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:54.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:54:54.792 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:54:54.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 10 monclient: get_monmap_and_config 2026-02-22T20:54:54.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 10 monclient: monmap: 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:54.859190+0000 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:54.859190+0000 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:54.859 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 1 Processor -- start 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 1 -- start start 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.854+0000 7f616b1d5640 10 monclient: init 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 0x7f616408eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-c con 0x7f616408eb20 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f616408f430 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 0x7f61641a1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-b con 0x7f616413fb10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f616408ae20 con 0x7f616408f430 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f616408a8f0 con 0x7f616408eb20 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f616408c210 con 0x7f616413fb10 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): authenticate will time out at 707.332088s 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 0x7f61641a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f616408f430 0x7f616413f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39076/0 (socket says 10.20.193.7:39076) 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 1 -- 10.20.193.7:0/2260335160 learned_addr learned my addr 10.20.193.7:0/2260335160 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): get_auth_request con 0x7f616413fb10 auth_method 0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 1 --2- 10.20.193.7:0/2260335160 >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 0x7f616408eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 10 monclient(hunting): get_auth_request con 0x7f616408eb20 auth_method 0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_done global_id 64124 payload 274 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 -- 10.20.193.7:0/2260335160 >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 msgr2=0x7f616408eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 --2- 10.20.193.7:0/2260335160 >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 0x7f616408eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 -- 10.20.193.7:0/2260335160 >> v1:10.20.193.7:6789/0 conn(0x7f616408f430 legacy=0x7f616413f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 monclient: found mon.noname-b 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 1 -- 10.20.193.7:0/2260335160 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449480912 0 0) 0x7f616408ae20 con 0x7f616408f430 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 -- 10.20.193.7:0/2260335160 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616405ff80 con 0x7f616413fb10 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 1 --2- 10.20.193.7:0/2260335160 >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 0x7f616408eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 --2- 10.20.193.7:0/2260335160 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 0x7f61641a1660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6160004b00 tx=0x7f616001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f780bc766bcdce0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 1 -- 10.20.193.7:0/2260335160 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600b2070 con 0x7f616413fb10 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:54.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: dump: 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 1 -- 10.20.193.7:0/2260335160 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61600a58d0 con 0x7f616413fb10 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 1 -- 10.20.193.7:0/2260335160 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600a5cc0 con 0x7f616413fb10 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615b7fe640 10 monclient: dump: 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 5 monclient: authenticate success, global_id 64124 2026-02-22T20:54:54.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 4 set_mon_vals no callback set 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: shutdown 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- 10.20.193.7:0/2260335160 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 msgr2=0x7f61641a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- 10.20.193.7:0/2260335160 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 0x7f61641a1660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6160004b00 tx=0x7f616001c830 comp rx=0 tx=0).stop 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- 10.20.193.7:0/2260335160 shutdown_connections 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- 10.20.193.7:0/2260335160 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616413fb10 0x7f61641a1660 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- 10.20.193.7:0/2260335160 >> v2:10.20.193.61:3300/0 conn(0x7f616408eb20 0x7f616408eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- 10.20.193.7:0/2260335160 >> 10.20.193.7:0/2260335160 conn(0x7f6164038f20 msgr2=0x7f61640392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- 10.20.193.7:0/2260335160 shutdown_connections 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- 10.20.193.7:0/2260335160 wait complete. 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: monmap: 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 Processor -- start 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- start start 2026-02-22T20:54:54.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: init 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616408eb20 0x7f61641268a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-b con 0x7f616408eb20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 0x7f6164126de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-c con 0x7f616408f430 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 0x7f6164127320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): picked mon.noname-a con 0x7f616413fb10 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f616403a0c0 con 0x7f616413fb10 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6164039f40 con 0x7f616408eb20 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f61641a43c0 con 0x7f616408f430 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616b1d5640 10 monclient(hunting): authenticate will time out at 707.335807s 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 0x7f6164126de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 0x7f6164127320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 0x7f6164126de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41090/0 (socket says 10.20.193.7:41090) 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 1 -- 10.20.193.7:0/3202158240 learned_addr learned my addr 10.20.193.7:0/3202158240 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 0x7f6164127320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60260/0 (socket says 10.20.193.7:60260) 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): get_auth_request con 0x7f616408f430 auth_method 0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): get_auth_request con 0x7f616413fb10 auth_method 0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f615bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f6168f4a640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616408eb20 0x7f61641268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.858+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616974b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): get_auth_request con 0x7f616408eb20 auth_method 0 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 10 monclient(hunting): handle_auth_done global_id 64127 payload 824 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616408eb20 msgr2=0x7f61641268a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616408eb20 0x7f61641268a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 msgr2=0x7f6164127320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 0x7f6164127320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 monclient: found mon.noname-c 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616412a2f0 con 0x7f616408f430 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616974b640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f616413fb10 0x7f6164127320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615bfff640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 0x7f6164126de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c550 tx=0x7f614c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c018070 con 0x7f616408f430 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: dump: 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c004cf0 con 0x7f616408f430 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 5 monclient: authenticate success, global_id 64127 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 monclient: _renew_subs 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616412a5d0 con 0x7f616408f430 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c0072d0 con 0x7f616408f430 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: dump: 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f615affd640 4 set_mon_vals no callback set 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 monclient: _renew_subs 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6164129d30 con 0x7f616408f430 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f614c007470 con 0x7f616408f430 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 0x7f61641114a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6164129f70 con 0x7f616412aad0 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 --2- 10.20.193.7:0/3202158240 >> v2:10.20.193.61:6800/2336688312 conn(0x7f613403ab20 0x7f613405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(89..89 src has 64..89) ==== 3503+0+0 (secure 0 0 0) 0x7f614c04dec0 con 0x7f616408f430 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 0x7f61641114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient: get_auth_request con 0x7f616412aad0 auth_method 0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616974b640 1 --2- 10.20.193.7:0/3202158240 >> v2:10.20.193.61:6800/2336688312 conn(0x7f613403ab20 0x7f613405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616974b640 10 monclient: get_auth_request con 0x7f613403ab20 auth_method 0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 10 monclient(hunting): handle_auth_done global_id 54298 payload 824 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f616408eef0 con 0x7f616412aad0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f616974b640 1 --2- 10.20.193.7:0/3202158240 >> v2:10.20.193.61:6800/2336688312 conn(0x7f613403ab20 0x7f613405afd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f616001d0d0 tx=0x7f61600a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f6168f4a640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 0x7f61641114a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6154010790 tx=0x7f6154010c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615400f040 con 0x7f616412aad0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: dump: 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f6154004030 con 0x7f616412aad0 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 msgr2=0x7f61641114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 0x7f61641114a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6154010790 tx=0x7f6154010c50 comp rx=0 tx=0).stop 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 msgr2=0x7f61641114a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.862+0000 7f61597fa640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f616412aad0 0x7f61641114a0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6154010790 tx=0x7f6154010c50 comp rx=0 tx=0).stop 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 0x7f6164111de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6164112320 con 0x7f61641119e0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 0x7f6164111de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient: get_auth_request con 0x7f61641119e0 auth_method 0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 10 monclient(hunting): handle_auth_done global_id 54301 payload 824 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 1 -- 10.20.193.7:0/3202158240 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6164129030 con 0x7f61641119e0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f6168f4a640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 0x7f6164111de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6154004000 tx=0x7f61540047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61540043e0 con 0x7f61641119e0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 10 monclient: dump: 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7f61540043e0 con 0x7f61641119e0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 msgr2=0x7f6164111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 0x7f6164111de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6154004000 tx=0x7f61540047b0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 msgr2=0x7f6164111de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f61597fa640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f61641119e0 0x7f6164111de0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6154004000 tx=0x7f61540047b0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 78102, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.873 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:54.874 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:54.875 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.876 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:54.877 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:54.878 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 >> v2:10.20.193.61:6800/2336688312 conn(0x7f613403ab20 msgr2=0x7f613405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 --2- 10.20.193.7:0/3202158240 >> v2:10.20.193.61:6800/2336688312 conn(0x7f613403ab20 0x7f613405afd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f616001d0d0 tx=0x7f61600a7070 comp rx=0 tx=0).stop 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 10 monclient: shutdown 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 msgr2=0x7f6164126de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 --2- 10.20.193.7:0/3202158240 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f616408f430 0x7f6164126de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c550 tx=0x7f614c00ca10 comp rx=0 tx=0).stop 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616974b640 1 -- 10.20.193.7:0/3202158240 reap_dead start 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616974b640 1 -- 10.20.193.7:0/3202158240 reap_dead start 2026-02-22T20:54:54.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 shutdown_connections 2026-02-22T20:54:54.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 >> 10.20.193.7:0/3202158240 conn(0x7f6164038f20 msgr2=0x7f6164086d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 shutdown_connections 2026-02-22T20:54:54.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.866+0000 7f616b1d5640 1 -- 10.20.193.7:0/3202158240 wait complete. 2026-02-22T20:54:54.880 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:54.880 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:54:54.880 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:54:54.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: get_monmap_and_config 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: monmap: 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:54.938235+0000 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:54.938235+0000 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:54.938 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 Processor -- start 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 -- start start 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: init 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe248090460 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe248090f40 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe248182010 0x7fe2481a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-c con 0x7fe248182010 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:54.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe248056050 con 0x7fe248090460 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24808d040 con 0x7fe248090f40 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe248055c30 con 0x7fe248182010 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe2503e8640 10 monclient(hunting): authenticate will time out at 707.411084s 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fe248090460 0x7fe248090830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39084/0 (socket says 10.20.193.7:39084) 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 1 -- 10.20.193.7:0/3494862173 learned_addr learned my addr 10.20.193.7:0/3494862173 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 1 --2- 10.20.193.7:0/3494862173 >> v2:10.20.193.61:3300/0 conn(0x7fe248182010 0x7fe2481a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): get_auth_request con 0x7fe248182010 auth_method 0 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171660848 0 0) 0x7fe248056050 con 0x7fe248090460 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): _negotiate 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): my global_id is 5160 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe230003620 con 0x7fe248090460 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4090587537 0 0) 0x7fe230003620 con 0x7fe248090460 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 >> v2:10.20.193.61:3300/0 conn(0x7fe248182010 msgr2=0x7fe2481a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 --2- 10.20.193.7:0/3494862173 >> v2:10.20.193.61:3300/0 conn(0x7fe248182010 0x7fe2481a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 >> v1:10.20.193.61:6789/0 conn(0x7fe248090f40 legacy=0x7fe2481808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe248056600 con 0x7fe248090460 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fe238002e60 con 0x7fe248090460 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: dump: 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 >> v1:10.20.193.7:6789/0 conn(0x7fe248090460 legacy=0x7fe248090830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe230003c10 0x7fe230004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): picked mon.c con 0x7fe230003c10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 0x7fe230004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): picked mon.a con 0x7fe2300048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe230005460 0x7fe230065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): picked mon.b con 0x7fe230005460 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe248055c30 con 0x7fe2300048d0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe230066390 con 0x7fe230005460 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe230066590 con 0x7fe230003c10 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d15b640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 0x7fe230004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): get_auth_request con 0x7fe2300048d0 auth_method 0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe230003c10 0x7fe230004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): get_auth_request con 0x7fe230003c10 auth_method 0 2026-02-22T20:54:54.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 10 monclient(hunting): handle_auth_done global_id 5160 payload 293 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.934+0000 7fe24d95c640 1 -- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe230003c10 msgr2=0x7fe230004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe230003c10 0x7fe230004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 -- 10.20.193.7:0/3494862173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe230005460 msgr2=0x7fe230065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe230005460 0x7fe230065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 monclient: found mon.a 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 -- 10.20.193.7:0/3494862173 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230003620 con 0x7fe2300048d0 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 -- 10.20.193.7:0/3494862173 reap_dead start 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 5 monclient: authenticate success, global_id 5160 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:54:54.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 0x7fe230004d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007fd0 tx=0x7fe23c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5aa915ccbb8012 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c002c20 con 0x7fe2300048d0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: dump: 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c005280 con 0x7fe2300048d0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 1 -- 10.20.193.7:0/3494862173 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0068d0 con 0x7fe2300048d0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 4 set_mon_vals no callback set 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d15b640 10 monclient: dump: 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.948 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: shutdown 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 msgr2=0x7fe230004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 0x7fe230004d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007fd0 tx=0x7fe23c01c450 comp rx=0 tx=0).stop 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/3494862173 shutdown_connections 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 --2- 10.20.193.7:0/3494862173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe2300048d0 0x7fe230004d40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/3494862173 >> 10.20.193.7:0/3494862173 conn(0x7fe24808e050 msgr2=0x7fe24808e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/3494862173 shutdown_connections 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/3494862173 wait complete. 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: build_initial_monmap 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: monmap: 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:54.949 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 Processor -- start 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- start start 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: init 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe2300048d0 0x7fe248152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-c con 0x7fe2300048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 0x7fe24813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-b con 0x7fe248138b40 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): picked mon.noname-a con 0x7fe24813ede0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe248090c40 con 0x7fe24813ede0 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe24808ef50 con 0x7fe248138b40 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe248090dc0 con 0x7fe2300048d0 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient(hunting): authenticate will time out at 707.414743s 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60270/0 (socket says 10.20.193.7:60270) 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 -- 10.20.193.7:0/1456905405 learned_addr learned my addr 10.20.193.7:0/1456905405 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe2300048d0 0x7fe248152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): get_auth_request con 0x7fe24813ede0 auth_method 0 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): get_auth_request con 0x7fe2300048d0 auth_method 0 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e15d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient(hunting): handle_auth_done global_id 5163 payload 824 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 -- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe2300048d0 msgr2=0x7fe248152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe2300048d0 0x7fe248152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 0x7fe24813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 -- 10.20.193.7:0/1456905405 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 msgr2=0x7fe24813e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 0x7fe24813e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient: _finish_hunting 0 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 monclient: found mon.noname-a 2026-02-22T20:54:54.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 -- 10.20.193.7:0/1456905405 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe248088740 con 0x7fe24813ede0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 10 monclient: get_auth_request con 0x7fe248138b40 auth_method 0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24d95c640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 0x7fe24813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24e95e640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe24803a5c0 tx=0x7fe24400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244018020 con 0x7fe24813ede0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: dump: 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: _finish_auth 0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe244014600 con 0x7fe24813ede0 2026-02-22T20:54:54.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2440149b0 con 0x7fe24813ede0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 5 monclient: authenticate success, global_id 5163 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe24c95a640 4 set_mon_vals no callback set 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _renew_subs 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe248137fe0 con 0x7fe24813ede0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 10 monclient: dump: 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _renew_subs 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe248139aa0 con 0x7fe24813ede0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:54.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2481400d0 con 0x7fe24813ede0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe244014b50 con 0x7fe24813ede0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 --2- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 0x7fe21805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.938+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(89..89 src has 64..89) ==== 3503+0+0 (secure 0 0 0) 0x7fe24404e8b0 con 0x7fe24813ede0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe24e15d640 1 --2- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 0x7fe21805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe24e15d640 10 monclient: get_auth_request con 0x7fe21803ab20 auth_method 0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe24e15d640 1 --2- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 0x7fe21805afd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2380036c0 tx=0x7fe238003610 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fe244022020 con 0x7fe24813ede0 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe22effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:54.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:54.942+0000 7fe22effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:55.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe2503e8640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:54:55.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe2503e8640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:54:55.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe2503e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:55.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe24805fc00 con 0x7fe24813ede0 2026-02-22T20:54:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe22effd640 1 -- 10.20.193.7:0/1456905405 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe24401f700 con 0x7fe24813ede0 2026-02-22T20:54:55.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe22effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:54:55.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.054+0000 7fe22effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=10,logm=66} crc {auth=2676229445,config=3140514009,health=3926953126,kv=3991984195,logm=2082319187}) 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=12,kv=9,logm=65} crc {auth=1829694186,config=3140514009,health=3331030292,kv=3619945143,logm=2033176096}) 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=10,logm=66} crc {auth=2676229445,config=3140514009,health=3926953126,kv=3991984195,logm=2082319187}) 2026-02-22T20:54:55.059 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.054+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=13,kv=10,logm=62} crc {auth=2228158561,config=3140514009,health=900190302,kv=1435687325,logm=2867909431}) 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 msgr2=0x7fe21805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 0x7fe21805afd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe2380036c0 tx=0x7fe238003610 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 10 monclient: shutdown 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 msgr2=0x7fe248136620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe24803a5c0 tx=0x7fe24400ea10 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 shutdown_connections 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe24813ede0 0x7fe248136620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe21803ab20 0x7fe21805afd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe248138b40 0x7fe24813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 --2- 10.20.193.7:0/1456905405 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe2300048d0 0x7fe248152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 >> 10.20.193.7:0/1456905405 conn(0x7fe24808e050 msgr2=0x7fe2480854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 shutdown_connections 2026-02-22T20:54:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:55.058+0000 7fe2503e8640 1 -- 10.20.193.7:0/1456905405 wait complete. 2026-02-22T20:54:55.061 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.061 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4047310791}) 2026-02-22T20:54:55.061 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1470252358}) 2026-02-22T20:54:55.061 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.061 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4047310791}) 2026-02-22T20:54:55.062 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=986905025}) 2026-02-22T20:54:55.064 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=878015858}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=387163791}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=878015858}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.058+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2312037001}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507330027}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=245705493}) 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.065 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507330027}) 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=488549637}) 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3308471777}) 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1021741426}) 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3308471777}) 2026-02-22T20:54:55.066 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=554127124}) 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2317434367}) 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4027480624}) 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2317434367}) 2026-02-22T20:54:55.068 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1738824808}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658294481}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3400341363}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658294481}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2053308136}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6} crc {logm=1926647719,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1930428157,mon_config_key=2504319980,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=62,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=3819878912,mdsmap=774328894,mgr=3250251636,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2819949100,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=3343516259}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6} crc {logm=1926647719,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1930428157,mon_config_key=2504319980,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947}) 2026-02-22T20:54:55.069 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.062+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=58,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1} crc {logm=3681719555,mdsmap=3140514009,mgr=2003615621,mgr_command_descs=2703170561,mgr_metadata=266755361,mgrstat=106986005,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=2985015379,osd_snap=3823785925}) 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=54} crc {osd_pg_creating=2985015379,osd_snap=4133920409,osdmap=3199179942}) 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=51} crc {osd_pg_creating=2985015379,osd_snap=4133920409,osdmap=2377453472}) 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=54} crc {osd_pg_creating=2985015379,osd_snap=4133920409,osdmap=3199179942}) 2026-02-22T20:54:55.070 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:54:55.066+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=54} crc {osd_pg_creating=2985015379,osd_snap=4133920409,osdmap=886633686}) 2026-02-22T20:54:55.071 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:54:56.072 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:54:56.072 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: starting. 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19707 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: created object 0... 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: created object 25... 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: created object 49... 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: finishing. 2026-02-22T20:54:56.114 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19708]: shutting down. 2026-02-22T20:54:56.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: get_monmap_and_config 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: monmap: 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:56.130927+0000 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:56.130927+0000 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.139 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 Processor -- start 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 -- start start 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: init 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2026-02-22T20:54:56.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-b con 0x7f51f813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f51f813d800 0x7f51f8139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-c con 0x7f51f813d800 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f51f813a110 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f805d510 con 0x7f51f813a110 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f51f808b800 con 0x7f51f813d800 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f51f808a720 con 0x7f51f813cef0 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.126+0000 7f51fcb7b640 10 monclient(hunting): authenticate will time out at 708.603973s 2026-02-22T20:54:56.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f51f813a110 0x7f51f819e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39092/0 (socket says 10.20.193.7:39092) 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41120/0 (socket says 10.20.193.7:41120) 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 -- 10.20.193.7:0/4211496988 learned_addr learned my addr 10.20.193.7:0/4211496988 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): get_auth_request con 0x7f51f813cef0 auth_method 0 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 1 --2- 10.20.193.7:0/4211496988 >> v2:10.20.193.61:3300/0 conn(0x7f51f813d800 0x7f51f8139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): get_auth_request con 0x7f51f813d800 auth_method 0 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): handle_auth_done global_id 64133 payload 274 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 -- 10.20.193.7:0/4211496988 >> v2:10.20.193.61:3300/0 conn(0x7f51f813d800 msgr2=0x7f51f8139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 --2- 10.20.193.7:0/4211496988 >> v2:10.20.193.61:3300/0 conn(0x7f51f813d800 0x7f51f8139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 -- 10.20.193.7:0/4211496988 >> v1:10.20.193.7:6789/0 conn(0x7f51f813a110 legacy=0x7f51f819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 monclient: found mon.noname-b 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 1 -- 10.20.193.7:0/4211496988 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927255105 0 0) 0x7f51f805d510 con 0x7f51f813a110 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 -- 10.20.193.7:0/4211496988 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f808aa00 con 0x7f51f813cef0 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 --2- 10.20.193.7:0/4211496988 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51ec004780 tx=0x7f51ec01cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f7bfcf20c489e24 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 1 -- 10.20.193.7:0/4211496988 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0b0070 con 0x7f51f813cef0 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: dump: 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.144 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 1 -- 10.20.193.7:0/4211496988 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec0ab600 con 0x7f51f813cef0 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 1 -- 10.20.193.7:0/4211496988 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0ab9b0 con 0x7f51f813cef0 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 5 monclient: authenticate success, global_id 64133 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 4 set_mon_vals no callback set 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5573640 10 monclient: dump: 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.146 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: shutdown 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/4211496988 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 msgr2=0x7f51f813d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/4211496988 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51ec004780 tx=0x7f51ec01cea0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/4211496988 shutdown_connections 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/4211496988 >> v2:10.20.193.61:3300/0 conn(0x7f51f813d800 0x7f51f8139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/4211496988 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813cef0 0x7f51f813d2c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/4211496988 >> 10.20.193.7:0/4211496988 conn(0x7f51f808f860 msgr2=0x7f51f808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/4211496988 shutdown_connections 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/4211496988 wait complete. 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: monmap: 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:56.148 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 Processor -- start 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- start start 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: init 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f51f813a110 0x7f51f81507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-b con 0x7f51f813a110 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f51f813cef0 0x7f51f8150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-a con 0x7f51f813cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): picked mon.noname-c con 0x7f51f813d800 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8088fa0 con 0x7f51f813cef0 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8088e20 con 0x7f51f813a110 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f51f81a23b0 con 0x7f51f813d800 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient(hunting): authenticate will time out at 708.607083s 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41130/0 (socket says 10.20.193.7:41130) 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 -- 10.20.193.7:0/3165150635 learned_addr learned my addr 10.20.193.7:0/3165150635 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): get_auth_request con 0x7f51f813d800 auth_method 0 2026-02-22T20:54:56.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f51f813cef0 0x7f51f8150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): get_auth_request con 0x7f51f813cef0 auth_method 0 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f51f813a110 0x7f51f81507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): get_auth_request con 0x7f51f813a110 auth_method 0 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient(hunting): handle_auth_done global_id 64136 payload 824 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 -- 10.20.193.7:0/3165150635 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f51f813a110 msgr2=0x7f51f81507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f51f813a110 0x7f51f81507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 -- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f51f813cef0 msgr2=0x7f51f8150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f51f813cef0 0x7f51f8150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 monclient: found mon.noname-c 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 -- 10.20.193.7:0/3165150635 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f812d360 con 0x7f51f813d800 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f6d76640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cb40 tx=0x7f51e800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8018070 con 0x7f51f813d800 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: dump: 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.153 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e800aca0 con 0x7f51f813d800 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 5 monclient: authenticate success, global_id 64136 2026-02-22T20:54:56.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _renew_subs 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f812c7d0 con 0x7f51f813d800 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80072d0 con 0x7f51f813d800 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51f4d72640 4 set_mon_vals no callback set 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51deffd640 10 monclient: dump: 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.155 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _renew_subs 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.130+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f805c710 con 0x7f51f813d800 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51fcb7b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51fcb7b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51fcb7b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f80382a0 con 0x7f51f813d800 2026-02-22T20:54:56.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f51e8007470 con 0x7f51f813d800 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 1 --2- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 0x7f51c405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7f51e804ea70 con 0x7f51f813d800 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51f6575640 1 --2- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 0x7f51c405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51f6575640 10 monclient: get_auth_request con 0x7f51c403ab20 auth_method 0 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51f6575640 1 --2- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 0x7f51c405afd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01cee0 tx=0x7f51ec0ad040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f51e8011360 con 0x7f51f813d800 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.157 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.134+0000 7f51deffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:56.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:54:56.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:56.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f51f813d2c0 con 0x7f51f813d800 2026-02-22T20:54:56.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51deffd640 1 -- 10.20.193.7:0/3165150635 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f51e80090e0 con 0x7f51f813d800 2026-02-22T20:54:56.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51deffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:56.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51deffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:56.249 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 msgr2=0x7f51c405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 0x7f51c405afd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01cee0 tx=0x7f51ec0ad040 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 10 monclient: shutdown 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 msgr2=0x7f51f80869b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cb40 tx=0x7f51e800a060 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 shutdown_connections 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f51f813d800 0x7f51f80869b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f51f813cef0 0x7f51f8150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> v2:10.20.193.61:6800/2336688312 conn(0x7f51c403ab20 0x7f51c405afd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 --2- 10.20.193.7:0/3165150635 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f51f813a110 0x7f51f81507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 >> 10.20.193.7:0/3165150635 conn(0x7f51f808f860 msgr2=0x7f51f813b710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 shutdown_connections 2026-02-22T20:54:56.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.246+0000 7f51fcb7b640 1 -- 10.20.193.7:0/3165150635 wait complete. 2026-02-22T20:54:56.259 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:54:56.259 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:54:56.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:54:56.259 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:54:56.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 10 monclient: get_monmap_and_config 2026-02-22T20:54:56.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 10 monclient: monmap: 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:56.319321+0000 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:56.319321+0000 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:56.320 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 1 Processor -- start 2026-02-22T20:54:56.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 1 -- start start 2026-02-22T20:54:56.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.314+0000 7f5552811640 10 monclient: init 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-b con 0x7f554c13f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f554c13fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f554c13c680 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554c08fd70 con 0x7f554c13c680 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554c092bc0 con 0x7f554c13fba0 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f554c08e1f0 con 0x7f554c13f290 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): authenticate will time out at 708.792431s 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41146/0 (socket says 10.20.193.7:41146) 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5550d87640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f554c13c680 0x7f554c1a17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39104/0 (socket says 10.20.193.7:39104) 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 -- 10.20.193.7:0/197079980 learned_addr learned my addr 10.20.193.7:0/197079980 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): get_auth_request con 0x7f554c13f290 auth_method 0 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient(hunting): handle_auth_done global_id 64139 payload 274 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 -- 10.20.193.7:0/197079980 >> v1:10.20.193.61:6789/0 conn(0x7f554c13fba0 legacy=0x7f554c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 1 -- 10.20.193.7:0/197079980 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194570277 0 0) 0x7f5540002ca0 con 0x7f554c13c680 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 -- 10.20.193.7:0/197079980 >> v1:10.20.193.7:6789/0 conn(0x7f554c13c680 legacy=0x7f554c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 monclient: found mon.noname-b 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 -- 10.20.193.7:0/197079980 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c08e6d0 con 0x7f554c13f290 2026-02-22T20:54:56.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554bfff640 1 --2- 10.20.193.7:0/197079980 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5538009910 tx=0x7f553801c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89cf412ee4463d7d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 1 -- 10.20.193.7:0/197079980 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380a9640 con 0x7f554c13f290 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: dump: 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.335 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 1 -- 10.20.193.7:0/197079980 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55380a97e0 con 0x7f554c13f290 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 1 -- 10.20.193.7:0/197079980 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380a9bb0 con 0x7f554c13f290 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f554affd640 10 monclient: dump: 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 5 monclient: authenticate success, global_id 64139 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:56.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 4 set_mon_vals no callback set 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: shutdown 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- 10.20.193.7:0/197079980 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 msgr2=0x7f554c13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- 10.20.193.7:0/197079980 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5538009910 tx=0x7f553801c5a0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- 10.20.193.7:0/197079980 shutdown_connections 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- 10.20.193.7:0/197079980 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13f290 0x7f554c13f660 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- 10.20.193.7:0/197079980 >> 10.20.193.7:0/197079980 conn(0x7f554c093df0 msgr2=0x7f554c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- 10.20.193.7:0/197079980 shutdown_connections 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- 10.20.193.7:0/197079980 wait complete. 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: monmap: 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 Processor -- start 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- start start 2026-02-22T20:54:56.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: init 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554c13c680 0x7f554c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-b con 0x7f554c13c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 0x7f554c151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-a con 0x7f554c13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13fba0 0x7f554c12a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): picked mon.noname-c con 0x7f554c13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f554c13ecc0 con 0x7f554c13f290 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f554c1a58a0 con 0x7f554c13c680 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f554c1a5720 con 0x7f554c13fba0 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.318+0000 7f5552811640 10 monclient(hunting): authenticate will time out at 708.795949s 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 0x7f554c151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 0x7f554c151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60290/0 (socket says 10.20.193.7:60290) 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 -- 10.20.193.7:0/1115134018 learned_addr learned my addr 10.20.193.7:0/1115134018 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): get_auth_request con 0x7f554c13f290 auth_method 0 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13fba0 0x7f554c12a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554c13c680 0x7f554c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): get_auth_request con 0x7f554c13fba0 auth_method 0 2026-02-22T20:54:56.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): get_auth_request con 0x7f554c13c680 auth_method 0 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient(hunting): handle_auth_done global_id 5175 payload 824 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13fba0 msgr2=0x7f554c12a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13fba0 0x7f554c12a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554c13c680 msgr2=0x7f554c150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f554c13c680 0x7f554c150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 monclient: found mon.noname-a 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c13c330 con 0x7f554c13f290 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f554c13fba0 0x7f554c12a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554b7fe640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 0x7f554c151040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c550 tx=0x7f553c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c006ad0 con 0x7f554c13f290 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: dump: 2026-02-22T20:54:56.345 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c006c70 con 0x7f554c13f290 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 5 monclient: authenticate success, global_id 5175 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 monclient: _renew_subs 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c13ee40 con 0x7f554c13f290 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c007250 con 0x7f554c13f290 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: dump: 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.347 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554a7fc640 4 set_mon_vals no callback set 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 monclient: _renew_subs 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c12dd80 con 0x7f554c13f290 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 0x7f554c12a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f554c1a5a20 con 0x7f554c12a600 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 0x7f554c12a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient: get_auth_request con 0x7f554c12a600 auth_method 0 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f553c023060 con 0x7f554c13f290 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 10 monclient(hunting): handle_auth_done global_id 5178 payload 824 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f554c12d210 con 0x7f554c12a600 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 --2- 10.20.193.7:0/1115134018 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551c03ab20 0x7f551c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7f553c04e850 con 0x7f554c13f290 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f554bfff640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 0x7f554c12a9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55380ab040 tx=0x7f553801ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380c1070 con 0x7f554c12a600 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: dump: 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.350 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 1 --2- 10.20.193.7:0/1115134018 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551c03ab20 0x7f551c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 10 monclient: get_auth_request con 0x7f551c03ab20 auth_method 0 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f55380a9e30 con 0x7f554c12a600 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 msgr2=0x7f554c12a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 0x7f554c12a9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55380ab040 tx=0x7f553801ade0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 msgr2=0x7f554c12a9d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5548ff9640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12a600 0x7f554c12a9d0 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f55380ab040 tx=0x7f553801ade0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.322+0000 7f5550d87640 1 --2- 10.20.193.7:0/1115134018 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551c03ab20 0x7f551c05afd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5540003070 tx=0x7f5540003000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 0x7f554c088650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f554c057420 con 0x7f554c12af10 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 0x7f554c088650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient: get_auth_request con 0x7f554c12af10 auth_method 0 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 10 monclient(hunting): handle_auth_done global_id 5181 payload 824 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 1 -- 10.20.193.7:0/1115134018 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f554c12c580 con 0x7f554c12af10 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f554bfff640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 0x7f554c088650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5538002410 tx=0x7f5538009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380c1050 con 0x7f554c12af10 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 10 monclient: dump: 2026-02-22T20:54:56.353 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f55380c2040 con 0x7f554c12af10 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 msgr2=0x7f554c088650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 0x7f554c088650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5538002410 tx=0x7f5538009300 comp rx=0 tx=0).stop 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 msgr2=0x7f554c088650 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5548ff9640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c12af10 0x7f554c088650 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5538002410 tx=0x7f5538009300 comp rx=0 tx=0).stop 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:54:56.355 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 175456, 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.356 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:56.357 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.358 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:56.359 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.360 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.361 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.362 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.364 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.365 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.366 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:56.367 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551c03ab20 msgr2=0x7f551c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 --2- 10.20.193.7:0/1115134018 >> v2:10.20.193.61:6800/2336688312 conn(0x7f551c03ab20 0x7f551c05afd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5540003070 tx=0x7f5540003000 comp rx=0 tx=0).stop 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 10 monclient: shutdown 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 msgr2=0x7f554c151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 --2- 10.20.193.7:0/1115134018 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f554c13f290 0x7f554c151040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c550 tx=0x7f553c00ca10 comp rx=0 tx=0).stop 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5550d87640 1 -- 10.20.193.7:0/1115134018 reap_dead start 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5550d87640 1 -- 10.20.193.7:0/1115134018 reap_dead start 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 shutdown_connections 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 >> 10.20.193.7:0/1115134018 conn(0x7f554c093df0 msgr2=0x7f554c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 shutdown_connections 2026-02-22T20:54:56.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.326+0000 7f5552811640 1 -- 10.20.193.7:0/1115134018 wait complete. 2026-02-22T20:54:56.368 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:56.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:54:56.369 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:54:56.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: get_monmap_and_config 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: monmap: 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:56.438074+0000 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:56.438074+0000 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:56.441 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 Processor -- start 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 -- start start 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: init 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa19005d1c0 0x7fa19005d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-a con 0x7fa19005d1c0 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fa19008e3b0 0x7fa19008e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-c con 0x7fa19008e3b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:56.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa19008ed30 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19013fbd0 con 0x7fa19008ed30 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa19008a6d0 con 0x7fa19005d1c0 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fa19008b770 con 0x7fa19008e3b0 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa1971b2640 10 monclient(hunting): authenticate will time out at 708.910976s 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa19005d1c0 0x7fa19005d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa19005d1c0 0x7fa19005d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60320/0 (socket says 10.20.193.7:60320) 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 -- 10.20.193.7:0/2385917097 learned_addr learned my addr 10.20.193.7:0/2385917097 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): get_auth_request con 0x7fa19005d1c0 auth_method 0 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa187fff640 1 --2- 10.20.193.7:0/2385917097 >> v2:10.20.193.61:3300/0 conn(0x7fa19008e3b0 0x7fa19008e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient(hunting): handle_auth_done global_id 5184 payload 274 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 -- 10.20.193.7:0/2385917097 >> v2:10.20.193.61:3300/0 conn(0x7fa19008e3b0 msgr2=0x7fa19008e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 --2- 10.20.193.7:0/2385917097 >> v2:10.20.193.61:3300/0 conn(0x7fa19008e3b0 0x7fa19008e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 -- 10.20.193.7:0/2385917097 >> v1:10.20.193.61:6789/0 conn(0x7fa19008ed30 legacy=0x7fa1901a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 monclient: found mon.noname-a 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.434+0000 7fa194f27640 1 -- 10.20.193.7:0/2385917097 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19008ba50 con 0x7fa19005d1c0 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 --2- 10.20.193.7:0/2385917097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa19005d590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa19008d330 tx=0x7fa18001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b406b4b3786adc3d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 1 -- 10.20.193.7:0/2385917097 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b0070 con 0x7fa19005d1c0 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: dump: 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 1 -- 10.20.193.7:0/2385917097 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1800ab600 con 0x7fa19005d1c0 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 1 -- 10.20.193.7:0/2385917097 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800a4e60 con 0x7fa19005d1c0 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 5 monclient: authenticate success, global_id 5184 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1877fe640 10 monclient: dump: 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.446 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 4 set_mon_vals no callback set 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: shutdown 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/2385917097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 msgr2=0x7fa19005d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- 10.20.193.7:0/2385917097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa19005d590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa19008d330 tx=0x7fa18001c300 comp rx=0 tx=0).stop 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/2385917097 shutdown_connections 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- 10.20.193.7:0/2385917097 >> v2:10.20.193.61:3300/0 conn(0x7fa19008e3b0 0x7fa19008e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- 10.20.193.7:0/2385917097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa19005d590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/2385917097 >> 10.20.193.7:0/2385917097 conn(0x7fa19008faa0 msgr2=0x7fa19008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/2385917097 shutdown_connections 2026-02-22T20:54:56.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/2385917097 wait complete. 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: monmap: 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 Processor -- start 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- start start 2026-02-22T20:54:56.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: init 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa1901506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-a con 0x7fa19005d1c0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 0x7fa190150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-c con 0x7fa19008e3b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa19008ed30 0x7fa190127670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): picked mon.noname-b con 0x7fa19008ed30 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa19008a910 con 0x7fa19005d1c0 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa1901a4560 con 0x7fa19008ed30 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa19012ab50 con 0x7fa19008e3b0 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): authenticate will time out at 708.913781s 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 0x7fa190150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa1901506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 0x7fa190150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41156/0 (socket says 10.20.193.7:41156) 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 -- 10.20.193.7:0/640192152 learned_addr learned my addr 10.20.193.7:0/640192152 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): get_auth_request con 0x7fa19008e3b0 auth_method 0 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): get_auth_request con 0x7fa19005d1c0 auth_method 0 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa19008ed30 0x7fa190127670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): get_auth_request con 0x7fa19008ed30 auth_method 0 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient(hunting): handle_auth_done global_id 5187 payload 824 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 msgr2=0x7fa190150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 0x7fa190150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa19008ed30 msgr2=0x7fa190127670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa19008ed30 0x7fa190127670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 monclient: found mon.noname-a 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19013c7c0 con 0x7fa19005d1c0 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa19008e3b0 0x7fa190150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa194f27640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa1901506e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa19008d330 tx=0x7fa18001ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b8020 con 0x7fa19005d1c0 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: dump: 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.464 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1800a4e60 con 0x7fa19005d1c0 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800b0040 con 0x7fa19005d1c0 2026-02-22T20:54:56.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: dump: 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.466 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa186ffd640 4 set_mon_vals no callback set 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 5 monclient: authenticate success, global_id 5187 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _renew_subs 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa190086690 con 0x7fa19005d1c0 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _renew_subs 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa190129bf0 con 0x7fa19005d1c0 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 0x7fa190086860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.467 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa1900382a0 con 0x7fa190128370 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 0x7fa190086860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient: get_auth_request con 0x7fa190128370 auth_method 0 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 10 monclient(hunting): handle_auth_done global_id 64148 payload 824 2026-02-22T20:54:56.468 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa19005d590 con 0x7fa190128370 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa180004240 con 0x7fa19005d1c0 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa187fff640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 0x7fa190086860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa17800d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 --2- 10.20.193.7:0/640192152 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa16003ab20 0x7fa16005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7fa1800e76f0 con 0x7fa19005d1c0 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178004220 con 0x7fa190128370 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: dump: 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.469 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 1 --2- 10.20.193.7:0/640192152 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa16003ab20 0x7fa16005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fa178004220 con 0x7fa190128370 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 msgr2=0x7fa190086860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 0x7fa190086860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa17800d590 comp rx=0 tx=0).stop 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 msgr2=0x7fa190086860 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa1857fa640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128370 0x7fa190086860 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa17800d590 comp rx=0 tx=0).stop 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 10 monclient: get_auth_request con 0x7fa16003ab20 auth_method 0 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.438+0000 7fa195728640 1 --2- 10.20.193.7:0/640192152 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa16003ab20 0x7fa16005afd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa18c003b30 tx=0x7fa18c004270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 0x7fa190086da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa19005fc70 con 0x7fa190128740 2026-02-22T20:54:56.471 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 0x7fa190086da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient: get_auth_request con 0x7fa190128740 auth_method 0 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 10 monclient(hunting): handle_auth_done global_id 64151 payload 824 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 1 -- 10.20.193.7:0/640192152 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1901399a0 con 0x7fa190128740 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa187fff640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 0x7fa190086da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa1780047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178003d10 con 0x7fa190128740 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 10 monclient: dump: 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.473 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7fa178003d10 con 0x7fa190128740 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 msgr2=0x7fa190086da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 0x7fa190086da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa1780047b0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 msgr2=0x7fa190086da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1857fa640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa190128740 0x7fa190086da0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a190 tx=0x7fa1780047b0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:56.474 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 22046, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.475 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.476 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.477 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:56.478 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.479 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:56.480 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.481 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.482 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.483 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.484 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.485 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:56.486 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:56.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa16003ab20 msgr2=0x7fa16005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 --2- 10.20.193.7:0/640192152 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa16003ab20 0x7fa16005afd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa18c003b30 tx=0x7fa18c004270 comp rx=0 tx=0).stop 2026-02-22T20:54:56.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 10 monclient: shutdown 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 msgr2=0x7fa1901506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 --2- 10.20.193.7:0/640192152 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa19005d1c0 0x7fa1901506e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa19008d330 tx=0x7fa18001ab40 comp rx=0 tx=0).stop 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa195728640 1 -- 10.20.193.7:0/640192152 reap_dead start 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa195728640 1 -- 10.20.193.7:0/640192152 reap_dead start 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 shutdown_connections 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 >> 10.20.193.7:0/640192152 conn(0x7fa19008faa0 msgr2=0x7fa19013ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 shutdown_connections 2026-02-22T20:54:56.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.442+0000 7fa1971b2640 1 -- 10.20.193.7:0/640192152 wait complete. 2026-02-22T20:54:56.488 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:56.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:54:56.488 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.542+0000 7f22ac103640 10 monclient: get_monmap_and_config 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.542+0000 7f22ac103640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.542+0000 7f22ac103640 10 monclient: monmap: 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:56.547508+0000 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:56.547508+0000 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:56.547 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 Processor -- start 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- start start 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: init 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f22a408b590 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f22a413a6a0 0x7f22a417e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-a con 0x7f22a413a6a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f22a417e8b0 0x7f22a419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-c con 0x7f22a417e8b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a4089920 con 0x7f22a408b590 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f22a413aad0 con 0x7f22a413a6a0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f22a408ab40 con 0x7f22a417e8b0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient(hunting): authenticate will time out at 709.020414s 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9e78640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f22a408b590 0x7f22a4139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39110/0 (socket says 10.20.193.7:39110) 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9e78640 1 -- 10.20.193.7:0/1195579616 learned_addr learned my addr 10.20.193.7:0/1195579616 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 --2- 10.20.193.7:0/1195579616 >> v2:10.20.193.7:3300/0 conn(0x7f22a413a6a0 0x7f22a417e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): get_auth_request con 0x7f22a413a6a0 auth_method 0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 1 --2- 10.20.193.7:0/1195579616 >> v2:10.20.193.61:3300/0 conn(0x7f22a417e8b0 0x7f22a419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): get_auth_request con 0x7f22a417e8b0 auth_method 0 2026-02-22T20:54:56.548 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 1 -- 10.20.193.7:0/1195579616 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241480385 0 0) 0x7f22a4089920 con 0x7f22a408b590 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient(hunting): _negotiate 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient(hunting): my global_id is 5193 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 1 -- 10.20.193.7:0/1195579616 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f228c003620 con 0x7f22a408b590 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient(hunting): handle_auth_done global_id 5190 payload 274 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 -- 10.20.193.7:0/1195579616 >> v2:10.20.193.61:3300/0 conn(0x7f22a417e8b0 msgr2=0x7f22a419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 --2- 10.20.193.7:0/1195579616 >> v2:10.20.193.61:3300/0 conn(0x7f22a417e8b0 0x7f22a419ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 -- 10.20.193.7:0/1195579616 >> v1:10.20.193.7:6789/0 conn(0x7f22a408b590 legacy=0x7f22a4139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 monclient: found mon.noname-a 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 -- 10.20.193.7:0/1195579616 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a408a860 con 0x7f22a413a6a0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a9677640 1 --2- 10.20.193.7:0/1195579616 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a413a6a0 0x7f22a417e370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f22a408d2e0 tx=0x7f229801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a455ec7778ecef3 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 1 -- 10.20.193.7:0/1195579616 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980ab620 con 0x7f22a413a6a0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: dump: 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.549 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 1 -- 10.20.193.7:0/1195579616 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22980b0070 con 0x7f22a413a6a0 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 1 -- 10.20.193.7:0/1195579616 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980ab9e0 con 0x7f22a413a6a0 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22a8e76640 10 monclient: dump: 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 5 monclient: authenticate success, global_id 5190 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 4 set_mon_vals no callback set 2026-02-22T20:54:56.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: shutdown 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- 10.20.193.7:0/1195579616 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a413a6a0 msgr2=0x7f22a417e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 --2- 10.20.193.7:0/1195579616 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a413a6a0 0x7f22a417e370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f22a408d2e0 tx=0x7f229801c400 comp rx=0 tx=0).stop 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- 10.20.193.7:0/1195579616 shutdown_connections 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 --2- 10.20.193.7:0/1195579616 >> v2:10.20.193.61:3300/0 conn(0x7f22a417e8b0 0x7f22a419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 --2- 10.20.193.7:0/1195579616 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a413a6a0 0x7f22a417e370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- 10.20.193.7:0/1195579616 >> 10.20.193.7:0/1195579616 conn(0x7f22a408faa0 msgr2=0x7f22a408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- 10.20.193.7:0/1195579616 shutdown_connections 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- 10.20.193.7:0/1195579616 wait complete. 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: monmap: 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 Processor -- start 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 1 -- start start 2026-02-22T20:54:56.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.546+0000 7f22ac103640 10 monclient: init 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 0x7f22a41392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-c con 0x7f22a408b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a413a6a0 0x7f22a41397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-b con 0x7f22a413a6a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a417e8b0 0x7f22a4190540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): picked mon.noname-a con 0x7f22a417e8b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41a1e10 con 0x7f22a417e8b0 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41a1c90 con 0x7f22a413a6a0 2026-02-22T20:54:56.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f22a41a1f90 con 0x7f22a408b590 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): authenticate will time out at 709.024204s 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 0x7f22a41392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 0x7f22a41392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41196/0 (socket says 10.20.193.7:41196) 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 -- 10.20.193.7:0/1425673148 learned_addr learned my addr 10.20.193.7:0/1425673148 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): get_auth_request con 0x7f22a408b590 auth_method 0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a417e8b0 0x7f22a4190540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): get_auth_request con 0x7f22a417e8b0 auth_method 0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a413a6a0 0x7f22a41397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): get_auth_request con 0x7f22a413a6a0 auth_method 0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient(hunting): handle_auth_done global_id 64154 payload 824 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a413a6a0 msgr2=0x7f22a41397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a413a6a0 0x7f22a41397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a417e8b0 msgr2=0x7f22a4190540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f22a417e8b0 0x7f22a4190540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 monclient: found mon.noname-c 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a412c9e0 con 0x7f22a408b590 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9e78640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 0x7f22a41392a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f229400c700 tx=0x7f229400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294017070 con 0x7f22a408b590 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: dump: 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2294005bb0 con 0x7f22a408b590 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294007070 con 0x7f22a408b590 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: dump: 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f2293fff640 4 set_mon_vals no callback set 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 5 monclient: authenticate success, global_id 64154 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _renew_subs 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a405d250 con 0x7f22a408b590 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _renew_subs 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a412b650 con 0x7f22a408b590 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 0x7f22a4086da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f22a412c180 con 0x7f22a40869d0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2294007210 con 0x7f22a408b590 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 0x7f22a4086da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient: get_auth_request con 0x7f22a40869d0 auth_method 0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 --2- 10.20.193.7:0/1425673148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f227403ab20 0x7f227405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7f229404df90 con 0x7f22a408b590 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 1 --2- 10.20.193.7:0/1425673148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f227403ab20 0x7f227405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 10 monclient: get_auth_request con 0x7f227403ab20 auth_method 0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 10 monclient(hunting): handle_auth_done global_id 54328 payload 824 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22a4058db0 con 0x7f22a40869d0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22a9677640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 0x7f22a4086da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f229801a030 tx=0x7f22980191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22aa679640 1 --2- 10.20.193.7:0/1425673148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f227403ab20 0x7f227405afd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22a4088790 tx=0x7f22a000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298004590 con 0x7f22a40869d0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: dump: 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.555 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f22980b9070 con 0x7f22a40869d0 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 msgr2=0x7f22a4086da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 0x7f22a4086da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f229801a030 tx=0x7f22980191a0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 msgr2=0x7f22a4086da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.550+0000 7f22927fc640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40869d0 0x7f22a4086da0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f229801a030 tx=0x7f22980191a0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 0x7f22a405ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40382a0 con 0x7f22a40872e0 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 0x7f22a405ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient: get_auth_request con 0x7f22a40872e0 auth_method 0 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 10 monclient(hunting): handle_auth_done global_id 54331 payload 824 2026-02-22T20:54:56.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 1 -- 10.20.193.7:0/1425673148 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22a4139f90 con 0x7f22a40872e0 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22a9677640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 0x7f22a405ac70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2298002410 tx=0x7f22980a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298004590 con 0x7f22a40872e0 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 10 monclient: dump: 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.558 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7f22980b0040 con 0x7f22a40872e0 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 msgr2=0x7f22a405ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 0x7f22a405ac70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2298002410 tx=0x7f22980a9000 comp rx=0 tx=0).stop 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 msgr2=0x7f22a405ac70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22927fc640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f22a40872e0 0x7f22a405ac70 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2298002410 tx=0x7f22980a9000 comp rx=0 tx=0).stop 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 26, 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 79790, 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:54:56.559 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.560 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:54:56.561 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:54:56.562 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:54:56.565 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f227403ab20 msgr2=0x7f227405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 --2- 10.20.193.7:0/1425673148 >> v2:10.20.193.61:6800/2336688312 conn(0x7f227403ab20 0x7f227405afd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22a4088790 tx=0x7f22a000b040 comp rx=0 tx=0).stop 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 10 monclient: shutdown 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 msgr2=0x7f22a41392a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 --2- 10.20.193.7:0/1425673148 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f22a408b590 0x7f22a41392a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f229400c700 tx=0x7f229400cbc0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22aa679640 1 -- 10.20.193.7:0/1425673148 reap_dead start 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22aa679640 1 -- 10.20.193.7:0/1425673148 reap_dead start 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 shutdown_connections 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 >> 10.20.193.7:0/1425673148 conn(0x7f22a408faa0 msgr2=0x7f22a405a300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 shutdown_connections 2026-02-22T20:54:56.566 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.554+0000 7f22ac103640 1 -- 10.20.193.7:0/1425673148 wait complete. 2026-02-22T20:54:56.567 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:54:56.567 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-22T20:54:56.567 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:54:56.567 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-22T20:54:56.567 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-22T20:54:56.567 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T20:54:56.567 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:54:56.582 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T20:54:56.582 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:54:56.582 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: get_monmap_and_config 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: monmap: 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:56.650218+0000 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:56.650218+0000 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.650 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 Processor -- start 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 -- start start 2026-02-22T20:54:56.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: init 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 0x7fcfa413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-b con 0x7fcfa413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcfa413d800 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcfa413a2e0 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa405d510 con 0x7fcfa413a2e0 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa408b800 con 0x7fcfa413d800 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa408a720 con 0x7fcfa413cef0 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfaac46640 10 monclient(hunting): authenticate will time out at 709.123446s 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcf9bfff640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fcfa413d800 legacy=0x7fcfa4139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 0x7fcfa413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa91bc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fcfa413a2e0 0x7fcfa419f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39124/0 (socket says 10.20.193.7:39124) 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa91bc640 1 -- 10.20.193.7:0/1978878795 learned_addr learned my addr 10.20.193.7:0/1978878795 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): get_auth_request con 0x7fcfa413cef0 auth_method 0 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_done global_id 64157 payload 274 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 1 -- 10.20.193.7:0/1978878795 >> v1:10.20.193.61:6789/0 conn(0x7fcfa413d800 legacy=0x7fcfa4139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 1 -- 10.20.193.7:0/1978878795 >> v1:10.20.193.7:6789/0 conn(0x7fcfa413a2e0 legacy=0x7fcfa419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 1 monclient: found mon.noname-b 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.646+0000 7fcfa89bb640 1 -- 10.20.193.7:0/1978878795 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa408aa00 con 0x7fcfa413cef0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- 10.20.193.7:0/1978878795 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 0x7fcfa413d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf9401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b17fe3ebc0b2fa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 1 -- 10.20.193.7:0/1978878795 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b0070 con 0x7fcfa413cef0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: dump: 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 1 -- 10.20.193.7:0/1978878795 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940ab600 con 0x7fcfa413cef0 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 1 -- 10.20.193.7:0/1978878795 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940ab9d0 con 0x7fcfa413cef0 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 5 monclient: authenticate success, global_id 64157 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 4 set_mon_vals no callback set 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9b7fe640 10 monclient: dump: 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: shutdown 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/1978878795 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 msgr2=0x7fcfa413d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 --2- 10.20.193.7:0/1978878795 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 0x7fcfa413d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf9401c460 comp rx=0 tx=0).stop 2026-02-22T20:54:56.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/1978878795 shutdown_connections 2026-02-22T20:54:56.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 --2- 10.20.193.7:0/1978878795 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413cef0 0x7fcfa413d2c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/1978878795 >> 10.20.193.7:0/1978878795 conn(0x7fcfa408f860 msgr2=0x7fcfa408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/1978878795 shutdown_connections 2026-02-22T20:54:56.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/1978878795 wait complete. 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: build_initial_monmap 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: monmap: 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:56.659 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 Processor -- start 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- start start 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: init 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-c con 0x7fcfa413a2e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 0x7fcfa4150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-b con 0x7fcfa413cef0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 0x7fcfa4086930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): picked mon.noname-a con 0x7fcfa413d800 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa408ca60 con 0x7fcfa413d800 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa41a3950 con 0x7fcfa413cef0 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa41a37d0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient(hunting): authenticate will time out at 709.127061s 2026-02-22T20:54:56.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41208/0 (socket says 10.20.193.7:41208) 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 -- 10.20.193.7:0/3131031098 learned_addr learned my addr 10.20.193.7:0/3131031098 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): get_auth_request con 0x7fcfa413a2e0 auth_method 0 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9bfff640 1 -- 10.20.193.7:0/3131031098 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 msgr2=0x7fcfa4150d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9bfff640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 0x7fcfa4150d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa91bc640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 0x7fcfa4086930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient(hunting): handle_auth_done global_id 64160 payload 824 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 -- 10.20.193.7:0/3131031098 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 msgr2=0x7fcfa4150d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 0x7fcfa4150d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 -- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 msgr2=0x7fcfa4086930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 0x7fcfa4086930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient: _finish_hunting 0 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 monclient: found mon.noname-c 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:56.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 -- 10.20.193.7:0/3131031098 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa412d5d0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa91bc640 10 monclient: get_auth_request con 0x7fcfa413d800 auth_method 0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa91bc640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 0x7fcfa4086930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfa89bb640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf9401c4a0 tx=0x7fcf94019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b0040 con 0x7fcfa413a2e0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: dump: 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: _finish_auth 0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: _check_auth_tickets 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940b9070 con 0x7fcfa413a2e0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940abbb0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 5 monclient: authenticate success, global_id 64160 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _renew_subs 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa412d8b0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf9affd640 4 set_mon_vals no callback set 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcf997fa640 10 monclient: dump: 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:56.663 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _renew_subs 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa412db90 con 0x7fcfa413a2e0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.650+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa413d2c0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fcf94003710 con 0x7fcfa413a2e0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf997fa640 1 --2- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 0x7fcf7405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7fcf940e87d0 con 0x7fcfa413a2e0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf9bfff640 1 --2- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 0x7fcf7405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf9bfff640 10 monclient: get_auth_request con 0x7fcf7403aa90 auth_method 0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.654+0000 7fcf9bfff640 1 --2- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 0x7fcf7405af40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcfa412d220 tx=0x7fcf8c009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.658+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fcf94016170 con 0x7fcfa413a2e0 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.658+0000 7fcf997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:56.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.658+0000 7fcf997fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:56.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:54:56.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:56.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:54:56.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcfa4139c40 con 0x7fcfa413a2e0 2026-02-22T20:54:56.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcf997fa640 1 -- 10.20.193.7:0/3131031098 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fcf940a5910 con 0x7fcfa413a2e0 2026-02-22T20:54:56.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcf997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:56.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcf997fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:56.773 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 msgr2=0x7fcf7405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 0x7fcf7405af40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcfa412d220 tx=0x7fcf8c009290 comp rx=0 tx=0).stop 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 10 monclient: shutdown 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 msgr2=0x7fcfa41507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf9401c4a0 tx=0x7fcf94019200 comp rx=0 tx=0).stop 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 shutdown_connections 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcfa413d800 0x7fcfa4086930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcf7403aa90 0x7fcf7405af40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcfa413cef0 0x7fcfa4150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 --2- 10.20.193.7:0/3131031098 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcfa413a2e0 0x7fcfa41507c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:56.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 >> 10.20.193.7:0/3131031098 conn(0x7fcfa408f860 msgr2=0x7fcfa413b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:56.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 shutdown_connections 2026-02-22T20:54:56.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:56.770+0000 7fcfaac46640 1 -- 10.20.193.7:0/3131031098 wait complete. 2026-02-22T20:54:56.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:54:56.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:54:59.783 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: get_monmap_and_config 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: build_initial_monmap 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: monmap: 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.864 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:54:59.854729+0000 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:54:59.854729+0000 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 Processor -- start 2026-02-22T20:54:59.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 -- start start 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: init 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd3b0091c70 addr v1:10.20.193.61:6789/0 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3b01604e0 addr v1:10.20.193.7:6789/0 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd3b0181fe0 0x7fd3b01a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-c con 0x7fd3b0181fe0 addr v2:10.20.193.61:3300/0 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b008e6a0 con 0x7fd3b01604e0 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b008e910 con 0x7fd3b0091c70 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b008ebf0 con 0x7fd3b0181fe0 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:59.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b74c6640 10 monclient(hunting): authenticate will time out at 712.327666s 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b523b640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fd3b0091c70 legacy=0x7fd3b0092040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b4a3a640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd3b01604e0 0x7fd3b01808c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:35330/0 (socket says 10.20.193.7:35330) 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/2826171035 learned_addr learned my addr 10.20.193.7:0/2826171035 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b5a3c640 1 -- 10.20.193.7:0/2826171035 >> v2:10.20.193.61:3300/0 conn(0x7fd3b0181fe0 msgr2=0x7fd3b01a23c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd3b5a3c640 1 --2- 10.20.193.7:0/2826171035 >> v2:10.20.193.61:3300/0 conn(0x7fd3b0181fe0 0x7fd3b01a23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731715024 0 0) 0x7fd3b008e6a0 con 0x7fd3b01604e0 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 10 monclient(hunting): _negotiate 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 10 monclient(hunting): my global_id is 5202 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.850+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd398003620 con 0x7fd3b01604e0 2026-02-22T20:54:59.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2106984545 0 0) 0x7fd398003620 con 0x7fd3b01604e0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 >> v2:10.20.193.61:3300/0 conn(0x7fd3b0181fe0 msgr2=0x7fd3b01a23c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 --2- 10.20.193.7:0/2826171035 >> v2:10.20.193.61:3300/0 conn(0x7fd3b0181fe0 0x7fd3b01a23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 >> v1:10.20.193.61:6789/0 conn(0x7fd3b0091c70 legacy=0x7fd3b0092040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b008eed0 con 0x7fd3b01604e0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _finish_auth 0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fd3a4002e50 con 0x7fd3b01604e0 2026-02-22T20:54:59.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: dump: 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:59.869 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 >> v1:10.20.193.7:6789/0 conn(0x7fd3b01604e0 legacy=0x7fd3b01808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd398003b20 0x7fd398003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): picked mon.c con 0x7fd398003b20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 0x7fd398004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): picked mon.a con 0x7fd3980048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd398045a80 0x7fd398065e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): picked mon.b con 0x7fd398045a80 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b008ebf0 con 0x7fd3980048d0 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd398066420 con 0x7fd398045a80 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd398066620 con 0x7fd398003b20 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 0x7fd398004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): get_auth_request con 0x7fd3980048d0 auth_method 0 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:59.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd398003b20 0x7fd398003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b5a3c640 1 -- 10.20.193.7:0/2826171035 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd398045a80 msgr2=0x7fd398065e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b5a3c640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd398045a80 0x7fd398065e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): get_auth_request con 0x7fd398003b20 auth_method 0 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_done global_id 5202 payload 293 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd398003b20 msgr2=0x7fd398003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd398003b20 0x7fd398003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/2826171035 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd398045a80 msgr2=0x7fd398065e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd398045a80 0x7fd398065e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _finish_hunting 0 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 monclient: found mon.a 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/2826171035 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd398003620 con 0x7fd3980048d0 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _finish_auth 0 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _check_auth_tickets 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b5a3c640 1 -- 10.20.193.7:0/2826171035 reap_dead start 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 5 monclient: authenticate success, global_id 5202 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd398003b20 0x7fd398003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:54:59.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 0x7fd398004d40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c190 tx=0x7fd3a401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370c51c3b767aa6c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4007d00 con 0x7fd3980048d0 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: dump: 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.874 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a40a9020 con 0x7fd3980048d0 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 1 -- 10.20.193.7:0/2826171035 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4005bf0 con 0x7fd3980048d0 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39ffff640 10 monclient: dump: 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:59.875 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: get_monmap_and_config success 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 4 set_mon_vals no callback set 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: shutdown 2026-02-22T20:54:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 msgr2=0x7fd398004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 0x7fd398004d40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c190 tx=0x7fd3a401cc00 comp rx=0 tx=0).stop 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- 10.20.193.7:0/2826171035 shutdown_connections 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/2826171035 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3980048d0 0x7fd398004d40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- 10.20.193.7:0/2826171035 >> 10.20.193.7:0/2826171035 conn(0x7fd3b0093d80 msgr2=0x7fd3b0090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- 10.20.193.7:0/2826171035 shutdown_connections 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- 10.20.193.7:0/2826171035 wait complete. 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: build_initial_monmap 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: monmap: 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:54:59.877 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 Processor -- start 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- start start 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: init 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: _reopen_session rank -1 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:54:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-c con 0x7fd3980048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 0x7fd3b015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-a con 0x7fd3b015b470 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 0x7fd3b015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): picked mon.noname-b con 0x7fd3b015caa0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b013f9c0 con 0x7fd3b015b470 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b013fb40 con 0x7fd3b015caa0 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b013fcc0 con 0x7fd3980048d0 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): _renew_subs 2026-02-22T20:54:59.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b74c6640 10 monclient(hunting): authenticate will time out at 712.331450s 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b5a3c640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 msgr2=0x7fd3b015cf20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b5a3c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 0x7fd3b015cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:38956/0 (socket says 10.20.193.7:38956) 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 -- 10.20.193.7:0/456618507 learned_addr learned my addr 10.20.193.7:0/456618507 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): get_auth_request con 0x7fd3980048d0 auth_method 0 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 0x7fd3b015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:59.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): get_auth_request con 0x7fd3b015b470 auth_method 0 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 msgr2=0x7fd3b008a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/456618507 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 msgr2=0x7fd3b015cf20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 0x7fd3b015cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _finish_hunting 0 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 monclient: found mon.noname-a 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 -- 10.20.193.7:0/456618507 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b015ff00 con 0x7fd3b015b470 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b523b640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd3b4a3a640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 0x7fd3b015aa90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3a401b300 tx=0x7fd398005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40048e0 con 0x7fd3b015b470 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:54:59.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 10 monclient: dump: 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 10 monclient: _finish_auth 0 2026-02-22T20:54:59.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.854+0000 7fd39dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4004aa0 con 0x7fd3b015b470 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 5 monclient: authenticate success, global_id 5205 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _renew_subs 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40a58b0 con 0x7fd3b015b470 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b01601e0 con 0x7fd3b015b470 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39f7fe640 4 set_mon_vals no callback set 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:54:59.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 10 monclient: dump: 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:54:59.885 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _renew_subs 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b015f940 con 0x7fd3b015b470 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b01424e0 con 0x7fd3b015b470 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd3a40a5a50 con 0x7fd3b015b470 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 1 --2- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 0x7fd38005ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7fd3a40e7f90 con 0x7fd3b015b470 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b523b640 1 --2- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 0x7fd38005ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b523b640 10 monclient: get_auth_request con 0x7fd38003a9d0 auth_method 0 2026-02-22T20:54:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.858+0000 7fd3b523b640 1 --2- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 0x7fd38005ae80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0002410 tx=0x7fd3a0009650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:54:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.862+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd3a40b4070 con 0x7fd3b015b470 2026-02-22T20:54:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.862+0000 7fd39dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:54:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.862+0000 7fd39dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd3b0092890 con 0x7fd3b015b470 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd39dffb640 1 -- 10.20.193.7:0/456618507 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7fd3a40169b0 con 0x7fd3b015b470 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd39dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd39dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:54:59.973 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 msgr2=0x7fd38005ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 0x7fd38005ae80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0002410 tx=0x7fd3a0009650 comp rx=0 tx=0).stop 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 10 monclient: shutdown 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 msgr2=0x7fd3b015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 0x7fd3b015aa90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3a401b300 tx=0x7fd398005900 comp rx=0 tx=0).stop 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 shutdown_connections 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd38003a9d0 0x7fd38005ae80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3b015caa0 0x7fd3b015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3b015b470 0x7fd3b015aa90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 --2- 10.20.193.7:0/456618507 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3980048d0 0x7fd3b008a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:54:59.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 >> 10.20.193.7:0/456618507 conn(0x7fd3b0093d80 msgr2=0x7fd3b0056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:54:59.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 shutdown_connections 2026-02-22T20:54:59.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:54:59.970+0000 7fd3b74c6640 1 -- 10.20.193.7:0/456618507 wait complete. 2026-02-22T20:55:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:55:01] 2026-02-22T20:55:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:55:01 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['rbd', 'ceph_test_rados_delete_pools_parallel.trial061-19707', '.mgr'] 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T20:55:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:55:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:55:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:55:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "ceph_test_rados_delete_pools_parallel.trial061-19707": { 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": {}, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:54:54.415557+0000", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 32769, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,creating", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "90", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 32, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 32, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 32, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 32, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 32, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 27, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "ceph_test_rados_delete_pools_parallel.trial061-19707", 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 1.309999942779541, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 1.309999942779541, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 1.309999942779541, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 1.309999942779541, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:55:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:55:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:55:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1, -1] pools [1, 2, 27] with 6 osds, pg_target 600 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'ceph_test_rados_delete_pools_parallel.trial061-19707' root_id -1 using 7.064254195601851e-07 of space, bias 1.0, pg target 0.00021192762586805553 quantized to 32 (current 32) 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:55:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:55:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:02.984 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:03.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.042+0000 7f0233728640 10 monclient: get_monmap_and_config 2026-02-22T20:55:03.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.042+0000 7f0233728640 10 monclient: build_initial_monmap 2026-02-22T20:55:03.047 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.042+0000 7f0233728640 10 monclient: monmap: 2026-02-22T20:55:03.047 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:03.047 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:03.047333+0000 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:03.047333+0000 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:03.048 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 Processor -- start 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- start start 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: init 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f022c13be70 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): picked mon.noname-a con 0x7f022c13c950 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f022c17d950 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022c0875d0 con 0x7f022c17d950 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022c0872f0 con 0x7f022c13be70 2026-02-22T20:55:03.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f022c0878b0 con 0x7f022c13c950 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient(hunting): authenticate will time out at 715.520666s 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f023149d640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f022c13be70 legacy=0x7f022c13c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0231c9e640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f022c17d950 0x7f022c19dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:35346/0 (socket says 10.20.193.7:35346) 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0231c9e640 1 -- 10.20.193.7:0/2754006732 learned_addr learned my addr 10.20.193.7:0/2754006732 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): get_auth_request con 0x7f022c13c950 auth_method 0 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:03.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient(hunting): handle_auth_done global_id 5208 payload 274 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 -- 10.20.193.7:0/2754006732 >> v1:10.20.193.61:6789/0 conn(0x7f022c13be70 legacy=0x7f022c13c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 -- 10.20.193.7:0/2754006732 >> v1:10.20.193.7:6789/0 conn(0x7f022c17d950 legacy=0x7f022c19dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient: _finish_hunting 0 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 monclient: found mon.noname-a 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 -- 10.20.193.7:0/2754006732 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c08dbd0 con 0x7f022c13c950 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0230c9c640 1 --2- 10.20.193.7:0/2754006732 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0220004780 tx=0x7f022001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cba483da0d3083b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:03.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 1 -- 10.20.193.7:0/2754006732 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02200b0070 con 0x7f022c13c950 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: dump: 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.060 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: _finish_auth 0 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 1 -- 10.20.193.7:0/2754006732 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02200ab600 con 0x7f022c13c950 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 1 -- 10.20.193.7:0/2754006732 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02200ab9d0 con 0x7f022c13c950 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 5 monclient: authenticate success, global_id 5208 2026-02-22T20:55:03.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 4 set_mon_vals no callback set 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f021bfff640 10 monclient: dump: 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:03.062 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: shutdown 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- 10.20.193.7:0/2754006732 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 msgr2=0x7f022c17d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 --2- 10.20.193.7:0/2754006732 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0220004780 tx=0x7f022001c4d0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- 10.20.193.7:0/2754006732 shutdown_connections 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 --2- 10.20.193.7:0/2754006732 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- 10.20.193.7:0/2754006732 >> 10.20.193.7:0/2754006732 conn(0x7f022c08f860 msgr2=0x7f022c08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- 10.20.193.7:0/2754006732 shutdown_connections 2026-02-22T20:55:03.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- 10.20.193.7:0/2754006732 wait complete. 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: build_initial_monmap 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: monmap: 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 Processor -- start 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 1 -- start start 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.046+0000 7f0233728640 10 monclient: init 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): picked mon.noname-c con 0x7f022c13be70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): picked mon.noname-a con 0x7f022c13c950 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 0x7f022c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): picked mon.noname-b con 0x7f022c17d950 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:03.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f022c08e5f0 con 0x7f022c13c950 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f022c08e470 con 0x7f022c17d950 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f022c08e770 con 0x7f022c13be70 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient(hunting): authenticate will time out at 715.524150s 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:38970/0 (socket says 10.20.193.7:38970) 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 -- 10.20.193.7:0/625105309 learned_addr learned my addr 10.20.193.7:0/625105309 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): get_auth_request con 0x7f022c13be70 auth_method 0 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:03.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0231c9e640 1 -- 10.20.193.7:0/625105309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 msgr2=0x7f022c19ea60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): get_auth_request con 0x7f022c13c950 auth_method 0 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0231c9e640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 0x7f022c19ea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:03.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient(hunting): handle_auth_done global_id 64166 payload 824 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 -- 10.20.193.7:0/625105309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 msgr2=0x7f022c19ea60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 0x7f022c19ea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 -- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 msgr2=0x7f022c17d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient: _finish_hunting 0 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 monclient: found mon.noname-c 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 -- 10.20.193.7:0/625105309 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c19b510 con 0x7f022c13be70 2026-02-22T20:55:03.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f023149d640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b750 tx=0x7f021c00bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c005070 con 0x7f022c13be70 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: dump: 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.069 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c010070 con 0x7f022c13be70 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c005410 con 0x7f022c13be70 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:03.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: dump: 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:03.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 5 monclient: authenticate success, global_id 64166 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _renew_subs 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f021b7fe640 4 set_mon_vals no callback set 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c08a6f0 con 0x7f022c13be70 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _renew_subs 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c19b230 con 0x7f022c13be70 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c13c240 con 0x7f022c13be70 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f021c0055b0 con 0x7f022c13be70 2026-02-22T20:55:03.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 --2- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 0x7f01fc05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(91..91 src has 64..91) ==== 3897+0+0 (secure 0 0 0) 0x7f021c04e140 con 0x7f022c13be70 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 1 --2- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 0x7f01fc05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 10 monclient: get_auth_request con 0x7f01fc03aa90 auth_method 0 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0230c9c640 1 --2- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 0x7f01fc05af40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f022001a100 tx=0x7f0220008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f021c013370 con 0x7f022c13be70 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:03.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.050+0000 7f0219ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:03.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:03.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:03.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:03.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f022c05fc00 con 0x7f022c13be70 2026-02-22T20:55:03.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0219ffb640 1 -- 10.20.193.7:0/625105309 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f021c004ac0 con 0x7f022c13be70 2026-02-22T20:55:03.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0219ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:03.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0219ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:03.170 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:03.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 msgr2=0x7f01fc05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 0x7f01fc05af40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f022001a100 tx=0x7f0220008040 comp rx=0 tx=0).stop 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 10 monclient: shutdown 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 msgr2=0x7f022c196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b750 tx=0x7f021c00bc10 comp rx=0 tx=0).stop 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 shutdown_connections 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> v2:10.20.193.61:6800/2336688312 conn(0x7f01fc03aa90 0x7f01fc05af40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f022c17d950 0x7f022c19ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f022c13c950 0x7f022c17d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 --2- 10.20.193.7:0/625105309 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f022c13be70 0x7f022c196930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:03.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 >> 10.20.193.7:0/625105309 conn(0x7f022c08f860 msgr2=0x7f022c197380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:03.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 shutdown_connections 2026-02-22T20:55:03.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:03.166+0000 7f0233728640 1 -- 10.20.193.7:0/625105309 wait complete. 2026-02-22T20:55:06.180 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: get_monmap_and_config 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: build_initial_monmap 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: monmap: 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:06.242198+0000 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:06.242198+0000 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:06.242 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:06.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 Processor -- start 2026-02-22T20:55:06.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 -- start start 2026-02-22T20:55:06.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: init 2026-02-22T20:55:06.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:06.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37b813f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-a con 0x7f37b813fd70 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-b con 0x7f37b8180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b808fd70 con 0x7f37b813f290 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f37b808e1f0 con 0x7f37b813fd70 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f37b808ec90 con 0x7f37b8180d00 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37be07d640 10 monclient(hunting): authenticate will time out at 718.715103s 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b77fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f37b813f290 0x7f37b813f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:35362/0 (socket says 10.20.193.7:35362) 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 learned_addr learned my addr 10.20.193.7:0/3838645204 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 10 monclient(hunting): get_auth_request con 0x7f37b8180d00 auth_method 0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37b813fd70 auth_method 0 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:06.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.238+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 10 monclient(hunting): get_auth_request con 0x7f37b8180d00 auth_method 0 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:06.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37b813fd70 auth_method 0 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.442+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:55:06.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 10 monclient(hunting): get_auth_request con 0x7f37b8180d00 auth_method 0 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37b813fd70 auth_method 0 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:55:06.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:06.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:06.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:06.846+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:55:06.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:06.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:07.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 10 monclient(hunting): get_auth_request con 0x7f37b8180d00 auth_method 0 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b7fff640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:07.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37b813fd70 auth_method 0 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:07.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:07.650+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:55:09.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): tick 2026-02-22T20:55:09.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:55:09.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 monclient(hunting): continuing hunt 2026-02-22T20:55:09.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 msgr2=0x7f37b81a10e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37b8180d00 0x7f37b81a10e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 msgr2=0x7f37b81807c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37b813fd70 0x7f37b81807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.7:6789/0 conn(0x7f37b813f290 legacy=0x7f37b813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient: _add_conns ranks=[1,4] 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f37940037a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:09.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): picked mon.noname-c con 0x7f37940254c0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b8092bc0 con 0x7f37940037a0 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f37b808e1f0 con 0x7f37940254c0 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b57fa640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 msgr2=0x7f3794045970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.61:6789/0 conn(0x7f37940037a0 legacy=0x7f3794023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:09.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.241+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:09.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.445+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.61:6789/0 conn(0x7f37940037a0 legacy=0x7f3794023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:09.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.445+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 msgr2=0x7f3794045970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:09.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.445+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:55:09.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.849+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.61:6789/0 conn(0x7f37940037a0 legacy=0x7f3794023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:09.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.849+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 msgr2=0x7f3794045970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:09.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:09.849+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:55:10.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:10.653+0000 7f37b6ffd640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 msgr2=0x7f3794045970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:10.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:10.653+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:55:10.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:10.653+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.61:6789/0 conn(0x7f37940037a0 legacy=0x7f3794023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:11.093 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19709]: starting. 2026-02-22T20:55:11.094 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19709]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19707 2026-02-22T20:55:11.094 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19709]: shutting down. 2026-02-22T20:55:11.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:11.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): tick 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 monclient(hunting): continuing hunt 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 msgr2=0x7f3794045970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.61:3300/0 conn(0x7f37940254c0 0x7f3794045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.61:6789/0 conn(0x7f37940037a0 legacy=0x7f3794023c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b7fff640 1 -- 10.20.193.7:0/3838645204 reap_dead start 2026-02-22T20:55:12.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f3794045970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): picked mon.noname-b con 0x7f37940243c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 0x7f3794024d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): picked mon.noname-a con 0x7f37940248a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3794023b80 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3794047040 con 0x7f3794023b80 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f37b808e1f0 con 0x7f37940248a0 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 1 -- 10.20.193.7:0/3838645204 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f37b808ec90 con 0x7f37940243c0 2026-02-22T20:55:12.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b57fa640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f3794045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 0x7f3794024d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): get_auth_request con 0x7f37940243c0 auth_method 0 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37940248a0 auth_method 0 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient(hunting): handle_auth_done global_id 64184 payload 274 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 msgr2=0x7f3794024d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 0x7f3794024d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 >> v1:10.20.193.7:6789/0 conn(0x7f3794023b80 legacy=0x7f3794046000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 monclient: found mon.noname-b 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b77fe640 1 -- 10.20.193.7:0/3838645204 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b8092bc0 con 0x7f37940243c0 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.237+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 0x7f3794024d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b77fe640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f3794045970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37a4002970 tx=0x7f37a401c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc67cf9855407e27 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 1 -- 10.20.193.7:0/3838645204 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4005bd0 con 0x7f37940243c0 2026-02-22T20:55:12.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: dump: 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.256 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 1 -- 10.20.193.7:0/3838645204 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a40ad070 con 0x7f37940243c0 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 1 -- 10.20.193.7:0/3838645204 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4007070 con 0x7f37940243c0 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 5 monclient: authenticate success, global_id 64184 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 4 set_mon_vals no callback set 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b67fc640 10 monclient: dump: 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: shutdown 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 msgr2=0x7f3794045970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f3794045970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37a4002970 tx=0x7f37a401c5f0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- 10.20.193.7:0/3838645204 shutdown_connections 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- 10.20.193.7:0/3838645204 >> v2:10.20.193.7:3300/0 conn(0x7f37940248a0 0x7f3794024d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- 10.20.193.7:0/3838645204 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f3794045970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- 10.20.193.7:0/3838645204 >> 10.20.193.7:0/3838645204 conn(0x7f37b8093df0 msgr2=0x7f37b80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- 10.20.193.7:0/3838645204 shutdown_connections 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- 10.20.193.7:0/3838645204 wait complete. 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: build_initial_monmap 2026-02-22T20:55:12.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: monmap: 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 Processor -- start 2026-02-22T20:55:12.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- start start 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: init 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 0x7f37b8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-b con 0x7f3794023b80 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f37b813b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-c con 0x7f37940243c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): picked mon.noname-a con 0x7f37940248a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8090de0 con 0x7f37940248a0 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8090c60 con 0x7f3794023b80 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f37b813c780 con 0x7f37940243c0 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37be07d640 10 monclient(hunting): authenticate will time out at 724.719924s 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.241+0000 7f37b77fe640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 msgr2=0x7f37b8152a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b77fe640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 0x7f37b8152a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48300/0 (socket says 10.20.193.7:48300) 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 -- 10.20.193.7:0/1298767681 learned_addr learned my addr 10.20.193.7:0/1298767681 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): get_auth_request con 0x7f37940248a0 auth_method 0 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f37b813b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request con 0x7f37940243c0 auth_method 0 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient(hunting): handle_auth_done global_id 5238 payload 824 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 -- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 msgr2=0x7f37b813b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f37b813b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 -- 10.20.193.7:0/1298767681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 msgr2=0x7f37b8152a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 0x7f37b8152a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 monclient: found mon.noname-a 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 -- 10.20.193.7:0/1298767681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b808a9e0 con 0x7f37940248a0 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b7fff640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37ac004b00 tx=0x7f37ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac01b020 con 0x7f37940248a0 2026-02-22T20:55:12.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: dump: 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac004900 con 0x7f37940248a0 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac017690 con 0x7f37940248a0 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:12.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 10 monclient: dump: 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b5ffb640 4 set_mon_vals no callback set 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 5 monclient: authenticate success, global_id 5238 2026-02-22T20:55:12.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _renew_subs 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b813bb10 con 0x7f37940248a0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _renew_subs 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b813ee70 con 0x7f37940248a0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b813cb50 con 0x7f37940248a0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f37ac017830 con 0x7f37940248a0 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 --2- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 0x7f378805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(93..93 src has 64..93) ==== 3897+0+0 (secure 0 0 0) 0x7f37ac04f030 con 0x7f37940248a0 2026-02-22T20:55:12.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b77fe640 1 --2- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 0x7f378805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b77fe640 10 monclient: get_auth_request con 0x7f378803aa90 auth_method 0 2026-02-22T20:55:12.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.245+0000 7f37b77fe640 1 --2- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 0x7f378805af40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37a401c630 tx=0x7f37a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.249+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f37ac025020 con 0x7f37940248a0 2026-02-22T20:55:12.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.249+0000 7f3793fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.249+0000 7f3793fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:12.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:12.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f37b805fb50 con 0x7f37940248a0 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f3793fff640 1 -- 10.20.193.7:0/1298767681 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f37b808a9e0 con 0x7f37940248a0 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f3793fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f3793fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:12.365 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":30,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 msgr2=0x7f378805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 0x7f378805af40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37a401c630 tx=0x7f37a4009040 comp rx=0 tx=0).stop 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 10 monclient: shutdown 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 msgr2=0x7f37b813b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37ac004b00 tx=0x7f37ac0042f0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 shutdown_connections 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f37940248a0 0x7f37b813b5d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f37940243c0 0x7f37b813b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f378803aa90 0x7f378805af40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.367 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 --2- 10.20.193.7:0/1298767681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3794023b80 0x7f37b8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 >> 10.20.193.7:0/1298767681 conn(0x7f37b8093df0 msgr2=0x7f37b8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 shutdown_connections 2026-02-22T20:55:12.368 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.361+0000 7f37be07d640 1 -- 10.20.193.7:0/1298767681 wait complete. 2026-02-22T20:55:12.375 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:55:12.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:55:12.376 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:55:12.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: get_monmap_and_config 2026-02-22T20:55:12.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: build_initial_monmap 2026-02-22T20:55:12.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: monmap: 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:12.445712+0000 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:12.445712+0000 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:12.446 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 Processor -- start 2026-02-22T20:55:12.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 -- start start 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: init 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 0x7fba44092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-b con 0x7fba44091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-a con 0x7fba4413f1b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 0x7fba441a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-c con 0x7fba4413fae0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fba4408e6a0 con 0x7fba4413f1b0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fba4408e910 con 0x7fba4413fae0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fba4408ebf0 con 0x7fba44091c70 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4c0bb640 10 monclient(hunting): authenticate will time out at 724.918811s 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4a631640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 msgr2=0x7fba441a0500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 0x7fba44092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4a631640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 0x7fba441a0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48304/0 (socket says 10.20.193.7:48304) 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 1 -- 10.20.193.7:0/3165174224 learned_addr learned my addr 10.20.193.7:0/3165174224 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): get_auth_request con 0x7fba4413f1b0 auth_method 0 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): get_auth_request con 0x7fba44091c70 auth_method 0 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient(hunting): handle_auth_done global_id 64190 payload 274 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 -- 10.20.193.7:0/3165174224 >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 msgr2=0x7fba441a0500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 --2- 10.20.193.7:0/3165174224 >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 0x7fba441a0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 -- 10.20.193.7:0/3165174224 >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 msgr2=0x7fba4413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 --2- 10.20.193.7:0/3165174224 >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 monclient: found mon.noname-b 2026-02-22T20:55:12.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba49e30640 1 -- 10.20.193.7:0/3165174224 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4408eed0 con 0x7fba44091c70 2026-02-22T20:55:12.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.441+0000 7fba4962f640 1 --2- 10.20.193.7:0/3165174224 >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:12.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- 10.20.193.7:0/3165174224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 0x7fba44092040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba4408eb20 tx=0x7fba3401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3d1bdc5aef5396 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 1 -- 10.20.193.7:0/3165174224 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340b0070 con 0x7fba44091c70 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: dump: 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.453 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 1 -- 10.20.193.7:0/3165174224 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba340ab600 con 0x7fba44091c70 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 1 -- 10.20.193.7:0/3165174224 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340ab9d0 con 0x7fba44091c70 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba48e2e640 10 monclient: dump: 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.454 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 5 monclient: authenticate success, global_id 64190 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 4 set_mon_vals no callback set 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: shutdown 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/3165174224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 msgr2=0x7fba44092040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/3165174224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 0x7fba44092040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba4408eb20 tx=0x7fba3401c420 comp rx=0 tx=0).stop 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/3165174224 shutdown_connections 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/3165174224 >> v2:10.20.193.61:3300/0 conn(0x7fba4413fae0 0x7fba441a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/3165174224 >> v2:10.20.193.7:3300/0 conn(0x7fba4413f1b0 0x7fba4413f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/3165174224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba44091c70 0x7fba44092040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/3165174224 >> 10.20.193.7:0/3165174224 conn(0x7fba44093d80 msgr2=0x7fba44090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/3165174224 shutdown_connections 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/3165174224 wait complete. 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: build_initial_monmap 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: monmap: 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:12.455 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 Processor -- start 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- start start 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: init 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 0x7fba44125800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-a con 0x7fba44091c70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba4413f1b0 0x7fba44127940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-b con 0x7fba4413f1b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba4413fae0 0x7fba441a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): picked mon.noname-c con 0x7fba4413fae0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba44091700 con 0x7fba44091c70 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fba44091580 con 0x7fba4413f1b0 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fba441a3670 con 0x7fba4413fae0 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): authenticate will time out at 724.921880s 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 0x7fba44125800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba4413fae0 0x7fba441a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba4413f1b0 msgr2=0x7fba44127940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:12.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba4413f1b0 0x7fba44127940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 0x7fba44125800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48316/0 (socket says 10.20.193.7:48316) 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 -- 10.20.193.7:0/1977862744 learned_addr learned my addr 10.20.193.7:0/1977862744 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): get_auth_request con 0x7fba4413fae0 auth_method 0 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): get_auth_request con 0x7fba44091c70 auth_method 0 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient(hunting): handle_auth_done global_id 5244 payload 824 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba4413fae0 msgr2=0x7fba441a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fba4413fae0 0x7fba441a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba4413f1b0 msgr2=0x7fba44127940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fba4413f1b0 0x7fba44127940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 monclient: found mon.noname-a 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4408a970 con 0x7fba44091c70 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba49e30640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 0x7fba44125800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba3401c990 tx=0x7fba340191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340b9070 con 0x7fba44091c70 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: dump: 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba340ab9b0 con 0x7fba44091c70 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340b0040 con 0x7fba44091c70 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 5 monclient: authenticate success, global_id 5244 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _renew_subs 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba33fff640 4 set_mon_vals no callback set 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44126de0 con 0x7fba44091c70 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: dump: 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _renew_subs 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba44128b80 con 0x7fba44091c70 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 0x7fba44123a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba44092040 con 0x7fba441236c0 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fba340b3070 con 0x7fba44091c70 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 0x7fba44123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient: get_auth_request con 0x7fba441236c0 auth_method 0 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 --2- 10.20.193.7:0/1977862744 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba1403aa90 0x7fba1405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 10 monclient(hunting): handle_auth_done global_id 5247 payload 824 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(93..93 src has 64..93) ==== 3897+0+0 (secure 0 0 0) 0x7fba340e7a20 con 0x7fba44091c70 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba44092870 con 0x7fba441236c0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4962f640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 0x7fba44123a90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba3800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 1 --2- 10.20.193.7:0/1977862744 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba1403aa90 0x7fba1405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 10 monclient: get_auth_request con 0x7fba1403aa90 auth_method 0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38017070 con 0x7fba441236c0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: dump: 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fba3800c980 con 0x7fba441236c0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 msgr2=0x7fba44123a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 0x7fba44123a90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba3800ec70 comp rx=0 tx=0).stop 2026-02-22T20:55:12.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 msgr2=0x7fba44123a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:12.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba327fc640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba441236c0 0x7fba44123a90 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba3800ec70 comp rx=0 tx=0).stop 2026-02-22T20:55:12.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.445+0000 7fba4a631640 1 --2- 10.20.193.7:0/1977862744 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba1403aa90 0x7fba1405af40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba44129070 tx=0x7fba400095e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 0x7fba44114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba441a0730 con 0x7fba44114070 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 0x7fba44114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient: get_auth_request con 0x7fba44114070 auth_method 0 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 10 monclient(hunting): handle_auth_done global_id 5250 payload 824 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 1 -- 10.20.193.7:0/1977862744 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba441149b0 con 0x7fba44114070 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4962f640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 0x7fba44114470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba38004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38017070 con 0x7fba44114070 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 10 monclient: dump: 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.462 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7fba38006660 con 0x7fba44114070 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 msgr2=0x7fba44114470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 0x7fba44114470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba38004820 comp rx=0 tx=0).stop 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 msgr2=0x7fba44114470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba327fc640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44114070 0x7fba44114470 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba441287d0 tx=0x7fba38004820 comp rx=0 tx=0).stop 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 30, 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 191579, 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.463 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:12.464 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:12.465 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:12.466 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:12.467 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.468 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba1403aa90 msgr2=0x7fba1405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/1977862744 >> v2:10.20.193.61:6800/2336688312 conn(0x7fba1403aa90 0x7fba1405af40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba44129070 tx=0x7fba400095e0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 10 monclient: shutdown 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 msgr2=0x7fba44125800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.469 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 --2- 10.20.193.7:0/1977862744 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fba44091c70 0x7fba44125800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba3401c990 tx=0x7fba340191c0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4a631640 1 -- 10.20.193.7:0/1977862744 reap_dead start 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4a631640 1 -- 10.20.193.7:0/1977862744 reap_dead start 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 shutdown_connections 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 >> 10.20.193.7:0/1977862744 conn(0x7fba44093d80 msgr2=0x7fba44056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 shutdown_connections 2026-02-22T20:55:12.470 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.449+0000 7fba4c0bb640 1 -- 10.20.193.7:0/1977862744 wait complete. 2026-02-22T20:55:12.470 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:55:12.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:55:12.470 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: get_monmap_and_config 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: build_initial_monmap 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: monmap: 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:12.538560+0000 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:12.538560+0000 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.538 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:12.539 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:12.539 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:12.539 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:12.539 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:12.539 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 Processor -- start 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 -- start start 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: init 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 0x7f35f413f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-b con 0x7f35f413f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f35f413fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f35f413c680 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f408fd70 con 0x7f35f413fba0 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f4092bc0 con 0x7f35f413c680 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35f408e1f0 con 0x7f35f413f290 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f8cbc640 10 monclient(hunting): authenticate will time out at 725.011448s 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2d76640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f35f413c680 legacy=0x7f35f41a17e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f1d74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f35f413fba0 0x7f35f413bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59658/0 (socket says 10.20.193.7:59658) 2026-02-22T20:55:12.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f1d74640 1 -- 10.20.193.7:0/2715232640 learned_addr learned my addr 10.20.193.7:0/2715232640 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 0x7f35f413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): get_auth_request con 0x7f35f413f290 auth_method 0 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient(hunting): handle_auth_done global_id 64196 payload 274 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f1573640 1 -- 10.20.193.7:0/2715232640 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747510986 0 0) 0x7f35dc002920 con 0x7f35f413fba0 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 1 -- 10.20.193.7:0/2715232640 >> v1:10.20.193.61:6789/0 conn(0x7f35f413c680 legacy=0x7f35f41a17e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 1 -- 10.20.193.7:0/2715232640 >> v1:10.20.193.7:6789/0 conn(0x7f35f413fba0 legacy=0x7f35f413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 1 monclient: found mon.noname-b 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f2575640 1 -- 10.20.193.7:0/2715232640 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f408e6d0 con 0x7f35f413f290 2026-02-22T20:55:12.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.533+0000 7f35f1573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:55:12.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2575640 1 --2- 10.20.193.7:0/2715232640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 0x7f35f413f660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009840 tx=0x7f35e801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea03cd289718c962 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 1 -- 10.20.193.7:0/2715232640 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80aa600 con 0x7f35f413f290 2026-02-22T20:55:12.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: dump: 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 1 -- 10.20.193.7:0/2715232640 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e80af070 con 0x7f35f413f290 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 1 -- 10.20.193.7:0/2715232640 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80aa9c0 con 0x7f35f413f290 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1573640 10 monclient: dump: 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.551 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 5 monclient: authenticate success, global_id 64196 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 4 set_mon_vals no callback set 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: shutdown 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/2715232640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 msgr2=0x7f35f413f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/2715232640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 0x7f35f413f660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009840 tx=0x7f35e801c4c0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/2715232640 shutdown_connections 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/2715232640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413f290 0x7f35f413f660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/2715232640 >> 10.20.193.7:0/2715232640 conn(0x7f35f4093df0 msgr2=0x7f35f40902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/2715232640 shutdown_connections 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/2715232640 wait complete. 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: build_initial_monmap 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: monmap: 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:12.553 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 Processor -- start 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- start start 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: init 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35f413c680 0x7f35f4150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-b con 0x7f35f413c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f35f413f290 0x7f35f4151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-a con 0x7f35f413f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413fba0 0x7f35f412a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): picked mon.noname-c con 0x7f35f413fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35f413ed30 con 0x7f35f413f290 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41a58a0 con 0x7f35f413c680 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35f41a5720 con 0x7f35f413fba0 2026-02-22T20:55:12.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient(hunting): authenticate will time out at 725.015093s 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2575640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35f413c680 msgr2=0x7f35f4150b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2575640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35f413c680 0x7f35f4150b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f35f413f290 0x7f35f4151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413fba0 0x7f35f412a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f35f413f290 0x7f35f4151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48338/0 (socket says 10.20.193.7:48338) 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 1 -- 10.20.193.7:0/4178679530 learned_addr learned my addr 10.20.193.7:0/4178679530 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): get_auth_request con 0x7f35f413fba0 auth_method 0 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): get_auth_request con 0x7f35f413f290 auth_method 0 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient(hunting): handle_auth_done global_id 64199 payload 824 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35f413c680 msgr2=0x7f35f4150b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f35f413c680 0x7f35f4150b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f35f413f290 msgr2=0x7f35f4151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f35f413f290 0x7f35f4151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient: _finish_hunting 0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 monclient: found mon.noname-c 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f412dad0 con 0x7f35f413fba0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f2d76640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413fba0 0x7f35f412a250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35e400bd50 tx=0x7f35e4009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4015670 con 0x7f35f413fba0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:12.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: dump: 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: _finish_auth 0 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: _check_auth_tickets 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e4010070 con 0x7f35f413fba0 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4015a30 con 0x7f35f413fba0 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 5 monclient: authenticate success, global_id 64199 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _renew_subs 2026-02-22T20:55:12.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f412ddb0 con 0x7f35f413fba0 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f0d72640 4 set_mon_vals no callback set 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35daffd640 10 monclient: dump: 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.558 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _renew_subs 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.537+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f412d510 con 0x7f35f413fba0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f8cbc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 0x7f35f412ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35f41a5a20 con 0x7f35f412a790 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 0x7f35f412ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient: get_auth_request con 0x7f35f412a790 auth_method 0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f35e400a040 con 0x7f35f413fba0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 10 monclient(hunting): handle_auth_done global_id 64202 payload 824 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35f413f660 con 0x7f35f412a790 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 --2- 10.20.193.7:0/4178679530 >> v2:10.20.193.61:6800/2336688312 conn(0x7f35c003aa90 0x7f35c005af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(93..93 src has 64..93) ==== 3897+0+0 (secure 0 0 0) 0x7f35e404e960 con 0x7f35f413fba0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f2575640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 0x7f35f412ab60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e801ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f1d74640 1 --2- 10.20.193.7:0/4178679530 >> v2:10.20.193.61:6800/2336688312 conn(0x7f35c003aa90 0x7f35c005af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f1d74640 10 monclient: get_auth_request con 0x7f35c003aa90 auth_method 0 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b7070 con 0x7f35f412a790 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 10 monclient: dump: 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f35e80af070 con 0x7f35f412a790 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 msgr2=0x7f35f412ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 0x7f35f412ab60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e801ad00 comp rx=0 tx=0).stop 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 msgr2=0x7f35f412ab60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35daffd640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412a790 0x7f35f412ab60 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e801ad00 comp rx=0 tx=0).stop 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.541+0000 7f35f1d74640 1 --2- 10.20.193.7:0/4178679530 >> v2:10.20.193.61:6800/2336688312 conn(0x7f35c003aa90 0x7f35c005af40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f35f412c540 tx=0x7f35dc007cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 0x7f35f4088650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:12.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35f412d1e0 con 0x7f35f412b0a0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 0x7f35f4088650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient: get_auth_request con 0x7f35f412b0a0 auth_method 0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 10 monclient(hunting): handle_auth_done global_id 64205 payload 824 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 1 -- 10.20.193.7:0/4178679530 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f35f412c5b0 con 0x7f35f412b0a0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2575640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 0x7f35f4088650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e8009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80bce60 con 0x7f35f412b0a0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 10 monclient: dump: 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:12.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4869 (secure 0 0 0) 0x7f35e80c13a0 con 0x7f35f412b0a0 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 msgr2=0x7f35f4088650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 0x7f35f4088650 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e8009290 comp rx=0 tx=0).stop 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 msgr2=0x7f35f4088650 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35daffd640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f412b0a0 0x7f35f4088650 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35e8002410 tx=0x7f35e8009290 comp rx=0 tx=0).stop 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 30, 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 38150, 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:12.562 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.563 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:12.564 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:12.565 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.566 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:12.567 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.568 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:12.569 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:12.570 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:12.570 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:12.570 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 >> v2:10.20.193.61:6800/2336688312 conn(0x7f35c003aa90 msgr2=0x7f35c005af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.570 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/4178679530 >> v2:10.20.193.61:6800/2336688312 conn(0x7f35c003aa90 0x7f35c005af40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f35f412c540 tx=0x7f35dc007cf0 comp rx=0 tx=0).stop 2026-02-22T20:55:12.570 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 10 monclient: shutdown 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413fba0 msgr2=0x7f35f412a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 --2- 10.20.193.7:0/4178679530 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f35f413fba0 0x7f35f412a250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35e400bd50 tx=0x7f35e4009e40 comp rx=0 tx=0).stop 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2d76640 1 -- 10.20.193.7:0/4178679530 reap_dead start 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f2d76640 1 -- 10.20.193.7:0/4178679530 reap_dead start 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 shutdown_connections 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 >> 10.20.193.7:0/4178679530 conn(0x7f35f4093df0 msgr2=0x7f35f4055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 shutdown_connections 2026-02-22T20:55:12.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:12.545+0000 7f35f8cbc640 1 -- 10.20.193.7:0/4178679530 wait complete. 2026-02-22T20:55:12.571 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:55:12.571 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:55:13.152 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:13.152 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: starting. 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19707 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: created object 0... 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: created object 25... 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: created object 49... 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: finishing. 2026-02-22T20:55:13.153 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19745]: shutting down. 2026-02-22T20:55:13.163 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:13.163 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: starting. 2026-02-22T20:55:13.163 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: listing objects. 2026-02-22T20:55:13.163 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: listed object 0... 2026-02-22T20:55:13.163 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: listed object 25... 2026-02-22T20:55:13.164 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: saw 50 objects 2026-02-22T20:55:13.164 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19747]: shutting down. 2026-02-22T20:55:14.108 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:14.109 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19746]: starting. 2026-02-22T20:55:14.109 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19746]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19707 2026-02-22T20:55:14.109 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19746]: shutting down. 2026-02-22T20:55:14.111 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:14.111 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:14.111 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:14.113 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: starting. 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19797 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: created object 0... 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: created object 25... 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: created object 49... 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: finishing. 2026-02-22T20:55:16.165 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19798]: shutting down. 2026-02-22T20:55:16.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:16.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:17.115 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19799]: starting. 2026-02-22T20:55:17.115 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19799]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19797 2026-02-22T20:55:17.115 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19799]: shutting down. 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: starting. 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19797 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: created object 0... 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: created object 25... 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: created object 49... 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: finishing. 2026-02-22T20:55:19.174 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19832]: shutting down. 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: starting. 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: listing objects. 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: listed object 0... 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: listed object 25... 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: saw 50 objects 2026-02-22T20:55:19.185 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19834]: shutting down. 2026-02-22T20:55:20.124 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:20.124 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19833]: starting. 2026-02-22T20:55:20.124 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19833]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19797 2026-02-22T20:55:20.124 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19833]: shutting down. 2026-02-22T20:55:20.126 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:20.126 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:20.126 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:20.128 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:55:21.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:21.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: starting. 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19884 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: created object 0... 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: created object 25... 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: created object 49... 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: finishing. 2026-02-22T20:55:22.184 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19885]: shutting down. 2026-02-22T20:55:23.134 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19886]: starting. 2026-02-22T20:55:23.135 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19886]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19884 2026-02-22T20:55:23.135 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19886]: shutting down. 2026-02-22T20:55:25.190 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:25.190 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: starting. 2026-02-22T20:55:25.190 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19884 2026-02-22T20:55:25.190 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: created object 0... 2026-02-22T20:55:25.190 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: created object 25... 2026-02-22T20:55:25.191 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: created object 49... 2026-02-22T20:55:25.191 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: finishing. 2026-02-22T20:55:25.191 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[19919]: shutting down. 2026-02-22T20:55:25.201 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:25.201 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: starting. 2026-02-22T20:55:25.201 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: listing objects. 2026-02-22T20:55:25.202 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: listed object 0... 2026-02-22T20:55:25.202 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: listed object 25... 2026-02-22T20:55:25.202 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: saw 50 objects 2026-02-22T20:55:25.202 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[19921]: shutting down. 2026-02-22T20:55:25.900 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:25.900 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19920]: starting. 2026-02-22T20:55:25.900 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19920]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19884 2026-02-22T20:55:25.900 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[19920]: shutting down. 2026-02-22T20:55:25.902 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:25.902 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:25.902 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:25.904 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:55:26.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:26.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: starting. 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19971 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: created object 0... 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: created object 25... 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: created object 49... 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: finishing. 2026-02-22T20:55:27.956 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[19972]: shutting down. 2026-02-22T20:55:28.911 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19973]: starting. 2026-02-22T20:55:28.911 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19973]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19971 2026-02-22T20:55:28.911 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[19973]: shutting down. 2026-02-22T20:55:30.950 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:30.950 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: starting. 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: creating pool ceph_test_rados_delete_pools_parallel.trial061-19971 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: created object 0... 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: created object 25... 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: created object 49... 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: finishing. 2026-02-22T20:55:30.951 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20006]: shutting down. 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: starting. 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: listing objects. 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: listed object 0... 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: listed object 25... 2026-02-22T20:55:30.962 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: saw 50 objects 2026-02-22T20:55:30.963 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20008]: shutting down. 2026-02-22T20:55:31.902 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:31.903 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20007]: starting. 2026-02-22T20:55:31.903 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20007]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-19971 2026-02-22T20:55:31.903 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20007]: shutting down. 2026-02-22T20:55:31.905 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:31.905 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:31.905 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:31.907 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:55:31.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:31.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:31.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:55:31.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:55:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:31.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:32.571 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-22T20:55:32.572 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T20:55:32.572 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T20:55:32.574 INFO:tasks.ceph.mon.b:Started 2026-02-22T20:55:32.574 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:55:32.575 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: get_monmap_and_config 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: build_initial_monmap 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: monmap: 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:32.642199+0000 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:32.642199+0000 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:32.642 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 Processor -- start 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 -- start start 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: init 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 0x7f623013d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): picked mon.noname-b con 0x7f623013cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f623013d800 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f623013a2e0 0x7f623019f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): picked mon.noname-c con 0x7f623013a2e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623005d510 con 0x7f623013d800 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f623008b800 con 0x7f623013a2e0 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f623008a720 con 0x7f623013cef0 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:32.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f6235def640 10 monclient(hunting): authenticate will time out at 745.115086s 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 0x7f623013d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622effd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f623013d800 0x7f6230139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48756/0 (socket says 10.20.193.7:48756) 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622effd640 1 -- 10.20.193.7:0/4254884315 learned_addr learned my addr 10.20.193.7:0/4254884315 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): get_auth_request con 0x7f623013cef0 auth_method 0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622ffff640 1 --2- 10.20.193.7:0/4254884315 >> v2:10.20.193.61:3300/0 conn(0x7f623013a2e0 0x7f623019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622ffff640 10 monclient(hunting): get_auth_request con 0x7f623013a2e0 auth_method 0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient(hunting): handle_auth_done global_id 64286 payload 274 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 -- 10.20.193.7:0/4254884315 >> v2:10.20.193.61:3300/0 conn(0x7f623013a2e0 msgr2=0x7f623019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 --2- 10.20.193.7:0/4254884315 >> v2:10.20.193.61:3300/0 conn(0x7f623013a2e0 0x7f623019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 -- 10.20.193.7:0/4254884315 >> v1:10.20.193.7:6789/0 conn(0x7f623013d800 legacy=0x7f6230139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 monclient: found mon.noname-b 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622e7fc640 1 -- 10.20.193.7:0/4254884315 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468577905 0 0) 0x7f623005d510 con 0x7f623013d800 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622f7fe640 1 -- 10.20.193.7:0/4254884315 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623008aa00 con 0x7f623013cef0 2026-02-22T20:55:32.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.637+0000 7f622e7fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- 10.20.193.7:0/4254884315 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 0x7f623013d2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f621c004780 tx=0x7f621c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56225d787bc50d48 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 1 -- 10.20.193.7:0/4254884315 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0b0070 con 0x7f623013cef0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: dump: 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 1 -- 10.20.193.7:0/4254884315 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0ab600 con 0x7f623013cef0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 1 -- 10.20.193.7:0/4254884315 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0ab9b0 con 0x7f623013cef0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622e7fc640 10 monclient: dump: 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:32.645 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 5 monclient: authenticate success, global_id 64286 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 4 set_mon_vals no callback set 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: shutdown 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/4254884315 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 msgr2=0x7f623013d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- 10.20.193.7:0/4254884315 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 0x7f623013d2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f621c004780 tx=0x7f621c01c440 comp rx=0 tx=0).stop 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/4254884315 shutdown_connections 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- 10.20.193.7:0/4254884315 >> v2:10.20.193.61:3300/0 conn(0x7f623013a2e0 0x7f623019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- 10.20.193.7:0/4254884315 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013cef0 0x7f623013d2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/4254884315 >> 10.20.193.7:0/4254884315 conn(0x7f623008f860 msgr2=0x7f623008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/4254884315 shutdown_connections 2026-02-22T20:55:32.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/4254884315 wait complete. 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: build_initial_monmap 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: monmap: 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 Processor -- start 2026-02-22T20:55:32.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- start start 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: init 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): picked mon.noname-c con 0x7f623013a2e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 0x7f6230127d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): picked mon.noname-b con 0x7f623013cef0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f623013d800 0x7f6230128290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): picked mon.noname-a con 0x7f623013d800 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62301a2360 con 0x7f623013d800 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f62301a21e0 con 0x7f623013cef0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f62301a24e0 con 0x7f623013a2e0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient(hunting): authenticate will time out at 745.118523s 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34868/0 (socket says 10.20.193.7:34868) 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 -- 10.20.193.7:0/1392606855 learned_addr learned my addr 10.20.193.7:0/1392606855 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): get_auth_request con 0x7f623013a2e0 auth_method 0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f623013d800 0x7f6230128290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): get_auth_request con 0x7f623013d800 auth_method 0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622effd640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 0x7f6230127d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient(hunting): handle_auth_done global_id 64289 payload 824 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 -- 10.20.193.7:0/1392606855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 msgr2=0x7f6230127d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 0x7f6230127d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 -- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f623013d800 msgr2=0x7f6230128290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f623013d800 0x7f6230128290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 monclient: found mon.noname-c 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 -- 10.20.193.7:0/1392606855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623012b630 con 0x7f623013a2e0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622effd640 10 monclient: get_auth_request con 0x7f623013cef0 auth_method 0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622effd640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 0x7f6230127d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622f7fe640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f621c01c9b0 tx=0x7f621c0191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0b0040 con 0x7f623013a2e0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: dump: 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: _finish_auth 0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0b9070 con 0x7f623013a2e0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0abbb0 con 0x7f623013a2e0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 5 monclient: authenticate success, global_id 64289 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _renew_subs 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623013c780 con 0x7f623013a2e0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f622dffb640 4 set_mon_vals no callback set 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 10 monclient: dump: 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.649 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _renew_subs 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f623012a7c0 con 0x7f623013a2e0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62300382a0 con 0x7f623013a2e0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f621c003710 con 0x7f623013a2e0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 --2- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 0x7f620005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.641+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(113..113 src has 64..113) ==== 3503+0+0 (secure 0 0 0) 0x7f621c0e8390 con 0x7f623013a2e0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f622effd640 1 --2- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 0x7f620005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f622effd640 10 monclient: get_auth_request con 0x7f620003ab20 auth_method 0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f622effd640 1 --2- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 0x7f620005afd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6230129dc0 tx=0x7f6220009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f621c016150 con 0x7f623013a2e0 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f620bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:32.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.645+0000 7f620bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:32.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f623005fc00 con 0x7f623013a2e0 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f620bfff640 1 -- 10.20.193.7:0/1392606855 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f621c0a5e20 con 0x7f623013a2e0 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f620bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:32.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f620bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:32.764 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":30,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:32.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 msgr2=0x7f620005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 0x7f620005afd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6230129dc0 tx=0x7f6220009040 comp rx=0 tx=0).stop 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 10 monclient: shutdown 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 msgr2=0x7f6230127810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f621c01c9b0 tx=0x7f621c0191e0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 shutdown_connections 2026-02-22T20:55:32.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f623013d800 0x7f6230128290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f620003ab20 0x7f620005afd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f623013cef0 0x7f6230127d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 --2- 10.20.193.7:0/1392606855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f623013a2e0 0x7f6230127810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 >> 10.20.193.7:0/1392606855 conn(0x7f623008f860 msgr2=0x7f623013b610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 shutdown_connections 2026-02-22T20:55:32.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:32.757+0000 7f6235def640 1 -- 10.20.193.7:0/1392606855 wait complete. 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: starting. 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20058 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: created object 0... 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: created object 25... 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: created object 49... 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: finishing. 2026-02-22T20:55:33.957 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20059]: shutting down. 2026-02-22T20:55:34.914 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20060]: starting. 2026-02-22T20:55:34.914 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20060]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20058 2026-02-22T20:55:34.914 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20060]: shutting down. 2026-02-22T20:55:35.774 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: get_monmap_and_config 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: build_initial_monmap 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: monmap: 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:35.842659+0000 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:35.842659+0000 2026-02-22T20:55:35.850 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 Processor -- start 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 -- start start 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: init 2026-02-22T20:55:35.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f640813f290 0x7f640813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): picked mon.noname-a con 0x7f640813f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f640813fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f640813c680 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640808fd70 con 0x7f640813fba0 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6408092bc0 con 0x7f640813c680 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f640808e1f0 con 0x7f640813f290 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f640d819640 10 monclient(hunting): authenticate will time out at 748.315611s 2026-02-22T20:55:35.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f640813f290 0x7f640813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f64067fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f640813fba0 0x7f640813bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48762/0 (socket says 10.20.193.7:48762) 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f640813f290 0x7f640813f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40100/0 (socket says 10.20.193.7:40100) 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f64067fc640 1 -- 10.20.193.7:0/3954078190 learned_addr learned my addr 10.20.193.7:0/3954078190 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): get_auth_request con 0x7f640813f290 auth_method 0 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient(hunting): handle_auth_done global_id 5397 payload 274 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 1 -- 10.20.193.7:0/3954078190 >> v1:10.20.193.61:6789/0 conn(0x7f640813c680 legacy=0x7f64081a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:35.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 1 -- 10.20.193.7:0/3954078190 >> v1:10.20.193.7:6789/0 conn(0x7f640813fba0 legacy=0x7f640813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6406ffd640 1 monclient: found mon.noname-a 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.837+0000 7f6405ffb640 1 -- 10.20.193.7:0/3954078190 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989285961 0 0) 0x7f63f0002920 con 0x7f640813fba0 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 -- 10.20.193.7:0/3954078190 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640808e6d0 con 0x7f640813f290 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- 10.20.193.7:0/3954078190 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813f290 0x7f640813f660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63fc004780 tx=0x7f63fc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb33f2a1b241463 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 1 -- 10.20.193.7:0/3954078190 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0b0070 con 0x7f640813f290 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:35.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: dump: 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:35.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 1 -- 10.20.193.7:0/3954078190 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63fc0ab600 con 0x7f640813f290 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 1 -- 10.20.193.7:0/3954078190 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0ab9d0 con 0x7f640813f290 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6405ffb640 10 monclient: dump: 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:35.856 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 5 monclient: authenticate success, global_id 5397 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 4 set_mon_vals no callback set 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: shutdown 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/3954078190 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813f290 msgr2=0x7f640813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 --2- 10.20.193.7:0/3954078190 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813f290 0x7f640813f660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63fc004780 tx=0x7f63fc01c440 comp rx=0 tx=0).stop 2026-02-22T20:55:35.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/3954078190 shutdown_connections 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 --2- 10.20.193.7:0/3954078190 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813f290 0x7f640813f660 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/3954078190 >> 10.20.193.7:0/3954078190 conn(0x7f6408093df0 msgr2=0x7f64080902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/3954078190 shutdown_connections 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/3954078190 wait complete. 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: build_initial_monmap 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: monmap: 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:35.858 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 Processor -- start 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- start start 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: init 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): picked mon.noname-a con 0x7f640813c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:35.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f640813f290 0x7f6408151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): picked mon.noname-c con 0x7f640813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f640813fba0 0x7f6408129e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): picked mon.noname-b con 0x7f640813fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a58a0 con 0x7f640813c680 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f64081a5720 con 0x7f640813fba0 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f64081a5a20 con 0x7f640813f290 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient(hunting): authenticate will time out at 748.319267s 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:35.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f640813f290 0x7f6408151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40108/0 (socket says 10.20.193.7:40108) 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 -- 10.20.193.7:0/966510573 learned_addr learned my addr 10.20.193.7:0/966510573 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): get_auth_request con 0x7f640813c680 auth_method 0 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): get_auth_request con 0x7f640813f290 auth_method 0 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:35.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient(hunting): handle_auth_done global_id 5403 payload 824 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 -- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f640813f290 msgr2=0x7f6408151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f640813f290 0x7f6408151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 -- 10.20.193.7:0/966510573 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f640813fba0 msgr2=0x7f6408129e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f640813fba0 0x7f6408129e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 monclient: found mon.noname-a 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:35.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 -- 10.20.193.7:0/966510573 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640812dca0 con 0x7f640813c680 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f6406ffd640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63fc01c480 tx=0x7f63fc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0b0040 con 0x7f640813c680 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: dump: 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:35.863 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: _finish_auth 0 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63fc0b9070 con 0x7f640813c680 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0abbb0 con 0x7f640813c680 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:35.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f63dffff640 10 monclient: dump: 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f64057fa640 4 set_mon_vals no callback set 2026-02-22T20:55:35.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 5 monclient: authenticate success, global_id 5403 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _renew_subs 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640808a9e0 con 0x7f640813c680 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _renew_subs 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.841+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640812b940 con 0x7f640813c680 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f640d819640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f640d819640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f640d819640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640813f660 con 0x7f640813c680 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f63fc003710 con 0x7f640813c680 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f63dffff640 1 --2- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 0x7f63d805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:35.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(116..116 src has 64..116) ==== 3503+0+0 (secure 0 0 0) 0x7f63fc0e8610 con 0x7f640813c680 2026-02-22T20:55:35.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f64067fc640 1 --2- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 0x7f63d805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:35.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f64067fc640 10 monclient: get_auth_request con 0x7f63d803ab20 auth_method 0 2026-02-22T20:55:35.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.845+0000 7f64067fc640 1 --2- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 0x7f63d805afd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63f0002770 tx=0x7f63f0007c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:35.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.849+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f63fc016150 con 0x7f640813c680 2026-02-22T20:55:35.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.849+0000 7f63dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:35.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.849+0000 7f63dffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:35.964 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f640d819640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:35.964 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f640d819640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:35.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f640d819640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:35.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f640812d500 con 0x7f640813c680 2026-02-22T20:55:35.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f63dffff640 1 -- 10.20.193.7:0/966510573 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f63fc0a5e20 con 0x7f640813c680 2026-02-22T20:55:35.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f63dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:35.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.957+0000 7f63dffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:35.966 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:35.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 msgr2=0x7f63d805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 0x7f63d805afd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63f0002770 tx=0x7f63f0007c40 comp rx=0 tx=0).stop 2026-02-22T20:55:35.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 10 monclient: shutdown 2026-02-22T20:55:35.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:35.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 msgr2=0x7f6408150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:35.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63fc01c480 tx=0x7f63fc0191e0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 shutdown_connections 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> v2:10.20.193.61:6800/2336688312 conn(0x7f63d803ab20 0x7f63d805afd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f640813fba0 0x7f6408129e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f640813f290 0x7f6408151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 --2- 10.20.193.7:0/966510573 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f640813c680 0x7f6408150b00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:35.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 >> 10.20.193.7:0/966510573 conn(0x7f6408093df0 msgr2=0x7f6408055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:35.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 shutdown_connections 2026-02-22T20:55:35.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:35.961+0000 7f640d819640 1 -- 10.20.193.7:0/966510573 wait complete. 2026-02-22T20:55:35.976 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:55:35.976 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:55:35.977 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:55:36.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: get_monmap_and_config 2026-02-22T20:55:36.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: monmap: 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:36.040110+0000 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:36.040110+0000 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:36.041 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:36.042 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 Processor -- start 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- start start 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: init 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f584013f290 0x7f584013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): picked mon.noname-a con 0x7f584013f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 0x7f584013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): picked mon.noname-b con 0x7f584013fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f584013c4b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584008fd70 con 0x7f584013c4b0 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f584008e1f0 con 0x7f584013f290 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f584008ec90 con 0x7f584013fba0 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient(hunting): authenticate will time out at 748.513339s 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 0x7f584013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f584013f290 0x7f584013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f584013c4b0 0x7f58401a07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48764/0 (socket says 10.20.193.7:48764) 2026-02-22T20:55:36.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583f7fe640 1 -- 10.20.193.7:0/883628863 learned_addr learned my addr 10.20.193.7:0/883628863 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): get_auth_request con 0x7f584013fba0 auth_method 0 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): get_auth_request con 0x7f584013f290 auth_method 0 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient(hunting): handle_auth_done global_id 64307 payload 274 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 -- 10.20.193.7:0/883628863 >> v2:10.20.193.7:3300/0 conn(0x7f584013f290 msgr2=0x7f584013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 --2- 10.20.193.7:0/883628863 >> v2:10.20.193.7:3300/0 conn(0x7f584013f290 0x7f584013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 -- 10.20.193.7:0/883628863 >> v1:10.20.193.7:6789/0 conn(0x7f584013c4b0 legacy=0x7f58401a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 monclient: found mon.noname-b 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 -- 10.20.193.7:0/883628863 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5840092bc0 con 0x7f584013fba0 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583e7fc640 1 --2- 10.20.193.7:0/883628863 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 0x7f584013bf70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5828004780 tx=0x7f582801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d5922259849ffe server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 1 -- 10.20.193.7:0/883628863 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280b1070 con 0x7f584013fba0 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: dump: 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.057 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 1 -- 10.20.193.7:0/883628863 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280a8050 con 0x7f584013fba0 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 5 monclient: authenticate success, global_id 64307 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 1 -- 10.20.193.7:0/883628863 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280ac860 con 0x7f584013fba0 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:36.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 4 set_mon_vals no callback set 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f583dffb640 10 monclient: dump: 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.059 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: shutdown 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- 10.20.193.7:0/883628863 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 msgr2=0x7f584013bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 --2- 10.20.193.7:0/883628863 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 0x7f584013bf70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5828004780 tx=0x7f582801c4d0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- 10.20.193.7:0/883628863 shutdown_connections 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 --2- 10.20.193.7:0/883628863 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013fba0 0x7f584013bf70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 --2- 10.20.193.7:0/883628863 >> v2:10.20.193.7:3300/0 conn(0x7f584013f290 0x7f584013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- 10.20.193.7:0/883628863 >> 10.20.193.7:0/883628863 conn(0x7f5840093df0 msgr2=0x7f58400902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- 10.20.193.7:0/883628863 shutdown_connections 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- 10.20.193.7:0/883628863 wait complete. 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: monmap: 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:36.061 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 Processor -- start 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 1 -- start start 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.037+0000 7f5845505640 10 monclient: init 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f584013c4b0 0x7f5840150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): picked mon.noname-b con 0x7f584013c4b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 0x7f5840151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): picked mon.noname-c con 0x7f584013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584013fba0 0x7f5840129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): picked mon.noname-a con 0x7f584013fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5840090e20 con 0x7f584013fba0 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5840090ca0 con 0x7f584013c4b0 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f58401a4710 con 0x7f584013f290 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): authenticate will time out at 748.516068s 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 0x7f5840151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584013fba0 0x7f5840129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 0x7f5840151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34904/0 (socket says 10.20.193.7:34904) 2026-02-22T20:55:36.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 -- 10.20.193.7:0/1673802072 learned_addr learned my addr 10.20.193.7:0/1673802072 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): get_auth_request con 0x7f584013f290 auth_method 0 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): get_auth_request con 0x7f584013fba0 auth_method 0 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f584013c4b0 0x7f5840150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient(hunting): handle_auth_done global_id 64310 payload 824 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f584013c4b0 msgr2=0x7f5840150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f584013c4b0 0x7f5840150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584013fba0 msgr2=0x7f5840129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584013fba0 0x7f5840129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 monclient: found mon.noname-c 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584012e540 con 0x7f584013f290 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient: get_auth_request con 0x7f584013c4b0 auth_method 0 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f584013c4b0 0x7f5840150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583e7fc640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 0x7f5840151040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f582801ca40 tx=0x7f5828019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280b1040 con 0x7f584013f290 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: dump: 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.066 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280ba070 con 0x7f584013f290 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 5 monclient: authenticate success, global_id 64310 2026-02-22T20:55:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _renew_subs 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584012d880 con 0x7f584013f290 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828003b10 con 0x7f584013f290 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583d7fa640 4 set_mon_vals no callback set 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: dump: 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.068 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _renew_subs 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f584013c110 con 0x7f584013f290 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 0x7f584012a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f584012d470 con 0x7f584012a390 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 0x7f584012a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f58280b4070 con 0x7f584013f290 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient: get_auth_request con 0x7f584012a390 auth_method 0 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 10 monclient(hunting): handle_auth_done global_id 5415 payload 824 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f584013f660 con 0x7f584012a390 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 --2- 10.20.193.7:0/1673802072 >> v2:10.20.193.61:6800/2336688312 conn(0x7f580c03ab70 0x7f580c05b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(117..117 src has 64..117) ==== 3897+0+0 (secure 0 0 0) 0x7f58280e82e0 con 0x7f584013f290 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 0x7f584012a760 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5834010800 tx=0x7f5834010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834018070 con 0x7f584012a390 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: dump: 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.071 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 1 --2- 10.20.193.7:0/1673802072 >> v2:10.20.193.61:6800/2336688312 conn(0x7f580c03ab70 0x7f580c05b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 10 monclient: get_auth_request con 0x7f580c03ab70 auth_method 0 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f5834004440 con 0x7f584012a390 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 msgr2=0x7f584012a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 0x7f584012a760 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5834010800 tx=0x7f5834010cc0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 msgr2=0x7f584012a760 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f581f7fe640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012a390 0x7f584012a760 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5834010800 tx=0x7f5834010cc0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.041+0000 7f583f7fe640 1 --2- 10.20.193.7:0/1673802072 >> v2:10.20.193.61:6800/2336688312 conn(0x7f580c03ab70 0x7f580c05b020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f584012e050 tx=0x7f5830009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 0x7f584008bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f584012b800 con 0x7f584012aca0 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 0x7f584008bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient: get_auth_request con 0x7f584012aca0 auth_method 0 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 10 monclient(hunting): handle_auth_done global_id 5418 payload 824 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 1 -- 10.20.193.7:0/1673802072 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f584012c360 con 0x7f584012aca0 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583effd640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 0x7f584008bed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5834017000 tx=0x7f58340047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583400f040 con 0x7f584012aca0 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 10 monclient: dump: 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.074 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f583401d450 con 0x7f584012aca0 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 msgr2=0x7f584008bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 0x7f584008bed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5834017000 tx=0x7f58340047b0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 msgr2=0x7f584008bed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f581f7fe640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f584012aca0 0x7f584008bed0 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5834017000 tx=0x7f58340047b0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 215174, 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:36.076 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.077 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.078 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:36.079 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.080 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.081 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.082 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.084 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.085 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:36.086 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 >> v2:10.20.193.61:6800/2336688312 conn(0x7f580c03ab70 msgr2=0x7f580c05b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 --2- 10.20.193.7:0/1673802072 >> v2:10.20.193.61:6800/2336688312 conn(0x7f580c03ab70 0x7f580c05b020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f584012e050 tx=0x7f5830009040 comp rx=0 tx=0).stop 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 10 monclient: shutdown 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 msgr2=0x7f5840151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 --2- 10.20.193.7:0/1673802072 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f584013f290 0x7f5840151040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f582801ca40 tx=0x7f5828019270 comp rx=0 tx=0).stop 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583f7fe640 1 -- 10.20.193.7:0/1673802072 reap_dead start 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f583f7fe640 1 -- 10.20.193.7:0/1673802072 reap_dead start 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 shutdown_connections 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 >> 10.20.193.7:0/1673802072 conn(0x7f5840093df0 msgr2=0x7f5840055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 shutdown_connections 2026-02-22T20:55:36.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.045+0000 7f5845505640 1 -- 10.20.193.7:0/1673802072 wait complete. 2026-02-22T20:55:36.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:36.089 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:55:36.089 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: get_monmap_and_config 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: monmap: 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:36.158234+0000 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:36.158234+0000 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:36.158 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 Processor -- start 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 -- start start 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: init 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 0x7fb79013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-b con 0x7fb79013f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-c con 0x7fb790055a70 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb7900563e0 0x7fb7901a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-a con 0x7fb7900563e0 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb79013f110 con 0x7fb7900563e0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fb790087300 con 0x7fb790055a70 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb790056880 con 0x7fb79013f780 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb794b53640 10 monclient(hunting): authenticate will time out at 748.631172s 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 0x7fb79013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb7900563e0 0x7fb7901a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 0x7fb79013fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34914/0 (socket says 10.20.193.7:34914) 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 1 -- 10.20.193.7:0/3426047196 learned_addr learned my addr 10.20.193.7:0/3426047196 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): get_auth_request con 0x7fb7900563e0 auth_method 0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): get_auth_request con 0x7fb79013f780 auth_method 0 2026-02-22T20:55:36.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 1 --2- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 10 monclient(hunting): get_auth_request con 0x7fb790055a70 auth_method 0 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient(hunting): handle_auth_done global_id 5421 payload 274 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 -- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 msgr2=0x7fb79013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 --2- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 0x7fb79013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 1 -- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 msgr2=0x7fb790055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 1 -- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 msgr2=0x7fb790055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 1 --2- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 -- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 msgr2=0x7fb790055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78effd640 1 --2- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 --2- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 monclient: found mon.noname-a 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:36.161 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.153+0000 7fb78ffff640 1 -- 10.20.193.7:0/3426047196 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb790091820 con 0x7fb7900563e0 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 1 --2- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb7900563e0 0x7fb7901a0440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb79008a9b0 tx=0x7fb78401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246e2614e5818be server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 1 -- 10.20.193.7:0/3426047196 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840b2070 con 0x7fb7900563e0 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: dump: 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 1 -- 10.20.193.7:0/3426047196 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7840a5890 con 0x7fb7900563e0 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 1 -- 10.20.193.7:0/3426047196 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840a5c80 con 0x7fb7900563e0 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 5 monclient: authenticate success, global_id 5421 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 4 set_mon_vals no callback set 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78e7fc640 10 monclient: dump: 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.163 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: shutdown 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb7900563e0 msgr2=0x7fb7901a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb7900563e0 0x7fb7901a0440 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb79008a9b0 tx=0x7fb78401c7f0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/3426047196 shutdown_connections 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb7900563e0 0x7fb7901a0440 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- 10.20.193.7:0/3426047196 >> v2:10.20.193.61:3300/0 conn(0x7fb790055a70 0x7fb790055ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- 10.20.193.7:0/3426047196 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79013f780 0x7fb79013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/3426047196 >> 10.20.193.7:0/3426047196 conn(0x7fb7900906f0 msgr2=0x7fb790090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/3426047196 shutdown_connections 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/3426047196 wait complete. 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: monmap: 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:36.164 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:36.165 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 Processor -- start 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- start start 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: init 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 0x7fb79012ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-c con 0x7fb790055a70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb7900563e0 0x7fb79012c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-b con 0x7fb7900563e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb79013f780 0x7fb79012ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): picked mon.noname-a con 0x7fb79013f780 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901a3730 con 0x7fb79013f780 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb7901a35b0 con 0x7fb7900563e0 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb7901a38b0 con 0x7fb790055a70 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient(hunting): authenticate will time out at 748.635336s 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 0x7fb79012ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 0x7fb79012ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34918/0 (socket says 10.20.193.7:34918) 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 -- 10.20.193.7:0/2409807779 learned_addr learned my addr 10.20.193.7:0/2409807779 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): get_auth_request con 0x7fb790055a70 auth_method 0 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb79013f780 0x7fb79012ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): get_auth_request con 0x7fb79013f780 auth_method 0 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient(hunting): handle_auth_done global_id 64316 payload 824 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb7900563e0 msgr2=0x7fb79012c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb7900563e0 0x7fb79012c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb7900563e0 0x7fb79012c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb79013f780 msgr2=0x7fb79012ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb79013f780 0x7fb79012ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 monclient: found mon.noname-c 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb790130320 con 0x7fb790055a70 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78ffff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb79013f780 0x7fb79012ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78effd640 10 monclient: get_auth_request con 0x7fb7900563e0 auth_method 0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb7900563e0 0x7fb79012c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78f7fe640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 0x7fb79012ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb77c006b50 tx=0x7fb77c00ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c017070 con 0x7fb790055a70 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: dump: 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.169 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c00c970 con 0x7fb790055a70 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00cd20 con 0x7fb790055a70 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb76bfff640 10 monclient: dump: 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb78dffb640 4 set_mon_vals no callback set 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 5 monclient: authenticate success, global_id 64316 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _renew_subs 2026-02-22T20:55:36.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7900883c0 con 0x7fb790055a70 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _renew_subs 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.157+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79008a9e0 con 0x7fb790055a70 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb794b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb794b53640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 0x7fb79012d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb790130b00 con 0x7fb79012ff20 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 0x7fb79012d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient: get_auth_request con 0x7fb79012ff20 auth_method 0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fb77c013470 con 0x7fb790055a70 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 --2- 10.20.193.7:0/2409807779 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb76003ab10 0x7fb76005afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 10 monclient(hunting): handle_auth_done global_id 64319 payload 824 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(117..117 src has 64..117) ==== 3897+0+0 (secure 0 0 0) 0x7fb77c04eec0 con 0x7fb790055a70 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb790055ea0 con 0x7fb79012ff20 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 0x7fb79012d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb79013e4a0 tx=0x7fb78000f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780018070 con 0x7fb79012ff20 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 10 monclient: dump: 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78ffff640 1 --2- 10.20.193.7:0/2409807779 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb76003ab10 0x7fb76005afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78ffff640 10 monclient: get_auth_request con 0x7fb76003ab10 auth_method 0 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fb780014890 con 0x7fb79012ff20 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 msgr2=0x7fb79012d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 0x7fb79012d350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb79013e4a0 tx=0x7fb78000f9e0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 msgr2=0x7fb79012d350 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb76bfff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb79012ff20 0x7fb79012d350 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb79013e4a0 tx=0x7fb78000f9e0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.161+0000 7fb78ffff640 1 --2- 10.20.193.7:0/2409807779 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb76003ab10 0x7fb76005afc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb78401d090 tx=0x7fb7840a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 0x7fb79008abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb790056b30 con 0x7fb790150a70 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 0x7fb79008abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient: get_auth_request con 0x7fb790150a70 auth_method 0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 10 monclient(hunting): handle_auth_done global_id 64322 payload 824 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 1 -- 10.20.193.7:0/2409807779 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb79005faa0 con 0x7fb790150a70 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78effd640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 0x7fb79008abb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb780017000 tx=0x7fb780004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7800285f0 con 0x7fb790150a70 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 10 monclient: dump: 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7fb7800133e0 con 0x7fb790150a70 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 msgr2=0x7fb79008abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 0x7fb79008abb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb780017000 tx=0x7fb780004820 comp rx=0 tx=0).stop 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 msgr2=0x7fb79008abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb76bfff640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790150a70 0x7fb79008abb0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb780017000 tx=0x7fb780004820 comp rx=0 tx=0).stop 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 61769, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.174 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.175 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.176 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.177 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:55:36.178 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb76003ab10 msgr2=0x7fb76005afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 --2- 10.20.193.7:0/2409807779 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb76003ab10 0x7fb76005afc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb78401d090 tx=0x7fb7840a7070 comp rx=0 tx=0).stop 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 10 monclient: shutdown 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 msgr2=0x7fb79012ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 --2- 10.20.193.7:0/2409807779 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb790055a70 0x7fb79012ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb77c006b50 tx=0x7fb77c00ee10 comp rx=0 tx=0).stop 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78ffff640 1 -- 10.20.193.7:0/2409807779 reap_dead start 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb78ffff640 1 -- 10.20.193.7:0/2409807779 reap_dead start 2026-02-22T20:55:36.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 shutdown_connections 2026-02-22T20:55:36.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 >> 10.20.193.7:0/2409807779 conn(0x7fb7900906f0 msgr2=0x7fb790088630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 shutdown_connections 2026-02-22T20:55:36.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.165+0000 7fb794b53640 1 -- 10.20.193.7:0/2409807779 wait complete. 2026-02-22T20:55:36.180 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:36.180 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:55:36.180 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:55:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.233+0000 7f4e53a40640 10 monclient: get_monmap_and_config 2026-02-22T20:55:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.233+0000 7f4e53a40640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.233+0000 7f4e53a40640 10 monclient: monmap: 2026-02-22T20:55:36.239 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.239 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:36.239636+0000 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:36.239636+0000 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:36.240 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 Processor -- start 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- start start 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: init 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4e4c089130 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-b con 0x7f4e4c089500 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 0x7f4e4c19e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-a con 0x7f4e4c17e230 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c087360 con 0x7f4e4c089130 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c08cca0 con 0x7f4e4c17e230 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c087640 con 0x7f4e4c089500 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient(hunting): authenticate will time out at 748.712751s 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34938/0 (socket says 10.20.193.7:34938) 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 -- 10.20.193.7:0/3757749157 learned_addr learned my addr 10.20.193.7:0/3757749157 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request con 0x7f4e4c089500 auth_method 0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 1 --2- 10.20.193.7:0/3757749157 >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 0x7f4e4c19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 10 monclient(hunting): get_auth_request con 0x7f4e4c17e230 auth_method 0 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_done global_id 64325 payload 274 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 -- 10.20.193.7:0/3757749157 >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 msgr2=0x7f4e4c19e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/3757749157 >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 0x7f4e4c19e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 -- 10.20.193.7:0/3757749157 >> v1:10.20.193.61:6789/0 conn(0x7f4e4c089130 legacy=0x7f4e4c08e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 monclient: found mon.noname-b 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 -- 10.20.193.7:0/3757749157 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c13c3a0 con 0x7f4e4c089500 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e51fb6640 1 --2- 10.20.193.7:0/3757749157 >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 0x7f4e4c19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/3757749157 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e400090a0 tx=0x7f4e4001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7685ce5d3b494159 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 1 -- 10.20.193.7:0/3757749157 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400ab610 con 0x7f4e4c089500 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: dump: 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.242 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 1 -- 10.20.193.7:0/3757749157 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e400b0070 con 0x7f4e4c089500 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 5 monclient: authenticate success, global_id 64325 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 1 -- 10.20.193.7:0/3757749157 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400ab9d0 con 0x7f4e4c089500 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e3bfff640 10 monclient: dump: 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 4 set_mon_vals no callback set 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: shutdown 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- 10.20.193.7:0/3757749157 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 msgr2=0x7f4e4c08eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 --2- 10.20.193.7:0/3757749157 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e400090a0 tx=0x7f4e4001c500 comp rx=0 tx=0).stop 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- 10.20.193.7:0/3757749157 shutdown_connections 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 --2- 10.20.193.7:0/3757749157 >> v2:10.20.193.7:3300/0 conn(0x7f4e4c17e230 0x7f4e4c19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 --2- 10.20.193.7:0/3757749157 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089500 0x7f4e4c08eac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- 10.20.193.7:0/3757749157 >> 10.20.193.7:0/3757749157 conn(0x7f4e4c08faa0 msgr2=0x7f4e4c08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- 10.20.193.7:0/3757749157 shutdown_connections 2026-02-22T20:55:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- 10.20.193.7:0/3757749157 wait complete. 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: monmap: 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:36.245 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 Processor -- start 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 1 -- start start 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.237+0000 7f4e53a40640 10 monclient: init 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 0x7f4e4c12cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-c con 0x7f4e4c089130 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e4c089500 0x7f4e4c129700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-a con 0x7f4e4c089500 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c17e230 0x7f4e4c129c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): picked mon.noname-b con 0x7f4e4c17e230 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c08f180 con 0x7f4e4c089500 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c08f000 con 0x7f4e4c17e230 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c1a1370 con 0x7f4e4c089130 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): authenticate will time out at 748.716252s 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 0x7f4e4c12cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e4c089500 0x7f4e4c129700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 0x7f4e4c12cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34942/0 (socket says 10.20.193.7:34942) 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 -- 10.20.193.7:0/887800557 learned_addr learned my addr 10.20.193.7:0/887800557 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): get_auth_request con 0x7f4e4c089130 auth_method 0 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request con 0x7f4e4c089500 auth_method 0 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c17e230 0x7f4e4c129c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 10 monclient(hunting): get_auth_request con 0x7f4e4c17e230 auth_method 0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient(hunting): handle_auth_done global_id 64328 payload 824 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c17e230 msgr2=0x7f4e4c129c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c17e230 0x7f4e4c129c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e4c089500 msgr2=0x7f4e4c129700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e4c089500 0x7f4e4c129700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 monclient: found mon.noname-c 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c086690 con 0x7f4e4c089130 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4e4c089500 0x7f4e4c129700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e517b5640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 0x7f4e4c12cc40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c4d0 tx=0x7f4e3c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c006ad0 con 0x7f4e4c089130 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: dump: 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c006c70 con 0x7f4e4c089130 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c007230 con 0x7f4e4c089130 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 5 monclient: authenticate success, global_id 64328 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: dump: 2026-02-22T20:55:36.247 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e3b7fe640 4 set_mon_vals no callback set 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _renew_subs 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c13a6d0 con 0x7f4e4c089130 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _renew_subs 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c10e580 con 0x7f4e4c089130 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 0x7f4e4c04ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c12a580 con 0x7f4e4c12a180 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4e3c0073d0 con 0x7f4e4c089130 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 0x7f4e4c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient: get_auth_request con 0x7f4e4c12a180 auth_method 0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 --2- 10.20.193.7:0/887800557 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4e1c03ab20 0x7f4e1c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(117..117 src has 64..117) ==== 3897+0+0 (secure 0 0 0) 0x7f4e3c04e7e0 con 0x7f4e4c089130 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 1 --2- 10.20.193.7:0/887800557 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4e1c03ab20 0x7f4e1c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 10 monclient: get_auth_request con 0x7f4e1c03ab20 auth_method 0 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_done global_id 74101 payload 824 2026-02-22T20:55:36.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e4c10e200 con 0x7f4e4c12a180 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 0x7f4e4c04ca80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ad040 tx=0x7f4e400192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e51fb6640 1 --2- 10.20.193.7:0/887800557 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4e1c03ab20 0x7f4e1c05afd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c058f60 tx=0x7f4e48003af0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400b5810 con 0x7f4e4c12a180 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: dump: 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f4e400b0050 con 0x7f4e4c12a180 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 msgr2=0x7f4e4c04ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 0x7f4e4c04ca80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ad040 tx=0x7f4e400192a0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 msgr2=0x7f4e4c04ca80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.241+0000 7f4e39ffb640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c12a180 0x7f4e4c04ca80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e400ad040 tx=0x7f4e400192a0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 0x7f4e4c0596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c10dce0 con 0x7f4e4c04cfc0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 0x7f4e4c0596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient: get_auth_request con 0x7f4e4c04cfc0 auth_method 0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 10 monclient(hunting): handle_auth_done global_id 74104 payload 824 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 1 -- 10.20.193.7:0/887800557 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e4c0382a0 con 0x7f4e4c04cfc0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e50fb4640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 0x7f4e4c0596b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e4001c540 tx=0x7f4e40009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400c9070 con 0x7f4e4c04cfc0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 10 monclient: dump: 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7f4e400c5590 con 0x7f4e4c04cfc0 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 msgr2=0x7f4e4c0596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 0x7f4e4c0596b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e4001c540 tx=0x7f4e40009300 comp rx=0 tx=0).stop 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 msgr2=0x7f4e4c0596b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e39ffb640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4e4c04cfc0 0x7f4e4c0596b0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e4001c540 tx=0x7f4e40009300 comp rx=0 tx=0).stop 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 3636, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:36.251 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:36.252 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.253 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.254 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:36.255 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4e1c03ab20 msgr2=0x7f4e1c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 --2- 10.20.193.7:0/887800557 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4e1c03ab20 0x7f4e1c05afd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c058f60 tx=0x7f4e48003af0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 10 monclient: shutdown 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 msgr2=0x7f4e4c12cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 --2- 10.20.193.7:0/887800557 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4e4c089130 0x7f4e4c12cc40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c4d0 tx=0x7f4e3c00c990 comp rx=0 tx=0).stop 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e51fb6640 1 -- 10.20.193.7:0/887800557 reap_dead start 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e51fb6640 1 -- 10.20.193.7:0/887800557 reap_dead start 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 shutdown_connections 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 >> 10.20.193.7:0/887800557 conn(0x7f4e4c08faa0 msgr2=0x7f4e4c05cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 shutdown_connections 2026-02-22T20:55:36.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.245+0000 7f4e53a40640 1 -- 10.20.193.7:0/887800557 wait complete. 2026-02-22T20:55:36.258 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:36.258 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:55:36.258 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:55:36.329 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: get_monmap_and_config 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: monmap: 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:36.329605+0000 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:36.329605+0000 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:36.330 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:36.331 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:36.331 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 Processor -- start 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 -- start start 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: init 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f9010090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): picked mon.noname-b con 0x7f901008c7a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f90100909a0 0x7f9010090d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): picked mon.noname-a con 0x7f90100909a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f901017f6d0 0x7f901019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): picked mon.noname-c con 0x7f901017f6d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f90100912b0 con 0x7f90100909a0 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f901008d840 con 0x7f901017f6d0 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f901008db20 con 0x7f901008c7a0 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f9015235640 10 monclient(hunting): authenticate will time out at 748.802536s 2026-02-22T20:55:36.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f9010090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f90100909a0 0x7f9010090d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f9010090460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34946/0 (socket says 10.20.193.7:34946) 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 1 -- 10.20.193.7:0/168636947 learned_addr learned my addr 10.20.193.7:0/168636947 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): get_auth_request con 0x7f90100909a0 auth_method 0 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): get_auth_request con 0x7f901008c7a0 auth_method 0 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900f577640 1 --2- 10.20.193.7:0/168636947 >> v2:10.20.193.61:3300/0 conn(0x7f901017f6d0 0x7f901019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900f577640 10 monclient(hunting): get_auth_request con 0x7f901017f6d0 auth_method 0 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900f577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient(hunting): handle_auth_done global_id 5433 payload 274 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 -- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 msgr2=0x7f9010090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 --2- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f9010090460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 -- 10.20.193.7:0/168636947 >> v2:10.20.193.61:3300/0 conn(0x7f901017f6d0 msgr2=0x7f901019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 --2- 10.20.193.7:0/168636947 >> v2:10.20.193.61:3300/0 conn(0x7f901017f6d0 0x7f901019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 monclient: found mon.noname-a 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.325+0000 7f900e575640 1 -- 10.20.193.7:0/168636947 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90100851e0 con 0x7f90100909a0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900e575640 1 --2- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f90100909a0 0x7f9010090d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9010085410 tx=0x7f8ff801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507dcd93a491404c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 1 -- 10.20.193.7:0/168636947 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b1070 con 0x7f90100909a0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: dump: 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.342 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 1 -- 10.20.193.7:0/168636947 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a8050 con 0x7f90100909a0 2026-02-22T20:55:36.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 1 -- 10.20.193.7:0/168636947 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ac860 con 0x7f90100909a0 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 5 monclient: authenticate success, global_id 5433 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 4 set_mon_vals no callback set 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900dd74640 10 monclient: dump: 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.344 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: shutdown 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f90100909a0 msgr2=0x7f9010090d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f90100909a0 0x7f9010090d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9010085410 tx=0x7f8ff801c400 comp rx=0 tx=0).stop 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/168636947 shutdown_connections 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- 10.20.193.7:0/168636947 >> v2:10.20.193.61:3300/0 conn(0x7f901017f6d0 0x7f901019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f90100909a0 0x7f9010090d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- 10.20.193.7:0/168636947 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f9010090460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/168636947 >> 10.20.193.7:0/168636947 conn(0x7f901008e050 msgr2=0x7f901008e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/168636947 shutdown_connections 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/168636947 wait complete. 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: build_initial_monmap 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: monmap: 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:36.345 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 Processor -- start 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- start start 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: init 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): picked mon.noname-c con 0x7f901008c7a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f90100909a0 0x7f901007b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): picked mon.noname-b con 0x7f90100909a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f901017f6d0 0x7f901007be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): picked mon.noname-a con 0x7f901017f6d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f90101a2ba0 con 0x7f901017f6d0 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f90101a2a20 con 0x7f90100909a0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f90101a2d20 con 0x7f901008c7a0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient(hunting): authenticate will time out at 748.806620s 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34952/0 (socket says 10.20.193.7:34952) 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 -- 10.20.193.7:0/2005120226 learned_addr learned my addr 10.20.193.7:0/2005120226 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): get_auth_request con 0x7f901008c7a0 auth_method 0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f901017f6d0 0x7f901007be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): get_auth_request con 0x7f901017f6d0 auth_method 0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900e575640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f90100909a0 0x7f901007b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient(hunting): handle_auth_done global_id 64334 payload 824 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 -- 10.20.193.7:0/2005120226 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f90100909a0 msgr2=0x7f901007b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f90100909a0 0x7f901007b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 -- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f901017f6d0 msgr2=0x7f901007be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f901017f6d0 0x7f901007be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient: _finish_hunting 0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 monclient: found mon.noname-c 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 -- 10.20.193.7:0/2005120226 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9010083860 con 0x7f901008c7a0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900ed76640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9004006b50 tx=0x7f900400ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004017070 con 0x7f901008c7a0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: dump: 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.348 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900400c970 con 0x7f901008c7a0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900400cd20 con 0x7f901008c7a0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 5 monclient: authenticate success, global_id 64334 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _renew_subs 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f900d573640 4 set_mon_vals no callback set 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9010087340 con 0x7f901008c7a0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:36.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 10 monclient: dump: 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _renew_subs 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f901007e360 con 0x7f901008c7a0 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9010090460 con 0x7f901008c7a0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9004013470 con 0x7f901008c7a0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 --2- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 0x7f8fdc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.329+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(117..117 src has 64..117) ==== 3897+0+0 (secure 0 0 0) 0x7f900404ef70 con 0x7f901008c7a0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f900e575640 1 --2- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 0x7f8fdc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f900e575640 10 monclient: get_auth_request con 0x7f8fdc03ab20 auth_method 0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f900e575640 1 --2- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 0x7f8fdc05afd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8002410 tx=0x7f8ff80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f9010087340 con 0x7f901008c7a0 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f8fef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:36.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.333+0000 7f8fef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:36.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:55:36.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:55:36.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:36.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f901005fc70 con 0x7f901008c7a0 2026-02-22T20:55:36.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f8fef7fe640 1 -- 10.20.193.7:0/2005120226 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9010083860 con 0x7f901008c7a0 2026-02-22T20:55:36.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f8fef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:55:36.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f8fef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=7,logm=64} crc {auth=1085836812,config=3140514009,health=275216553,kv=1299730079,logm=2910380555}) 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=13,kv=9,logm=62} crc {auth=1085836812,config=3140514009,health=139899691,kv=3802980238,logm=793831144}) 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=7,logm=64} crc {auth=1085836812,config=3140514009,health=275216553,kv=1299730079,logm=2910380555}) 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=12,kv=7,logm=65} crc {auth=1085836812,config=3140514009,health=4182953865,kv=960935916,logm=2979750811}) 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.450 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3342745854}) 2026-02-22T20:55:36.451 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=856489276}) 2026-02-22T20:55:36.451 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.451 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3342745854}) 2026-02-22T20:55:36.451 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2419900921}) 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 msgr2=0x7f8fdc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 0x7f8fdc05afd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8002410 tx=0x7f8ff80a7000 comp rx=0 tx=0).stop 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 10 monclient: shutdown 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 msgr2=0x7f901005d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9004006b50 tx=0x7f900400ee10 comp rx=0 tx=0).stop 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 shutdown_connections 2026-02-22T20:55:36.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f901017f6d0 0x7f901007be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab20 0x7f8fdc05afd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.453 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.453 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2848112375}) 2026-02-22T20:55:36.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f90100909a0 0x7f901007b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 --2- 10.20.193.7:0/2005120226 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f901008c7a0 0x7f901005d510 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:36.454 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2929450167}) 2026-02-22T20:55:36.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 >> 10.20.193.7:0/2005120226 conn(0x7f901008e050 msgr2=0x7f901008a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:36.455 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.455 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2848112375}) 2026-02-22T20:55:36.455 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3602201342}) 2026-02-22T20:55:36.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 shutdown_connections 2026-02-22T20:55:36.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:36.445+0000 7f9015235640 1 -- 10.20.193.7:0/2005120226 wait complete. 2026-02-22T20:55:36.459 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.459 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655591475}) 2026-02-22T20:55:36.459 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=495751976}) 2026-02-22T20:55:36.459 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.459 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655591475}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3711752122}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1900660625}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2594589124}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1900660625}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.445+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3957767029}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=755292909}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1097424987}) 2026-02-22T20:55:36.460 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=755292909}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3840327186}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3029449698}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2116721771}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3029449698}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3670635272}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=293437726}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3836599083}) 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.461 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=293437726}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3102127977}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1220791056}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1854450884}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1220791056}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2761294601}) 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.462 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=32,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=924280321,mdsmap=1256979633,mgr=436450291,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=662357294,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=1014900235,osd_pg_creating=1616749025,osd_snap=4133920409,osdmap=3085761850}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=34,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3224050733,mdsmap=774328894,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1911514234,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1616749025,osd_snap=4133920409,osdmap=1278333419}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=32,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=924280321,mdsmap=1256979633,mgr=436450291,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=662357294,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=1014900235,osd_pg_creating=1616749025,osd_snap=4133920409,osdmap=3085761850}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.449+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=34,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=6,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=25} crc {logm=3105112374,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2846817945,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1616749025,osd_snap=4133920409,osdmap=4147673151}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=66} crc {osdmap=701139815}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=68} crc {osdmap=2830861574}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=66} crc {osdmap=701139815}) 2026-02-22T20:55:36.463 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:55:36.453+0000 7fcb815cd640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=68} crc {osdmap=4056030633}) 2026-02-22T20:55:36.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:55:36.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:36.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:36.970 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: starting. 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20058 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: created object 0... 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: created object 25... 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: created object 49... 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: finishing. 2026-02-22T20:55:36.971 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20135]: shutting down. 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: starting. 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: listing objects. 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: listed object 0... 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: listed object 25... 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: saw 50 objects 2026-02-22T20:55:36.982 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20137]: shutting down. 2026-02-22T20:55:37.466 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:55:37.466 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 10 monclient: get_monmap_and_config 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 10 monclient: monmap: 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:37.527039+0000 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:37.527039+0000 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:37.527 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 1 Processor -- start 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 1 -- start start 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.521+0000 7f9fb8e28640 10 monclient: init 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9fb413cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9fb413d9d0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9fb417fb80 0x7f9fb419ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-a con 0x7f9fb417fb80 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:37.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb405d510 con 0x7f9fb413d9d0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb408b800 con 0x7f9fb413cef0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb408a720 con 0x7f9fb417fb80 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): authenticate will time out at 750.000181s 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9fb417fb80 0x7f9fb419ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9fb417fb80 0x7f9fb419ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40200/0 (socket says 10.20.193.7:40200) 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/2101436339 learned_addr learned my addr 10.20.193.7:0/2101436339 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): get_auth_request con 0x7f9fb417fb80 auth_method 0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_done global_id 5439 payload 274 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/2101436339 >> v1:10.20.193.61:6789/0 conn(0x7f9fb413cef0 legacy=0x7f9fb413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/2101436339 >> v1:10.20.193.7:6789/0 conn(0x7f9fb413d9d0 legacy=0x7f9fb417e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/2101436339 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb408aa00 con 0x7f9fb417fb80 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- 10.20.193.7:0/2101436339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb419ff60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009580 tx=0x7f9fa401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccda8e0f0e1569b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 1 -- 10.20.193.7:0/2101436339 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40b2070 con 0x7f9fb417fb80 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: dump: 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 1 -- 10.20.193.7:0/2101436339 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40a59d0 con 0x7f9fb417fb80 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 1 -- 10.20.193.7:0/2101436339 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40a5dc0 con 0x7f9fb417fb80 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 5 monclient: authenticate success, global_id 5439 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:37.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 4 set_mon_vals no callback set 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1573640 10 monclient: dump: 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: shutdown 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- 10.20.193.7:0/2101436339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 msgr2=0x7f9fb419ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/2101436339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb419ff60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009580 tx=0x7f9fa401c8f0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- 10.20.193.7:0/2101436339 shutdown_connections 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/2101436339 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb419ff60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- 10.20.193.7:0/2101436339 >> 10.20.193.7:0/2101436339 conn(0x7f9fb408f860 msgr2=0x7f9fb408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- 10.20.193.7:0/2101436339 shutdown_connections 2026-02-22T20:55:37.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- 10.20.193.7:0/2101436339 wait complete. 2026-02-22T20:55:37.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: monmap: 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:37.534 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 Processor -- start 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- start start 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: init 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 0x7f9fb412beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-c con 0x7f9fb413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 0x7f9fb412c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-b con 0x7f9fb413d9d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb412c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): picked mon.noname-a con 0x7f9fb417fb80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41a30d0 con 0x7f9fb417fb80 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41a2f50 con 0x7f9fb413d9d0 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb41a3250 con 0x7f9fb413cef0 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb8e28640 10 monclient(hunting): authenticate will time out at 750.003602s 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 0x7f9fb412beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 0x7f9fb412beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34966/0 (socket says 10.20.193.7:34966) 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 1 -- 10.20.193.7:0/3582789224 learned_addr learned my addr 10.20.193.7:0/3582789224 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): get_auth_request con 0x7f9fb413cef0 auth_method 0 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb412c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): get_auth_request con 0x7f9fb417fb80 auth_method 0 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1d74640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 0x7f9fb412c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient(hunting): handle_auth_done global_id 5442 payload 824 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 msgr2=0x7f9fb412beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 0x7f9fb412beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/3582789224 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 msgr2=0x7f9fb412c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 0x7f9fb412c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 -- 10.20.193.7:0/3582789224 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb413c970 con 0x7f9fb417fb80 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1d74640 10 monclient: get_auth_request con 0x7f9fb413d9d0 auth_method 0 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb1d74640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 0x7f9fb412c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.525+0000 7f9fb2d76640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb412c930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9fa401afa0 tx=0x7f9fa4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40b2040 con 0x7f9fb417fb80 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: dump: 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa4003e50 con 0x7f9fb417fb80 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004240 con 0x7f9fb417fb80 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb0d72640 4 set_mon_vals no callback set 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 10 monclient: dump: 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.540 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 5 monclient: authenticate success, global_id 5442 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _renew_subs 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb4086620 con 0x7f9fb417fb80 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _renew_subs 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb412a0e0 con 0x7f9fb417fb80 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb413d2c0 con 0x7f9fb417fb80 2026-02-22T20:55:37.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9fa40b5070 con 0x7f9fb417fb80 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 --2- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 0x7f9f8005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(118..118 src has 64..118) ==== 3897+0+0 (secure 0 0 0) 0x7f9fa40e9280 con 0x7f9fb417fb80 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb2575640 1 --2- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 0x7f9f8005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb2575640 10 monclient: get_auth_request con 0x7f9f8003ab20 auth_method 0 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.529+0000 7f9fb2575640 1 --2- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 0x7f9f8005afd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8007d60 tx=0x7f9fa8003950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.533+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f9fa4016600 con 0x7f9fb417fb80 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.533+0000 7f9f9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.533+0000 7f9f9affd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9fb4128620 con 0x7f9fb417fb80 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9f9affd640 1 -- 10.20.193.7:0/3582789224 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f9fa40bd6a0 con 0x7f9fb417fb80 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9f9affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9f9affd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:37.650 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 msgr2=0x7f9f8005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 0x7f9f8005afd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8007d60 tx=0x7f9fa8003950 comp rx=0 tx=0).stop 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 10 monclient: shutdown 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 msgr2=0x7f9fb412c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb412c930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9fa401afa0 tx=0x7f9fa4019690 comp rx=0 tx=0).stop 2026-02-22T20:55:37.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 shutdown_connections 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9fb417fb80 0x7f9fb412c930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9f8003ab20 0x7f9f8005afd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9fb413d9d0 0x7f9fb412c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 --2- 10.20.193.7:0/3582789224 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9fb413cef0 0x7f9fb412beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 >> 10.20.193.7:0/3582789224 conn(0x7f9fb408f860 msgr2=0x7f9fb405b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 shutdown_connections 2026-02-22T20:55:37.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.645+0000 7f9fb8e28640 1 -- 10.20.193.7:0/3582789224 wait complete. 2026-02-22T20:55:37.660 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:55:37.660 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:55:37.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:55:37.660 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: get_monmap_and_config 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: monmap: 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:37.730238+0000 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:37.730238+0000 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:37.730 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 Processor -- start 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 -- start start 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: init 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f29f8090880 0x7f29f8090c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-a con 0x7f29f8090880 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f29f815f6c0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f29f81811c0 0x7f29f81a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-c con 0x7f29f81811c0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f808dd90 con 0x7f29f815f6c0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f29f808d7d0 con 0x7f29f8090880 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f29f808dab0 con 0x7f29f81811c0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fdf63640 10 monclient(hunting): authenticate will time out at 750.203216s 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f29f8090880 0x7f29f8090c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f29f8090880 0x7f29f8090c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40216/0 (socket says 10.20.193.7:40216) 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 -- 10.20.193.7:0/4137639058 learned_addr learned my addr 10.20.193.7:0/4137639058 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): get_auth_request con 0x7f29f8090880 auth_method 0 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fd762640 1 --2- 10.20.193.7:0/4137639058 >> v2:10.20.193.61:3300/0 conn(0x7f29f81811c0 0x7f29f81a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fd762640 10 monclient(hunting): get_auth_request con 0x7f29f81811c0 auth_method 0 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fd762640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fd762640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fd762640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient(hunting): handle_auth_done global_id 5445 payload 274 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 -- 10.20.193.7:0/4137639058 >> v2:10.20.193.61:3300/0 conn(0x7f29f81811c0 msgr2=0x7f29f81a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 --2- 10.20.193.7:0/4137639058 >> v2:10.20.193.61:3300/0 conn(0x7f29f81811c0 0x7f29f81a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 -- 10.20.193.7:0/4137639058 >> v1:10.20.193.7:6789/0 conn(0x7f29f815f6c0 legacy=0x7f29f817faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.725+0000 7f29fcf61640 1 -- 10.20.193.7:0/4137639058 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f808c970 con 0x7f29f8090880 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 1 --2- 10.20.193.7:0/4137639058 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8090880 0x7f29f8090c50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f29f8059450 tx=0x7f29e801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7307b565320edc6e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 1 -- 10.20.193.7:0/4137639058 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80aa660 con 0x7f29f8090880 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: dump: 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 1 -- 10.20.193.7:0/4137639058 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e80af070 con 0x7f29f8090880 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 5 monclient: authenticate success, global_id 5445 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 1 -- 10.20.193.7:0/4137639058 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80aaa20 con 0x7f29f8090880 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ef7fe640 10 monclient: dump: 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 4 set_mon_vals no callback set 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: shutdown 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/4137639058 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8090880 msgr2=0x7f29f8090c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- 10.20.193.7:0/4137639058 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8090880 0x7f29f8090c50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f29f8059450 tx=0x7f29e801c4e0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/4137639058 shutdown_connections 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- 10.20.193.7:0/4137639058 >> v2:10.20.193.61:3300/0 conn(0x7f29f81811c0 0x7f29f81a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- 10.20.193.7:0/4137639058 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8090880 0x7f29f8090c50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/4137639058 >> 10.20.193.7:0/4137639058 conn(0x7f29f808e050 msgr2=0x7f29f808e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/4137639058 shutdown_connections 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/4137639058 wait complete. 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: monmap: 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.737 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 Processor -- start 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- start start 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: init 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f29f8090880 0x7f29f807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-b con 0x7f29f8090880 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f815f6c0 0x7f29f807be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-a con 0x7f29f815f6c0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 0x7f29f807c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): picked mon.noname-c con 0x7f29f81811c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29f80852b0 con 0x7f29f815f6c0 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8085130 con 0x7f29f8090880 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f29f81a4300 con 0x7f29f81811c0 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): authenticate will time out at 750.206728s 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 0x7f29f807c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f815f6c0 0x7f29f807be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 0x7f29f807c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34970/0 (socket says 10.20.193.7:34970) 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 1 -- 10.20.193.7:0/1029890012 learned_addr learned my addr 10.20.193.7:0/1029890012 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): get_auth_request con 0x7f29f815f6c0 auth_method 0 2026-02-22T20:55:37.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): get_auth_request con 0x7f29f81811c0 auth_method 0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f29f8090880 0x7f29f807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): get_auth_request con 0x7f29f8090880 auth_method 0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient(hunting): handle_auth_done global_id 5448 payload 824 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 msgr2=0x7f29f807c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 0x7f29f807c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f29f8090880 msgr2=0x7f29f807b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f29f8090880 0x7f29f807b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f807f080 con 0x7f29f815f6c0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fd762640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f29f81811c0 0x7f29f807c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29effff640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f815f6c0 0x7f29f807be30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f29e0002770 tx=0x7f29e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0005220 con 0x7f29f815f6c0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: dump: 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e00053c0 con 0x7f29f815f6c0 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 5 monclient: authenticate success, global_id 5448 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0006af0 con 0x7f29f815f6c0 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29ed7fa640 10 monclient: dump: 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.740 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29eeffd640 4 set_mon_vals no callback set 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _renew_subs 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f8088740 con 0x7f29f815f6c0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _renew_subs 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f807eda0 con 0x7f29f815f6c0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 0x7f29f8178ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8088420 con 0x7f29f8178c20 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 0x7f29f8178ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient: get_auth_request con 0x7f29f8178c20 auth_method 0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 10 monclient(hunting): handle_auth_done global_id 5451 payload 824 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f8090c50 con 0x7f29f8178c20 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.729+0000 7f29fcf61640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 0x7f29f8178ff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ac040 tx=0x7f29e8019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f29e0006c90 con 0x7f29f815f6c0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 --2- 10.20.193.7:0/1029890012 >> v2:10.20.193.61:6800/2336688312 conn(0x7f29c803aad0 0x7f29c805af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(118..118 src has 64..118) ==== 3897+0+0 (secure 0 0 0) 0x7f29e004dd30 con 0x7f29f815f6c0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8004020 con 0x7f29f8178c20 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 10 monclient: dump: 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.741 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f29e80af040 con 0x7f29f8178c20 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 msgr2=0x7f29f8178ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 0x7f29f8178ff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ac040 tx=0x7f29e8019280 comp rx=0 tx=0).stop 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 msgr2=0x7f29f8178ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29ed7fa640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8178c20 0x7f29f8178ff0 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ac040 tx=0x7f29e8019280 comp rx=0 tx=0).stop 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fd762640 1 --2- 10.20.193.7:0/1029890012 >> v2:10.20.193.61:6800/2336688312 conn(0x7f29c803aad0 0x7f29c805af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fd762640 10 monclient: get_auth_request con 0x7f29c803aad0 auth_method 0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fd762640 1 --2- 10.20.193.7:0/1029890012 >> v2:10.20.193.61:6800/2336688312 conn(0x7f29c803aad0 0x7f29c805af80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009750 tx=0x7f29f40098b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fdf63640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fdf63640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 0x7f29f8059e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fdf63640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29f807d880 con 0x7f29f8179530 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 0x7f29f8059e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient: get_auth_request con 0x7f29f8179530 auth_method 0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 10 monclient(hunting): handle_auth_done global_id 5454 payload 824 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 1 -- 10.20.193.7:0/1029890012 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f29f805fb90 con 0x7f29f8179530 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.733+0000 7f29fcf61640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 0x7f29f8059e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29e801c520 tx=0x7f29e8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80c4920 con 0x7f29f8179530 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 10 monclient: dump: 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f29e80c4920 con 0x7f29f8179530 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 msgr2=0x7f29f8059e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 0x7f29f8059e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29e801c520 tx=0x7f29e8009300 comp rx=0 tx=0).stop 2026-02-22T20:55:37.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 msgr2=0x7f29f8059e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29ed7fa640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f8179530 0x7f29f8059e00 secure :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29e801c520 tx=0x7f29e8009300 comp rx=0 tx=0).stop 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 216866, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:37.744 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.745 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.746 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.747 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:37.748 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 >> v2:10.20.193.61:6800/2336688312 conn(0x7f29c803aad0 msgr2=0x7f29c805af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 --2- 10.20.193.7:0/1029890012 >> v2:10.20.193.61:6800/2336688312 conn(0x7f29c803aad0 0x7f29c805af80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009750 tx=0x7f29f40098b0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 10 monclient: shutdown 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f815f6c0 msgr2=0x7f29f807be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 --2- 10.20.193.7:0/1029890012 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f29f815f6c0 0x7f29f807be30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f29e0002770 tx=0x7f29e000c960 comp rx=0 tx=0).stop 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fd762640 1 -- 10.20.193.7:0/1029890012 reap_dead start 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fd762640 1 -- 10.20.193.7:0/1029890012 reap_dead start 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 shutdown_connections 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 >> 10.20.193.7:0/1029890012 conn(0x7f29f808e050 msgr2=0x7f29f8088950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 shutdown_connections 2026-02-22T20:55:37.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.737+0000 7f29fdf63640 1 -- 10.20.193.7:0/1029890012 wait complete. 2026-02-22T20:55:37.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:37.752 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:55:37.752 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:55:37.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: get_monmap_and_config 2026-02-22T20:55:37.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: monmap: 2026-02-22T20:55:37.810 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.810 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:37.810440+0000 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:37.810440+0000 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:37.811 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 Processor -- start 2026-02-22T20:55:37.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 -- start start 2026-02-22T20:55:37.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: init 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f290808b590 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f290813a6a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f290817fa90 0x7f290819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): picked mon.noname-a con 0x7f290817fa90 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2908089920 con 0x7f290808b590 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290808a860 con 0x7f290813a6a0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f290813aad0 con 0x7f290817fa90 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f2910310640 10 monclient(hunting): authenticate will time out at 750.283477s 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e085640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f290808b590 0x7f2908139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48790/0 (socket says 10.20.193.7:48790) 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e085640 1 -- 10.20.193.7:0/2468164553 learned_addr learned my addr 10.20.193.7:0/2468164553 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 1 --2- 10.20.193.7:0/2468164553 >> v2:10.20.193.7:3300/0 conn(0x7f290817fa90 0x7f290819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): get_auth_request con 0x7f290817fa90 auth_method 0 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient(hunting): handle_auth_done global_id 5457 payload 274 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 1 -- 10.20.193.7:0/2468164553 >> v1:10.20.193.61:6789/0 conn(0x7f290813a6a0 legacy=0x7f290817e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 1 -- 10.20.193.7:0/2468164553 >> v1:10.20.193.7:6789/0 conn(0x7f290808b590 legacy=0x7f2908139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.805+0000 7f290e886640 1 -- 10.20.193.7:0/2468164553 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2908089170 con 0x7f290817fa90 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e886640 1 --2- 10.20.193.7:0/2468164553 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290817fa90 0x7f290819fe70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2904004b00 tx=0x7f290401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9503596dcb7d05 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 1 -- 10.20.193.7:0/2468164553 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29040b2070 con 0x7f290817fa90 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: dump: 2026-02-22T20:55:37.815 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 1 -- 10.20.193.7:0/2468164553 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29040a5800 con 0x7f290817fa90 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 1 -- 10.20.193.7:0/2468164553 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29040a5bf0 con 0x7f290817fa90 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 5 monclient: authenticate success, global_id 5457 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 4 set_mon_vals no callback set 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d083640 10 monclient: dump: 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: shutdown 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/2468164553 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290817fa90 msgr2=0x7f290819fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- 10.20.193.7:0/2468164553 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290817fa90 0x7f290819fe70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2904004b00 tx=0x7f290401c830 comp rx=0 tx=0).stop 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/2468164553 shutdown_connections 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- 10.20.193.7:0/2468164553 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290817fa90 0x7f290819fe70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/2468164553 >> 10.20.193.7:0/2468164553 conn(0x7f290808faa0 msgr2=0x7f290808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/2468164553 shutdown_connections 2026-02-22T20:55:37.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/2468164553 wait complete. 2026-02-22T20:55:37.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: monmap: 2026-02-22T20:55:37.822 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.822 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:37.822 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 Processor -- start 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- start start 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: init 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 0x7f290819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): picked mon.noname-a con 0x7f290808b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290813a6a0 0x7f290819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): picked mon.noname-c con 0x7f290813a6a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f290817fa90 0x7f290819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): picked mon.noname-b con 0x7f290817fa90 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:37.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29081a2f60 con 0x7f290808b590 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f29081a2de0 con 0x7f290817fa90 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f29081a30e0 con 0x7f290813a6a0 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): authenticate will time out at 750.286836s 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 0x7f290819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 0x7f290819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40260/0 (socket says 10.20.193.7:40260) 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 -- 10.20.193.7:0/3545669159 learned_addr learned my addr 10.20.193.7:0/3545669159 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): get_auth_request con 0x7f290808b590 auth_method 0 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290813a6a0 0x7f290819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): get_auth_request con 0x7f290813a6a0 auth_method 0 2026-02-22T20:55:37.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient(hunting): handle_auth_done global_id 5463 payload 824 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e886640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f290817fa90 0x7f290819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290813a6a0 msgr2=0x7f290819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290813a6a0 0x7f290819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f290817fa90 msgr2=0x7f290819e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f290817fa90 0x7f290819e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290819f0a0 con 0x7f290808b590 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e886640 10 monclient: get_auth_request con 0x7f290817fa90 auth_method 0 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e886640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f290817fa90 0x7f290819e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290e085640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 0x7f290819d6b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c700 tx=0x7f28f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.825 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8017070 con 0x7f290808b590 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: dump: 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f8005bd0 con 0x7f290808b590 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8007070 con 0x7f290808b590 2026-02-22T20:55:37.826 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f28eeffd640 10 monclient: dump: 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 5 monclient: authenticate success, global_id 5463 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290c882640 4 set_mon_vals no callback set 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _renew_subs 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2908126b50 con 0x7f290808b590 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _renew_subs 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290819fdd0 con 0x7f290808b590 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 0x7f290818bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f29080382a0 con 0x7f290818bb70 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 0x7f290818bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient: get_auth_request con 0x7f290818bb70 auth_method 0 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.809+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290d884640 10 monclient(hunting): handle_auth_done global_id 64346 payload 824 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290d884640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2908139f90 con 0x7f290818bb70 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290d884640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 0x7f290818bf40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc00fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f28f8007210 con 0x7f290808b590 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 --2- 10.20.193.7:0/3545669159 >> v2:10.20.193.61:6800/2336688312 conn(0x7f28d803aae0 0x7f28d805af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(118..118 src has 64..118) ==== 3897+0+0 (secure 0 0 0) 0x7f28f804def0 con 0x7f290808b590 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc018020 con 0x7f290818bb70 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:37.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 10 monclient: dump: 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f28fc00d7a0 con 0x7f290818bb70 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 msgr2=0x7f290818bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 0x7f290818bf40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc00fc00 comp rx=0 tx=0).stop 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 msgr2=0x7f290818bf40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f28eeffd640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290818bb70 0x7f290818bf40 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc00fc00 comp rx=0 tx=0).stop 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290e886640 1 --2- 10.20.193.7:0/3545669159 >> v2:10.20.193.61:6800/2336688312 conn(0x7f28d803aae0 0x7f28d805af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290e886640 10 monclient: get_auth_request con 0x7f28d803aae0 auth_method 0 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f290e886640 1 --2- 10.20.193.7:0/3545669159 >> v2:10.20.193.61:6800/2336688312 conn(0x7f28d803aae0 0x7f28d805af90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f290401a460 tx=0x7f29040a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f2910310640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f2910310640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 0x7f290805b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f2910310640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.813+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f290805fc70 con 0x7f290805aed0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 0x7f290805b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient: get_auth_request con 0x7f290805aed0 auth_method 0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 10 monclient(hunting): handle_auth_done global_id 64349 payload 824 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 1 -- 10.20.193.7:0/3545669159 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f290805b7e0 con 0x7f290805aed0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290d884640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 0x7f290805b2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc018040 con 0x7f290805aed0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 10 monclient: dump: 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.830 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f28fc014bd0 con 0x7f290805aed0 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 msgr2=0x7f290805b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 0x7f290805b2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc007f90 comp rx=0 tx=0).stop 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 msgr2=0x7f290805b2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f28eeffd640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f290805aed0 0x7f290805b2a0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0037b0 tx=0x7f28fc007f90 comp rx=0 tx=0).stop 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:37.831 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 63421, 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.832 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.833 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.834 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.835 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.836 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:37.837 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.838 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:37.839 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 >> v2:10.20.193.61:6800/2336688312 conn(0x7f28d803aae0 msgr2=0x7f28d805af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 --2- 10.20.193.7:0/3545669159 >> v2:10.20.193.61:6800/2336688312 conn(0x7f28d803aae0 0x7f28d805af90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f290401a460 tx=0x7f29040a7070 comp rx=0 tx=0).stop 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 10 monclient: shutdown 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 msgr2=0x7f290819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 --2- 10.20.193.7:0/3545669159 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f290808b590 0x7f290819d6b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c700 tx=0x7f28f800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290e886640 1 -- 10.20.193.7:0/3545669159 reap_dead start 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f290e886640 1 -- 10.20.193.7:0/3545669159 reap_dead start 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 shutdown_connections 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 >> 10.20.193.7:0/3545669159 conn(0x7f290808faa0 msgr2=0x7f290808e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 shutdown_connections 2026-02-22T20:55:37.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.817+0000 7f2910310640 1 -- 10.20.193.7:0/3545669159 wait complete. 2026-02-22T20:55:37.840 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:37.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:55:37.841 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: get_monmap_and_config 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: monmap: 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:37.907915+0000 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:37.907915+0000 2026-02-22T20:55:37.908 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:37.909 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 Processor -- start 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- start start 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: init 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-22T20:55:37.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f678c13f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-c con 0x7f678c13fd70 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f678c180d00 0x7f678c1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-a con 0x7f678c180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c08fd70 con 0x7f678c13f290 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f678c08e1f0 con 0x7f678c180d00 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f678c08ec90 con 0x7f678c13fd70 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient(hunting): authenticate will time out at 750.381062s 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6791f5e640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f678c13f290 0x7f678c13f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:48794/0 (socket says 10.20.193.7:48794) 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6791f5e640 1 -- 10.20.193.7:0/195618005 learned_addr learned my addr 10.20.193.7:0/195618005 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 --2- 10.20.193.7:0/195618005 >> v2:10.20.193.7:3300/0 conn(0x7f678c180d00 0x7f678c1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): get_auth_request con 0x7f678c180d00 auth_method 0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679175d640 1 --2- 10.20.193.7:0/195618005 >> v2:10.20.193.61:3300/0 conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679175d640 10 monclient(hunting): get_auth_request con 0x7f678c13fd70 auth_method 0 2026-02-22T20:55:37.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679175d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679175d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679175d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient(hunting): handle_auth_done global_id 5466 payload 274 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 -- 10.20.193.7:0/195618005 >> v2:10.20.193.61:3300/0 conn(0x7f678c13fd70 msgr2=0x7f678c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 --2- 10.20.193.7:0/195618005 >> v2:10.20.193.61:3300/0 conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 -- 10.20.193.7:0/195618005 >> v1:10.20.193.7:6789/0 conn(0x7f678c13f290 legacy=0x7f678c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 -- 10.20.193.7:0/195618005 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c092bc0 con 0x7f678c180d00 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f679275f640 1 --2- 10.20.193.7:0/195618005 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c180d00 0x7f678c1a10e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f678c092f70 tx=0x7f678801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5218221214ae1e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 1 -- 10.20.193.7:0/195618005 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880b2070 con 0x7f678c180d00 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: dump: 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.921 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 1 -- 10.20.193.7:0/195618005 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880a5910 con 0x7f678c180d00 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 5 monclient: authenticate success, global_id 5466 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 1 -- 10.20.193.7:0/195618005 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880a5d00 con 0x7f678c180d00 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f6790f5c640 10 monclient: dump: 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 4 set_mon_vals no callback set 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 10 monclient: shutdown 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- 10.20.193.7:0/195618005 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c180d00 msgr2=0x7f678c1a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 --2- 10.20.193.7:0/195618005 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c180d00 0x7f678c1a10e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f678c092f70 tx=0x7f678801c850 comp rx=0 tx=0).stop 2026-02-22T20:55:37.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- 10.20.193.7:0/195618005 shutdown_connections 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 --2- 10.20.193.7:0/195618005 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c180d00 0x7f678c1a10e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 --2- 10.20.193.7:0/195618005 >> v2:10.20.193.61:3300/0 conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- 10.20.193.7:0/195618005 >> 10.20.193.7:0/195618005 conn(0x7f678c093df0 msgr2=0x7f678c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- 10.20.193.7:0/195618005 shutdown_connections 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.905+0000 7f67941e9640 1 -- 10.20.193.7:0/195618005 wait complete. 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: build_initial_monmap 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: monmap: 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 Processor -- start 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- start start 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: init 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-a con 0x7f678c13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-b con 0x7f678c13fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f678c180d00 0x7f678c12bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): picked mon.noname-c con 0x7f678c180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f678c1a4050 con 0x7f678c13f290 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f678c090da0 con 0x7f678c13fd70 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f678c1a41d0 con 0x7f678c180d00 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:37.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): authenticate will time out at 750.384951s 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40280/0 (socket says 10.20.193.7:40280) 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 -- 10.20.193.7:0/2398095229 learned_addr learned my addr 10.20.193.7:0/2398095229 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): get_auth_request con 0x7f678c13f290 auth_method 0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f678c180d00 0x7f678c12bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): get_auth_request con 0x7f678c180d00 auth_method 0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient(hunting): handle_auth_done global_id 5472 payload 824 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f678c180d00 msgr2=0x7f678c12bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f678c180d00 0x7f678c12bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c13fd70 msgr2=0x7f678c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient: _finish_hunting 0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 monclient: found mon.noname-a 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c10c6c0 con 0x7f678c13f290 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient: get_auth_request con 0x7f678c13fd70 auth_method 0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c13fd70 0x7f678c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f6791f5e640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f677c00c700 tx=0x7f677c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c017070 con 0x7f678c13f290 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: dump: 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.925 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c005bd0 con 0x7f678c13f290 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 5 monclient: authenticate success, global_id 5472 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _renew_subs 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678c10b1d0 con 0x7f678c13f290 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c007070 con 0x7f678c13f290 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: dump: 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677bfff640 4 set_mon_vals no callback set 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _renew_subs 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678c10cc90 con 0x7f678c13f290 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 0x7f678c10a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f678c13f660 con 0x7f678c109e40 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f677c007210 con 0x7f678c13f290 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 --2- 10.20.193.7:0/2398095229 >> v2:10.20.193.61:6800/2336688312 conn(0x7f675c03ab10 0x7f675c05afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 0x7f678c10a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(118..118 src has 64..118) ==== 3897+0+0 (secure 0 0 0) 0x7f677c04df30 con 0x7f678c13f290 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient: get_auth_request con 0x7f678c109e40 auth_method 0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 1 --2- 10.20.193.7:0/2398095229 >> v2:10.20.193.61:6800/2336688312 conn(0x7f675c03ab10 0x7f675c05afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 10 monclient: get_auth_request con 0x7f675c03ab10 auth_method 0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 10 monclient(hunting): handle_auth_done global_id 74119 payload 824 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f678c10d400 con 0x7f678c109e40 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679275f640 1 --2- 10.20.193.7:0/2398095229 >> v2:10.20.193.61:6800/2336688312 conn(0x7f675c03ab10 0x7f675c05afc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6788009b40 tx=0x7f67880a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 0x7f678c10a240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6780004780 tx=0x7f678000f970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780018020 con 0x7f678c109e40 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: dump: 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f6780004440 con 0x7f678c109e40 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 msgr2=0x7f678c10a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 0x7f678c10a240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6780004780 tx=0x7f678000f970 comp rx=0 tx=0).stop 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 msgr2=0x7f678c10a240 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.909+0000 7f677a7fc640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c109e40 0x7f678c10a240 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6780004780 tx=0x7f678000f970 comp rx=0 tx=0).stop 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f67941e9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f67941e9640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 0x7f678c08bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f67941e9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f678c10aba0 con 0x7f678c10a780 2026-02-22T20:55:37.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 0x7f678c08bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient: get_auth_request con 0x7f678c10a780 auth_method 0 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 10 monclient(hunting): handle_auth_done global_id 74122 payload 824 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 1 -- 10.20.193.7:0/2398095229 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f678c10bf90 con 0x7f678c10a780 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.913+0000 7f679175d640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 0x7f678c08bc00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6780016000 tx=0x7f67800047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780014500 con 0x7f678c10a780 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 10 monclient: dump: 2026-02-22T20:55:37.928 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7f6780014500 con 0x7f678c10a780 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 msgr2=0x7f678c08bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 0x7f678c08bc00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6780016000 tx=0x7f67800047b0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 msgr2=0x7f678c08bc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f677a7fc640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f678c10a780 0x7f678c08bc00 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6780016000 tx=0x7f67800047b0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 32, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 5304, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:37.929 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:37.930 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.931 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.932 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:37.933 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20136]: starting. 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20136]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20058 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20136]: shutting down. 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:37.934 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 >> v2:10.20.193.61:6800/2336688312 conn(0x7f675c03ab10 msgr2=0x7f675c05afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 --2- 10.20.193.7:0/2398095229 >> v2:10.20.193.61:6800/2336688312 conn(0x7f675c03ab10 0x7f675c05afc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6788009b40 tx=0x7f67880a7070 comp rx=0 tx=0).stop 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 10 monclient: shutdown 2026-02-22T20:55:37.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 msgr2=0x7f678c12c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f677c00c700 tx=0x7f677c00cbc0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f679275f640 1 -- 10.20.193.7:0/2398095229 reap_dead start 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 shutdown_connections 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 --2- 10.20.193.7:0/2398095229 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f678c13f290 0x7f678c12c6e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 >> 10.20.193.7:0/2398095229 conn(0x7f678c093df0 msgr2=0x7f678c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 shutdown_connections 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:37.917+0000 7f67941e9640 1 -- 10.20.193.7:0/2398095229 wait complete. 2026-02-22T20:55:37.935 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:55:37.935 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-22T20:55:37.935 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:55:37.935 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-22T20:55:37.935 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-22T20:55:37.935 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T20:55:37.935 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:55:37.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:55:37.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:55:37.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:55:37.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:55:37.950 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:55:37.950 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T20:55:37.950 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:55:37.951 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:37.951 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:55:38.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.045+0000 7f09c3e92640 10 monclient: get_monmap_and_config 2026-02-22T20:55:38.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.045+0000 7f09c3e92640 10 monclient: build_initial_monmap 2026-02-22T20:55:38.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.045+0000 7f09c3e92640 10 monclient: monmap: 2026-02-22T20:55:38.051 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:38.051299+0000 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:38.051299+0000 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:38.052 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.045+0000 7f09c3e92640 1 Processor -- start 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- start start 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient: init 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f09bc13be70 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-b con 0x7f09bc13c950 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f09bc17d950 0x7f09bc19dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-c con 0x7f09bc17d950 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc0875d0 con 0x7f09bc13be70 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f09bc0878b0 con 0x7f09bc17d950 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f09bc08b780 con 0x7f09bc13c950 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1c07640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f09bc13be70 legacy=0x7f09bc13c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient(hunting): authenticate will time out at 750.524583s 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:35048/0 (socket says 10.20.193.7:35048) 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 -- 10.20.193.7:0/532947560 learned_addr learned my addr 10.20.193.7:0/532947560 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): get_auth_request con 0x7f09bc13c950 auth_method 0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 1 --2- 10.20.193.7:0/532947560 >> v2:10.20.193.61:3300/0 conn(0x7f09bc17d950 0x7f09bc19dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): get_auth_request con 0x7f09bc17d950 auth_method 0 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:38.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient(hunting): handle_auth_done global_id 64358 payload 274 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 -- 10.20.193.7:0/532947560 >> v2:10.20.193.61:3300/0 conn(0x7f09bc17d950 msgr2=0x7f09bc19dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 --2- 10.20.193.7:0/532947560 >> v2:10.20.193.61:3300/0 conn(0x7f09bc17d950 0x7f09bc19dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 -- 10.20.193.7:0/532947560 >> v1:10.20.193.7:6789/0 conn(0x7f09bc13be70 legacy=0x7f09bc13c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient: _finish_hunting 0 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 monclient: found mon.noname-b 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 -- 10.20.193.7:0/532947560 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc0872f0 con 0x7f09bc13c950 2026-02-22T20:55:38.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c1406640 1 --2- 10.20.193.7:0/532947560 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09b00090a0 tx=0x7f09b001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a19ea7ace7d222b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:38.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 1 -- 10.20.193.7:0/532947560 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00b0070 con 0x7f09bc13c950 2026-02-22T20:55:38.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:38.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: dump: 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: _finish_auth 0 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: _check_auth_tickets 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 1 -- 10.20.193.7:0/532947560 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b00ab600 con 0x7f09bc13c950 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 1 -- 10.20.193.7:0/532947560 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00ab9d0 con 0x7f09bc13c950 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c0c05640 10 monclient: dump: 2026-02-22T20:55:38.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 5 monclient: authenticate success, global_id 64358 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 4 set_mon_vals no callback set 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 10 monclient: shutdown 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- 10.20.193.7:0/532947560 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 msgr2=0x7f09bc17d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 --2- 10.20.193.7:0/532947560 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09b00090a0 tx=0x7f09b001c500 comp rx=0 tx=0).stop 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- 10.20.193.7:0/532947560 shutdown_connections 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 --2- 10.20.193.7:0/532947560 >> v2:10.20.193.61:3300/0 conn(0x7f09bc17d950 0x7f09bc19dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 --2- 10.20.193.7:0/532947560 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- 10.20.193.7:0/532947560 >> 10.20.193.7:0/532947560 conn(0x7f09bc08f860 msgr2=0x7f09bc08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:38.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- 10.20.193.7:0/532947560 shutdown_connections 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.049+0000 7f09c3e92640 1 -- 10.20.193.7:0/532947560 wait complete. 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: build_initial_monmap 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: monmap: 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 Processor -- start 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- start start 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: init 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f09bc13be70 0x7f09bc19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-b con 0x7f09bc13be70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:38.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-a con 0x7f09bc13c950 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): picked mon.noname-c con 0x7f09bc17d950 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc19ee10 con 0x7f09bc13c950 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc19ec90 con 0x7f09bc13be70 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f09bc19ef90 con 0x7f09bc17d950 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient(hunting): authenticate will time out at 750.528855s 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1406640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 msgr2=0x7f09bc17d410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1406640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:35050/0 (socket says 10.20.193.7:35050) 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 -- 10.20.193.7:0/2643130577 learned_addr learned my addr 10.20.193.7:0/2643130577 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): get_auth_request con 0x7f09bc17d950 auth_method 0 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:38.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f09bc13be70 0x7f09bc19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): get_auth_request con 0x7f09bc13be70 auth_method 0 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient(hunting): handle_auth_done global_id 64361 payload 824 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 -- 10.20.193.7:0/2643130577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f09bc13be70 msgr2=0x7f09bc19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f09bc13be70 0x7f09bc19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 -- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 msgr2=0x7f09bc17d410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient: _finish_hunting 0 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 monclient: found mon.noname-c 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 -- 10.20.193.7:0/2643130577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc088bd0 con 0x7f09bc17d950 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c2408640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009cc0 tx=0x7f09b800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:38.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8018030 con 0x7f09bc17d950 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: dump: 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b800cd30 con 0x7f09bc17d950 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8003c90 con 0x7f09bc17d950 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 5 monclient: authenticate success, global_id 64361 2026-02-22T20:55:38.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _renew_subs 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc128480 con 0x7f09bc17d950 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09abfff640 4 set_mon_vals no callback set 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 10 monclient: dump: 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _renew_subs 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc12a7e0 con 0x7f09bc17d950 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:38.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc13c240 con 0x7f09bc17d950 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f09b8025060 con 0x7f09bc17d950 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 --2- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 0x7f098c05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(119..119 src has 64..119) ==== 3503+0+0 (secure 0 0 0) 0x7f09b804f0a0 con 0x7f09bc17d950 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 1 --2- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 0x7f098c05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 10 monclient: get_auth_request con 0x7f098c03aa90 auth_method 0 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.053+0000 7f09c1c07640 1 --2- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 0x7f098c05af40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006fd0 tx=0x7f09ac009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.057+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f09b8010040 con 0x7f09bc17d950 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.057+0000 7f09aa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:38.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.057+0000 7f09aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f09bc0008e0 con 0x7f09bc17d950 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09aa7fc640 1 -- 10.20.193.7:0/2643130577 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f09bc0008e0 con 0x7f09bc17d950 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09aa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:38.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 msgr2=0x7f098c05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 0x7f098c05af40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006fd0 tx=0x7f09ac009210 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 10 monclient: shutdown 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 msgr2=0x7f09bc19a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009cc0 tx=0x7f09b800c490 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 shutdown_connections 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f09bc17d950 0x7f09bc19a940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f09bc13c950 0x7f09bc17d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> v2:10.20.193.61:6800/2336688312 conn(0x7f098c03aa90 0x7f098c05af40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 --2- 10.20.193.7:0/2643130577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f09bc13be70 0x7f09bc19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.165+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 >> 10.20.193.7:0/2643130577 conn(0x7f09bc08f860 msgr2=0x7f09bc089d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.169+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 shutdown_connections 2026-02-22T20:55:38.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:38.169+0000 7f09c3e92640 1 -- 10.20.193.7:0/2643130577 wait complete. 2026-02-22T20:55:41.182 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:41.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: get_monmap_and_config 2026-02-22T20:55:41.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: build_initial_monmap 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: monmap: 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:41.253855+0000 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:41.253855+0000 2026-02-22T20:55:41.271 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 Processor -- start 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 -- start start 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: init 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f32e013cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-c con 0x7f32e013d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-b con 0x7f32e017e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e005d510 con 0x7f32e013cef0 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f32e008ad70 con 0x7f32e013d9d0 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:41.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f32e008b850 con 0x7f32e017e9a0 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32e54c0640 10 monclient(hunting): authenticate will time out at 753.726811s 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48130/0 (socket says 10.20.193.7:48130) 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 -- 10.20.193.7:0/3146989791 learned_addr learned my addr 10.20.193.7:0/3146989791 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): get_auth_request con 0x7f32e017e9a0 auth_method 0 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32de7fc640 1 --2- 10.20.193.7:0/3146989791 >> v2:10.20.193.61:3300/0 conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32de7fc640 10 monclient(hunting): get_auth_request con 0x7f32e013d9d0 auth_method 0 2026-02-22T20:55:41.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient(hunting): handle_auth_done global_id 64364 payload 274 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 -- 10.20.193.7:0/3146989791 >> v2:10.20.193.61:3300/0 conn(0x7f32e013d9d0 msgr2=0x7f32e017e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 --2- 10.20.193.7:0/3146989791 >> v2:10.20.193.61:3300/0 conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 -- 10.20.193.7:0/3146989791 >> v1:10.20.193.61:6789/0 conn(0x7f32e013cef0 legacy=0x7f32e013d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 monclient: found mon.noname-b 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.249+0000 7f32df7fe640 1 -- 10.20.193.7:0/3146989791 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e008a770 con 0x7f32e017e9a0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 1 --2- 10.20.193.7:0/3146989791 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009580 tx=0x7f32d001c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db9a589b760ef0a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 1 -- 10.20.193.7:0/3146989791 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d00b2070 con 0x7f32e017e9a0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:41.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: dump: 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 1 -- 10.20.193.7:0/3146989791 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d00a58c0 con 0x7f32e017e9a0 2026-02-22T20:55:41.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 1 -- 10.20.193.7:0/3146989791 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d00a5cb0 con 0x7f32e017e9a0 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 5 monclient: authenticate success, global_id 64364 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 4 set_mon_vals no callback set 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32ddffb640 10 monclient: dump: 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:41.277 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: shutdown 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3146989791 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 msgr2=0x7f32e019ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3146989791 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009580 tx=0x7f32d001c8f0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3146989791 shutdown_connections 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3146989791 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e017e9a0 0x7f32e019ed80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3146989791 >> v2:10.20.193.61:3300/0 conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3146989791 >> 10.20.193.7:0/3146989791 conn(0x7f32e008f860 msgr2=0x7f32e008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3146989791 shutdown_connections 2026-02-22T20:55:41.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3146989791 wait complete. 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: build_initial_monmap 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: monmap: 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 Processor -- start 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- start start 2026-02-22T20:55:41.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: init 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 0x7f32e010ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-a con 0x7f32e013cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-c con 0x7f32e013d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 0x7f32e0127ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): picked mon.noname-b con 0x7f32e017e9a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01a1ec0 con 0x7f32e013cef0 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f32e01a1d40 con 0x7f32e017e9a0 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f32e01a2040 con 0x7f32e013d9d0 2026-02-22T20:55:41.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient(hunting): authenticate will time out at 753.730425s 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32deffd640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 msgr2=0x7f32e010ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32deffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 0x7f32e010ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48146/0 (socket says 10.20.193.7:48146) 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 -- 10.20.193.7:0/3091095153 learned_addr learned my addr 10.20.193.7:0/3091095153 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): get_auth_request con 0x7f32e013d9d0 auth_method 0 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 0x7f32e0127ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:41.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 10 monclient(hunting): get_auth_request con 0x7f32e017e9a0 auth_method 0 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient(hunting): handle_auth_done global_id 64367 payload 824 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 -- 10.20.193.7:0/3091095153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 msgr2=0x7f32e0127ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 0x7f32e0127ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 -- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 msgr2=0x7f32e010ac80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 0x7f32e010ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 monclient: found mon.noname-c 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 -- 10.20.193.7:0/3091095153 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e010c480 con 0x7f32e013d9d0 2026-02-22T20:55:41.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32df7fe640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 0x7f32e0127ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32de7fc640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32c8006b80 tx=0x7f32c800ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8017070 con 0x7f32e013d9d0 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: dump: 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:41.283 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c800ee50 con 0x7f32e013d9d0 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c800f040 con 0x7f32e013d9d0 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 10 monclient: dump: 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:41.284 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 5 monclient: authenticate success, global_id 64367 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32dd7fa640 4 set_mon_vals no callback set 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _renew_subs 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e010b610 con 0x7f32e013d9d0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _renew_subs 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e0109ad0 con 0x7f32e013d9d0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e00382a0 con 0x7f32e013d9d0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f32c8012050 con 0x7f32e013d9d0 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.253+0000 7f32bf7fe640 1 --2- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 0x7f32ac05af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:41.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(119..119 src has 64..119) ==== 3503+0+0 (secure 0 0 0) 0x7f32c804e410 con 0x7f32e013d9d0 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32deffd640 1 --2- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 0x7f32ac05af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32deffd640 10 monclient: get_auth_request con 0x7f32ac03aa80 auth_method 0 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32deffd640 1 --2- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 0x7f32ac05af30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32e005d6e0 tx=0x7f32d4007b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f32c800a0d0 con 0x7f32e013d9d0 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:41.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.257+0000 7f32bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:41.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f32e005fc00 con 0x7f32e013d9d0 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32bf7fe640 1 -- 10.20.193.7:0/3091095153 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f32c800a320 con 0x7f32e013d9d0 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:41.375 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 msgr2=0x7f32ac05af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 0x7f32ac05af30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32e005d6e0 tx=0x7f32d4007b30 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 10 monclient: shutdown 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 msgr2=0x7f32e017e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32c8006b80 tx=0x7f32c800ec00 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 shutdown_connections 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32ac03aa80 0x7f32ac05af30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32e017e9a0 0x7f32e0127ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32e013d9d0 0x7f32e017e460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 --2- 10.20.193.7:0/3091095153 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32e013cef0 0x7f32e010ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 >> 10.20.193.7:0/3091095153 conn(0x7f32e008f860 msgr2=0x7f32e005cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 shutdown_connections 2026-02-22T20:55:41.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:41.369+0000 7f32e54c0640 1 -- 10.20.193.7:0/3091095153 wait complete. 2026-02-22T20:55:41.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:41.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:44.386 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: get_monmap_and_config 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: build_initial_monmap 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: monmap: 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:44.449776+0000 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:44.449776+0000 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:44.450 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 Processor -- start 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 -- start start 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: init 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1dcc13f430 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1dcc057850 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1dcc181c10 0x7f1dcc1a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-c con 0x7f1dcc181c10 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc08d840 con 0x7f1dcc057850 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc055c10 con 0x7f1dcc13f430 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc08db20 con 0x7f1dcc181c10 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dcb7fe640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f1dcc057850 legacy=0x7f1dcc1804f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd2462640 10 monclient(hunting): authenticate will time out at 756.922738s 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dcbfff640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f1dcc13f430 0x7f1dcc057140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:41032/0 (socket says 10.20.193.7:41032) 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dcbfff640 1 -- 10.20.193.7:0/3000971433 learned_addr learned my addr 10.20.193.7:0/3000971433 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 1 --2- 10.20.193.7:0/3000971433 >> v2:10.20.193.61:3300/0 conn(0x7f1dcc181c10 0x7f1dcc1a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): get_auth_request con 0x7f1dcc181c10 auth_method 0 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient(hunting): handle_auth_done global_id 74155 payload 274 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 1 -- 10.20.193.7:0/3000971433 >> v1:10.20.193.61:6789/0 conn(0x7f1dcc13f430 legacy=0x7f1dcc057140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:44.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 1 -- 10.20.193.7:0/3000971433 >> v1:10.20.193.7:6789/0 conn(0x7f1dcc057850 legacy=0x7f1dcc1804f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient: _finish_hunting 0 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 1 monclient: found mon.noname-c 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.444+0000 7f1dd09d8640 1 -- 10.20.193.7:0/3000971433 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc13f800 con 0x7f1dcc181c10 2026-02-22T20:55:44.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd09d8640 1 --2- 10.20.193.7:0/3000971433 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc181c10 0x7f1dcc1a1ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0004b00 tx=0x7f1dc001c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96d6856960737e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 1 -- 10.20.193.7:0/3000971433 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00b2070 con 0x7f1dcc181c10 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: dump: 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:44.453 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: _finish_auth 0 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: _check_auth_tickets 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 1 -- 10.20.193.7:0/3000971433 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc00a5800 con 0x7f1dcc181c10 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 1 -- 10.20.193.7:0/3000971433 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00a5bf0 con 0x7f1dcc181c10 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 5 monclient: authenticate success, global_id 74155 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 4 set_mon_vals no callback set 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcaffd640 10 monclient: dump: 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: shutdown 2026-02-22T20:55:44.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/3000971433 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc181c10 msgr2=0x7f1dcc1a1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 --2- 10.20.193.7:0/3000971433 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc181c10 0x7f1dcc1a1ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0004b00 tx=0x7f1dc001c830 comp rx=0 tx=0).stop 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/3000971433 shutdown_connections 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 --2- 10.20.193.7:0/3000971433 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc181c10 0x7f1dcc1a1ff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/3000971433 >> 10.20.193.7:0/3000971433 conn(0x7f1dcc091690 msgr2=0x7f1dcc091a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/3000971433 shutdown_connections 2026-02-22T20:55:44.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/3000971433 wait complete. 2026-02-22T20:55:44.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: build_initial_monmap 2026-02-22T20:55:44.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: monmap: 2026-02-22T20:55:44.457 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 Processor -- start 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- start start 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: init 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-c con 0x7f1dcc057850 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc13f430 0x7f1dcc108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-b con 0x7f1dcc13f430 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 0x7f1dcc108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:44.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): picked mon.noname-a con 0x7f1dcc181c10 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a50e0 con 0x7f1dcc181c10 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a4f60 con 0x7f1dcc13f430 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a5260 con 0x7f1dcc057850 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient(hunting): authenticate will time out at 756.926597s 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd09d8640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 msgr2=0x7f1dcc108590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd09d8640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 0x7f1dcc108590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48156/0 (socket says 10.20.193.7:48156) 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 -- 10.20.193.7:0/1041986967 learned_addr learned my addr 10.20.193.7:0/1041986967 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): get_auth_request con 0x7f1dcc057850 auth_method 0 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcb7fe640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc13f430 0x7f1dcc108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:44.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcb7fe640 10 monclient(hunting): get_auth_request con 0x7f1dcc13f430 auth_method 0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient(hunting): handle_auth_done global_id 64370 payload 824 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 -- 10.20.193.7:0/1041986967 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc13f430 msgr2=0x7f1dcc108050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc13f430 0x7f1dcc108050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 -- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 msgr2=0x7f1dcc108590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 0x7f1dcc108590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 monclient: found mon.noname-c 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 -- 10.20.193.7:0/1041986967 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc10b280 con 0x7f1dcc057850 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dcbfff640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c700 tx=0x7f1db800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8017070 con 0x7f1dcc057850 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: dump: 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: _finish_auth 0 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:44.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db8005bd0 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8007070 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 5 monclient: authenticate success, global_id 64370 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 10 monclient: dump: 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dca7fc640 4 set_mon_vals no callback set 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _renew_subs 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc0886b0 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _renew_subs 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc10afa0 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc057140 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.448+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1db8007210 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dc8ff9640 1 --2- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 0x7f1d9c05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(119..119 src has 64..119) ==== 3503+0+0 (secure 0 0 0) 0x7f1db804ddf0 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dcb7fe640 1 --2- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 0x7f1d9c05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dcb7fe640 10 monclient: get_auth_request con 0x7f1d9c03aa90 auth_method 0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dcb7fe640 1 --2- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 0x7f1d9c05af40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc05de20 tx=0x7f1dbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1db804cd30 con 0x7f1dcc057850 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dc8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:44.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.452+0000 7f1dc8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:44.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:44.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:44.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:44.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1dcc109a80 con 0x7f1dcc057850 2026-02-22T20:55:44.572 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dc8ff9640 1 -- 10.20.193.7:0/1041986967 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f1db804ae20 con 0x7f1dcc057850 2026-02-22T20:55:44.572 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dc8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:44.572 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dc8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:44.572 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:44.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 msgr2=0x7f1d9c05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:44.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 0x7f1d9c05af40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc05de20 tx=0x7f1dbc008040 comp rx=0 tx=0).stop 2026-02-22T20:55:44.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 10 monclient: shutdown 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 msgr2=0x7f1dcc107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c700 tx=0x7f1db800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 shutdown_connections 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1dcc181c10 0x7f1dcc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d9c03aa90 0x7f1d9c05af40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1dcc13f430 0x7f1dcc108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 --2- 10.20.193.7:0/1041986967 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1dcc057850 0x7f1dcc107b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 >> 10.20.193.7:0/1041986967 conn(0x7f1dcc091690 msgr2=0x7f1dcc08df50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 shutdown_connections 2026-02-22T20:55:44.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:44.564+0000 7f1dd2462640 1 -- 10.20.193.7:0/1041986967 wait complete. 2026-02-22T20:55:46.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:46.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:47.583 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:47.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: get_monmap_and_config 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: build_initial_monmap 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: monmap: 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:47.654633+0000 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:47.654633+0000 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:47.655 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 Processor -- start 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 -- start start 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: init 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f567408c7a0 0x7f5674090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-c con 0x7f567408c7a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-b con 0x7f56740909a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f567417f6d0 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f567408d840 con 0x7f567417f6d0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f56740912b0 con 0x7f567408c7a0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f567408db20 con 0x7f56740909a0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567ac96640 10 monclient(hunting): authenticate will time out at 760.127514s 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f567920c640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f567417f6d0 legacy=0x7f567419fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48160/0 (socket says 10.20.193.7:48160) 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 -- 10.20.193.7:0/2668261904 learned_addr learned my addr 10.20.193.7:0/2668261904 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): get_auth_request con 0x7f56740909a0 auth_method 0 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:47.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f5678a0b640 1 --2- 10.20.193.7:0/2668261904 >> v2:10.20.193.61:3300/0 conn(0x7f567408c7a0 0x7f5674090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f5678a0b640 10 monclient(hunting): get_auth_request con 0x7f567408c7a0 auth_method 0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f5678a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f5678a0b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f5678a0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient(hunting): handle_auth_done global_id 64373 payload 274 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 -- 10.20.193.7:0/2668261904 >> v2:10.20.193.61:3300/0 conn(0x7f567408c7a0 msgr2=0x7f5674090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 --2- 10.20.193.7:0/2668261904 >> v2:10.20.193.61:3300/0 conn(0x7f567408c7a0 0x7f5674090460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 -- 10.20.193.7:0/2668261904 >> v1:10.20.193.7:6789/0 conn(0x7f567417f6d0 legacy=0x7f567419fab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 monclient: found mon.noname-b 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.648+0000 7f566bfff640 1 -- 10.20.193.7:0/2668261904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56740851e0 con 0x7f56740909a0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 --2- 10.20.193.7:0/2668261904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f567408dfb0 tx=0x7f565c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee01c2de333db471 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 1 -- 10.20.193.7:0/2668261904 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c0aa600 con 0x7f56740909a0 2026-02-22T20:55:47.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: dump: 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 1 -- 10.20.193.7:0/2668261904 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0af070 con 0x7f56740909a0 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 5 monclient: authenticate success, global_id 64373 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 1 -- 10.20.193.7:0/2668261904 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c0aa9c0 con 0x7f56740909a0 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566b7fe640 10 monclient: dump: 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:47.658 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:47.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 4 set_mon_vals no callback set 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: shutdown 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- 10.20.193.7:0/2668261904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 msgr2=0x7f5674090d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- 10.20.193.7:0/2668261904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f567408dfb0 tx=0x7f565c01c500 comp rx=0 tx=0).stop 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- 10.20.193.7:0/2668261904 shutdown_connections 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- 10.20.193.7:0/2668261904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674090d70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- 10.20.193.7:0/2668261904 >> v2:10.20.193.61:3300/0 conn(0x7f567408c7a0 0x7f5674090460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- 10.20.193.7:0/2668261904 >> 10.20.193.7:0/2668261904 conn(0x7f567408e050 msgr2=0x7f567408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- 10.20.193.7:0/2668261904 shutdown_connections 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- 10.20.193.7:0/2668261904 wait complete. 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: build_initial_monmap 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: monmap: 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 Processor -- start 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- start start 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: init 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:47.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 0x7f567412dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-a con 0x7f567408c7a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-c con 0x7f56740909a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f567417f6d0 0x7f567412a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): picked mon.noname-b con 0x7f567417f6d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56741a3d80 con 0x7f567408c7a0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f5678a0b640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 msgr2=0x7f567412dd40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f56741a3c00 con 0x7f567417f6d0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f56741a3f00 con 0x7f56740909a0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567ac96640 10 monclient(hunting): authenticate will time out at 760.131642s 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f5678a0b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 0x7f567412dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48176/0 (socket says 10.20.193.7:48176) 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 -- 10.20.193.7:0/871528015 learned_addr learned my addr 10.20.193.7:0/871528015 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): get_auth_request con 0x7f56740909a0 auth_method 0 2026-02-22T20:55:47.664 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567920c640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f567417f6d0 0x7f567412a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567920c640 10 monclient(hunting): get_auth_request con 0x7f567417f6d0 auth_method 0 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567920c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567920c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f567920c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient(hunting): handle_auth_done global_id 64376 payload 824 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 -- 10.20.193.7:0/871528015 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f567417f6d0 msgr2=0x7f567412a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f567417f6d0 0x7f567412a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 -- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 msgr2=0x7f567412dd40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 0x7f567412dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 monclient: found mon.noname-c 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:47.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.652+0000 7f566bfff640 1 -- 10.20.193.7:0/871528015 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567408ad50 con 0x7f56740909a0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f566bfff640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f565c01c540 tx=0x7f565c01ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c004220 con 0x7f56740909a0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: dump: 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: _finish_auth 0 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: _check_auth_tickets 2026-02-22T20:55:47.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0043c0 con 0x7f56740909a0 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 5 monclient: authenticate success, global_id 64376 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _renew_subs 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5674086e50 con 0x7f56740909a0 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c003910 con 0x7f56740909a0 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 10 monclient: dump: 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:47.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f566affd640 4 set_mon_vals no callback set 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _renew_subs 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f567407daa0 con 0x7f56740909a0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f565c003ab0 con 0x7f56740909a0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5674090460 con 0x7f56740909a0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 --2- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 0x7f564405af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(119..119 src has 64..119) ==== 3503+0+0 (secure 0 0 0) 0x7f565c0e91c0 con 0x7f56740909a0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f5678a0b640 1 --2- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 0x7f564405af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f5678a0b640 10 monclient: get_auth_request con 0x7f564403aa80 auth_method 0 2026-02-22T20:55:47.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.656+0000 7f5678a0b640 1 --2- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 0x7f564405af30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5664004780 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:47.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.660+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f565c016210 con 0x7f56740909a0 2026-02-22T20:55:47.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.660+0000 7f56697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:47.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.660+0000 7f56697fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f567405fc70 con 0x7f56740909a0 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f56697fa640 1 -- 10.20.193.7:0/871528015 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7f565c0b3390 con 0x7f56740909a0 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f56697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:47.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f56697fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:47.778 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 msgr2=0x7f564405af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 0x7f564405af30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5664004780 tx=0x7f5664008040 comp rx=0 tx=0).stop 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 10 monclient: shutdown 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 msgr2=0x7f5674084020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:47.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f565c01c540 tx=0x7f565c01ad40 comp rx=0 tx=0).stop 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 shutdown_connections 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> v2:10.20.193.61:6800/2336688312 conn(0x7f564403aa80 0x7f564405af30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f567417f6d0 0x7f567412a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56740909a0 0x7f5674084020 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 --2- 10.20.193.7:0/871528015 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f567408c7a0 0x7f567412dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 >> 10.20.193.7:0/871528015 conn(0x7f567408e050 msgr2=0x7f56740873a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 shutdown_connections 2026-02-22T20:55:47.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:47.772+0000 7f567ac96640 1 -- 10.20.193.7:0/871528015 wait complete. 2026-02-22T20:55:50.788 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:55:50.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: get_monmap_and_config 2026-02-22T20:55:50.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: build_initial_monmap 2026-02-22T20:55:50.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: monmap: 2026-02-22T20:55:50.858 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:50.858232+0000 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:50.858232+0000 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:50.859 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 Processor -- start 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 -- start start 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: init 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3b6813be70 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3b6813c950 addr v1:10.20.193.61:6789/0 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-a con 0x7f3b6817eb30 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b680875d0 con 0x7f3b6813be70 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b680872f0 con 0x7f3b6813c950 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b66ffd640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f3b6813be70 legacy=0x7f3b6813c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f3b680878b0 con 0x7f3b6817eb30 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b6d6bb640 10 monclient(hunting): authenticate will time out at 763.331396s 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b677fe640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 msgr2=0x7f3b6819ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b677fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b667fc640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f3b6813c950 0x7f3b6817d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:52156/0 (socket says 10.20.193.7:52156) 2026-02-22T20:55:50.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:50.852+0000 7f3b667fc640 1 -- 10.20.193.7:0/4179077873 learned_addr learned my addr 10.20.193.7:0/4179077873 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:55:51.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.056+0000 7f3b66ffd640 1 -- 10.20.193.7:0/4179077873 >> v1:10.20.193.7:6789/0 conn(0x7f3b6813be70 legacy=0x7f3b6813c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:51.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.056+0000 7f3b677fe640 1 -- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 msgr2=0x7f3b6819ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:51.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.056+0000 7f3b677fe640 1 --2- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:55:51.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.460+0000 7f3b66ffd640 1 -- 10.20.193.7:0/4179077873 >> v1:10.20.193.7:6789/0 conn(0x7f3b6813be70 legacy=0x7f3b6813c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:51.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.460+0000 7f3b677fe640 1 -- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 msgr2=0x7f3b6819ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:51.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:51.460+0000 7f3b677fe640 1 --2- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:55:51.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:51.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:52.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.264+0000 7f3b66ffd640 1 -- 10.20.193.7:0/4179077873 >> v1:10.20.193.7:6789/0 conn(0x7f3b6813be70 legacy=0x7f3b6813c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:52.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.264+0000 7f3b677fe640 1 -- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 msgr2=0x7f3b6819ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:52.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.264+0000 7f3b677fe640 1 --2- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358221974 0 0) 0x7f3b680872f0 con 0x7f3b6813c950 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 10 monclient(hunting): my global_id is 74167 2026-02-22T20:55:52.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.936+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b540058b0 con 0x7f3b6813c950 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 41491176 0 0) 0x7f3b540058b0 con 0x7f3b6813c950 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 msgr2=0x7f3b6819ef10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 --2- 10.20.193.7:0/4179077873 >> v2:10.20.193.7:3300/0 conn(0x7f3b6817eb30 0x7f3b6819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 >> v1:10.20.193.7:6789/0 conn(0x7f3b6813be70 legacy=0x7f3b6813c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _finish_hunting 0 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 monclient: found mon.noname-c-legacy 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.61:6789/0 2026-02-22T20:55:52.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 --> v1:10.20.193.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6808dbd0 con 0x7f3b6813c950 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _finish_auth 0 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.1 v1:10.20.193.61:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f3b50002d50 con 0x7f3b6813c950 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: dump: 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.953 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] but i'm connected to v1:10.20.193.61:6789/0, reconnecting 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 >> v1:10.20.193.61:6789/0 conn(0x7f3b6813c950 legacy=0x7f3b6817d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b54005db0 0x7f3b540061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): picked mon.a con 0x7f3b54005db0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 0x7f3b54006fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): picked mon.c con 0x7f3b54006b60 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b540075e0 0x7f3b54067d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.954 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): picked mon.b con 0x7f3b540075e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b540684e0 con 0x7f3b54005db0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54068690 con 0x7f3b540075e0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b66ffd640 1 -- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b54005db0 msgr2=0x7f3b540061a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f3b54068890 con 0x7f3b54006b60 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b65ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b66ffd640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b54005db0 0x7f3b540061a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 0x7f3b54006fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): get_auth_request con 0x7f3b54006b60 auth_method 0 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:52.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b540075e0 0x7f3b54067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 10 monclient(hunting): get_auth_request con 0x7f3b540075e0 auth_method 0 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient(hunting): handle_auth_done global_id 74167 payload 293 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 -- 10.20.193.7:0/4179077873 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b540075e0 msgr2=0x7f3b54067d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b540075e0 0x7f3b54067d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 -- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b54005db0 msgr2=0x7f3b540061a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:52.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b54005db0 0x7f3b540061a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient: _finish_hunting 0 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 monclient: found mon.c 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 -- 10.20.193.7:0/4179077873 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b540058b0 con 0x7f3b54006b60 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b677fe640 1 -- 10.20.193.7:0/4179077873 reap_dead start 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b6d6bb640 5 monclient: authenticate success, global_id 74167 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b6d6bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:52.957 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.944+0000 7f3b667fc640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 0x7f3b54006fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b50003680 tx=0x7f3b5001caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b02641748041ef server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b500032d0 con 0x7f3b54006b60 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: dump: 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:52.963 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b500a9020 con 0x7f3b54006b60 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:52.964 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 1 -- 10.20.193.7:0/4179077873 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50005cb0 con 0x7f3b54006b60 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 4 set_mon_vals no callback set 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b65ffb640 10 monclient: dump: 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.965 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: shutdown 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 msgr2=0x7f3b54006fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 0x7f3b54006fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b50003680 tx=0x7f3b5001caa0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/4179077873 shutdown_connections 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/4179077873 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b54006b60 0x7f3b54006fd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/4179077873 >> 10.20.193.7:0/4179077873 conn(0x7f3b6808f860 msgr2=0x7f3b6808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:52.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/4179077873 shutdown_connections 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/4179077873 wait complete. 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: build_initial_monmap 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: monmap: 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:52.967 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 Processor -- start 2026-02-22T20:55:52.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- start start 2026-02-22T20:55:52.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: init 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b54006b60 0x7f3b681529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-b con 0x7f3b54006b60 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 0x7f3b68138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-a con 0x7f3b68138000 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): picked mon.noname-c con 0x7f3b68129fa0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:52.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b68139760 con 0x7f3b68138000 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681395e0 con 0x7f3b54006b60 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f3b681398e0 con 0x7f3b68129fa0 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient(hunting): authenticate will time out at 765.435358s 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b667fc640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 msgr2=0x7f3b68138430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b667fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 0x7f3b68138430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49052/0 (socket says 10.20.193.7:49052) 2026-02-22T20:55:52.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 -- 10.20.193.7:0/3091266600 learned_addr learned my addr 10.20.193.7:0/3091266600 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): get_auth_request con 0x7f3b68129fa0 auth_method 0 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b66ffd640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b54006b60 0x7f3b681529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b66ffd640 10 monclient(hunting): get_auth_request con 0x7f3b54006b60 auth_method 0 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:52.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient(hunting): handle_auth_done global_id 64379 payload 824 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 -- 10.20.193.7:0/3091266600 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b54006b60 msgr2=0x7f3b681529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b54006b60 0x7f3b681529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 -- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 msgr2=0x7f3b68138430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 0x7f3b68138430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient: _finish_hunting 0 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 monclient: found mon.noname-c 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 -- 10.20.193.7:0/3091266600 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6812b6e0 con 0x7f3b68129fa0 2026-02-22T20:55:52.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b677fe640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b58003f90 tx=0x7f3b5800edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58010710 con 0x7f3b68129fa0 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: dump: 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:52.977 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b580108b0 con 0x7f3b68129fa0 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58010c60 con 0x7f3b68129fa0 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b477fe640 10 monclient: dump: 2026-02-22T20:55:52.978 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 5 monclient: authenticate success, global_id 64379 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: _renew_subs 2026-02-22T20:55:52.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b657fa640 4 set_mon_vals no callback set 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.956+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6812c940 con 0x7f3b68129fa0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 10 monclient: _renew_subs 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b68152f30 con 0x7f3b68129fa0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b680382a0 con 0x7f3b68129fa0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f3b58018400 con 0x7f3b68129fa0 2026-02-22T20:55:52.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 1 --2- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 0x7f3b3405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(119..119 src has 64..119) ==== 3503+0+0 (secure 0 0 0) 0x7f3b5804ecc0 con 0x7f3b68129fa0 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b66ffd640 1 --2- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 0x7f3b3405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b66ffd640 10 monclient: get_auth_request con 0x7f3b3403aa90 auth_method 0 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b66ffd640 1 --2- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 0x7f3b3405af40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0026b0 tx=0x7f3b5c0093e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f3b5801f020 con 0x7f3b68129fa0 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:52.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:52.960+0000 7f3b477fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b6d6bb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b6d6bb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b6d6bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b6808e220 con 0x7f3b68129fa0 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b477fe640 1 -- 10.20.193.7:0/3091266600 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f3b58014030 con 0x7f3b68129fa0 2026-02-22T20:55:53.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:55:53.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.076+0000 7f3b477fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:53.084 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":34,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 msgr2=0x7f3b3405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 0x7f3b3405af40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0026b0 tx=0x7f3b5c0093e0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 10 monclient: shutdown 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 msgr2=0x7f3b6812a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b58003f90 tx=0x7f3b5800edb0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 shutdown_connections 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3b68129fa0 0x7f3b6812a3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3b68138000 0x7f3b68138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> v2:10.20.193.61:6800/2336688312 conn(0x7f3b3403aa90 0x7f3b3405af40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 --2- 10.20.193.7:0/3091266600 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3b54006b60 0x7f3b681529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 >> 10.20.193.7:0/3091266600 conn(0x7f3b6808f860 msgr2=0x7f3b6808be40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 shutdown_connections 2026-02-22T20:55:53.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.080+0000 7f3b6d6bb640 1 -- 10.20.193.7:0/3091266600 wait complete. 2026-02-22T20:55:53.095 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:55:53.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:55:53.096 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:55:53.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.148+0000 7ff2ff07b640 10 monclient: get_monmap_and_config 2026-02-22T20:55:53.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.148+0000 7ff2ff07b640 10 monclient: build_initial_monmap 2026-02-22T20:55:53.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.148+0000 7ff2ff07b640 10 monclient: monmap: 2026-02-22T20:55:53.156 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:53.155792+0000 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:53.155792+0000 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:53.157 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 Processor -- start 2026-02-22T20:55:53.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- start start 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient: init 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff2f813f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2f813fd70 addr v2:10.20.193.61:3300/0 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2f8180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f808fd70 con 0x7ff2f813f290 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f808e1f0 con 0x7ff2f813fd70 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f808ec90 con 0x7ff2f8180d00 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient(hunting): authenticate will time out at 765.629102s 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fcdf0640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7ff2f813f290 legacy=0x7ff2f813f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49060/0 (socket says 10.20.193.7:49060) 2026-02-22T20:55:53.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/1299255409 learned_addr learned my addr 10.20.193.7:0/1299255409 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): get_auth_request con 0x7ff2f8180d00 auth_method 0 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 1 --2- 10.20.193.7:0/1299255409 >> v2:10.20.193.61:3300/0 conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): get_auth_request con 0x7ff2f813fd70 auth_method 0 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient(hunting): handle_auth_done global_id 64382 payload 274 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/1299255409 >> v2:10.20.193.61:3300/0 conn(0x7ff2f813fd70 msgr2=0x7ff2f81807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 --2- 10.20.193.7:0/1299255409 >> v2:10.20.193.61:3300/0 conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/1299255409 >> v1:10.20.193.7:6789/0 conn(0x7ff2f813f290 legacy=0x7ff2f813f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient: _finish_hunting 0 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 monclient: found mon.noname-b 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/1299255409 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f8092bc0 con 0x7ff2f8180d00 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2fd5f1640 1 --2- 10.20.193.7:0/1299255409 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009580 tx=0x7ff2f401c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f732194e1784c2a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 1 -- 10.20.193.7:0/1299255409 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40a6710 con 0x7ff2f8180d00 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: dump: 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.173 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: _finish_auth 0 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 5 monclient: authenticate success, global_id 64382 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 1 -- 10.20.193.7:0/1299255409 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f40a68b0 con 0x7ff2f8180d00 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 1 -- 10.20.193.7:0/1299255409 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40a6ca0 con 0x7ff2f8180d00 2026-02-22T20:55:53.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ef7fe640 10 monclient: dump: 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.175 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 4 set_mon_vals no callback set 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 10 monclient: shutdown 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- 10.20.193.7:0/1299255409 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 msgr2=0x7ff2f81a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/1299255409 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009580 tx=0x7ff2f401c680 comp rx=0 tx=0).stop 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- 10.20.193.7:0/1299255409 shutdown_connections 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/1299255409 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f8180d00 0x7ff2f81a10e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/1299255409 >> v2:10.20.193.61:3300/0 conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- 10.20.193.7:0/1299255409 >> 10.20.193.7:0/1299255409 conn(0x7ff2f8093df0 msgr2=0x7ff2f80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- 10.20.193.7:0/1299255409 shutdown_connections 2026-02-22T20:55:53.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.152+0000 7ff2ff07b640 1 -- 10.20.193.7:0/1299255409 wait complete. 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: build_initial_monmap 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: monmap: 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:53.177 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 Processor -- start 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- start start 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: init 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff2f813f290 0x7ff2f8128c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-a con 0x7ff2f813f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2f813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff2f8180d00 0x7ff2f810b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2f8180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f81a3fc0 con 0x7ff2f813f290 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f81a3e40 con 0x7ff2f8180d00 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f81a4140 con 0x7ff2f813fd70 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): authenticate will time out at 765.632636s 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff2f813f290 msgr2=0x7ff2f8128c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff2f813f290 0x7ff2f8128c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 0x7ff2f81807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49076/0 (socket says 10.20.193.7:49076) 2026-02-22T20:55:53.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 -- 10.20.193.7:0/853523261 learned_addr learned my addr 10.20.193.7:0/853523261 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): get_auth_request con 0x7ff2f813fd70 auth_method 0 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff2f8180d00 0x7ff2f810b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 10 monclient(hunting): get_auth_request con 0x7ff2f8180d00 auth_method 0 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient(hunting): handle_auth_done global_id 64385 payload 824 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff2f8180d00 msgr2=0x7ff2f810b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff2f8180d00 0x7ff2f810b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff2f813f290 msgr2=0x7ff2f8128c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff2f813f290 0x7ff2f8128c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient: _finish_hunting 0 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 monclient: found mon.noname-c 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f808a9e0 con 0x7ff2f813fd70 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2effff640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 0x7ff2f81807c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e980 tx=0x7ff2e000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0017070 con 0x7ff2f813fd70 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: dump: 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.182 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: _finish_auth 0 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e000ca00 con 0x7ff2f813fd70 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 5 monclient: authenticate success, global_id 64385 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _renew_subs 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f810c7a0 con 0x7ff2f813fd70 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000cdf0 con 0x7ff2f813fd70 2026-02-22T20:55:53.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: dump: 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2eeffd640 4 set_mon_vals no callback set 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _renew_subs 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f810cd70 con 0x7ff2f813fd70 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 0x7ff2f808abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f813f660 con 0x7ff2f812c4d0 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 0x7ff2f808abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient: get_auth_request con 0x7ff2f812c4d0 auth_method 0 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_done global_id 64388 payload 824 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2f810c190 con 0x7ff2f812c4d0 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff2e0013470 con 0x7ff2f813fd70 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fcdf0640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 0x7ff2f808abb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b450 tx=0x7ff2e800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 --2- 10.20.193.7:0/853523261 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2c803aa90 0x7ff2c805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(120..120 src has 64..120) ==== 3897+0+0 (secure 0 0 0) 0x7ff2e004efe0 con 0x7ff2f813fd70 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8005070 con 0x7ff2f812c4d0 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: dump: 2026-02-22T20:55:53.186 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7ff2e8015070 con 0x7ff2f812c4d0 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:53.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 msgr2=0x7ff2f808abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 0x7ff2f808abb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b450 tx=0x7ff2e800b910 comp rx=0 tx=0).stop 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 msgr2=0x7ff2f808abb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2ed7fa640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c4d0 0x7ff2f808abb0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b450 tx=0x7ff2e800b910 comp rx=0 tx=0).stop 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 1 --2- 10.20.193.7:0/853523261 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2c803aa90 0x7ff2c805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 10 monclient: get_auth_request con 0x7ff2c803aa90 auth_method 0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.156+0000 7ff2fd5f1640 1 --2- 10.20.193.7:0/853523261 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2c803aa90 0x7ff2c805af40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2f401cf20 tx=0x7ff2f40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 0x7ff2f808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f805fb50 con 0x7ff2f812c8a0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 0x7ff2f808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient: get_auth_request con 0x7ff2f812c8a0 auth_method 0 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 10 monclient(hunting): handle_auth_done global_id 64391 payload 824 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 1 -- 10.20.193.7:0/853523261 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff2f808b630 con 0x7ff2f812c8a0 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fcdf0640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 0x7ff2f808b0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b950 tx=0x7ff2e8005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80056e0 con 0x7ff2f812c8a0 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 10 monclient: dump: 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.189 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5036 (secure 0 0 0) 0x7ff2e80056e0 con 0x7ff2f812c8a0 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 msgr2=0x7ff2f808b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 0x7ff2f808b0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b950 tx=0x7ff2e8005ad0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 msgr2=0x7ff2f808b0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:53.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ed7fa640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f812c8a0 0x7ff2f808b0f0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800b950 tx=0x7ff2e8005ad0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 34, 2026-02-22T20:55:53.191 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 78765, 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.192 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.193 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:53.194 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.195 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:53.196 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:53.197 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.198 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.199 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:53.200 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.201 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:53.202 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2c803aa90 msgr2=0x7ff2c805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/853523261 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2c803aa90 0x7ff2c805af40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2f401cf20 tx=0x7ff2f40a7000 comp rx=0 tx=0).stop 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 10 monclient: shutdown 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 msgr2=0x7ff2f81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 --2- 10.20.193.7:0/853523261 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff2f813fd70 0x7ff2f81807c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e980 tx=0x7ff2e000ee40 comp rx=0 tx=0).stop 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/853523261 reap_dead start 2026-02-22T20:55:53.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2fd5f1640 1 -- 10.20.193.7:0/853523261 reap_dead start 2026-02-22T20:55:53.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 shutdown_connections 2026-02-22T20:55:53.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 >> 10.20.193.7:0/853523261 conn(0x7ff2f8093df0 msgr2=0x7ff2f8057260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:53.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 shutdown_connections 2026-02-22T20:55:53.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.160+0000 7ff2ff07b640 1 -- 10.20.193.7:0/853523261 wait complete. 2026-02-22T20:55:53.204 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:55:53.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T20:55:53.204 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: get_monmap_and_config 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: build_initial_monmap 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: monmap: 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:55:53.265958+0000 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:55:53.265958+0000 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.266 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:55:53.267 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:55:53.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:55:53.267 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:55:53.267 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:55:53.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 Processor -- start 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 -- start start 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: init 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 0x7f41a4089500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-a con 0x7f41a4089130 addr v2:10.20.193.7:3300/0 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-b con 0x7f41a408e3b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f41a408ed00 addr v1:10.20.193.7:6789/0 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a4087360 con 0x7f41a408ed00 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f41a408cca0 con 0x7f41a4089130 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f41a4087640 con 0x7f41a408e3b0 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41abbc7640 10 monclient(hunting): authenticate will time out at 765.739215s 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a993c640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 msgr2=0x7f41a4089500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41aa13d640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f41a408ed00 legacy=0x7f41a419d230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a993c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 0x7f41a4089500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49086/0 (socket says 10.20.193.7:49086) 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 -- 10.20.193.7:0/714461522 learned_addr learned my addr 10.20.193.7:0/714461522 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:53.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): get_auth_request con 0x7f41a408e3b0 auth_method 0 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient(hunting): handle_auth_done global_id 64394 payload 274 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 -- 10.20.193.7:0/714461522 >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 msgr2=0x7f41a4089500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 --2- 10.20.193.7:0/714461522 >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 0x7f41a4089500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 -- 10.20.193.7:0/714461522 >> v1:10.20.193.7:6789/0 conn(0x7f41a408ed00 legacy=0x7f41a419d230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient: _finish_hunting 0 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 monclient: found mon.noname-b 2026-02-22T20:55:53.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.260+0000 7f41a913b640 1 -- 10.20.193.7:0/714461522 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a413c3a0 con 0x7f41a408e3b0 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 1 --2- 10.20.193.7:0/714461522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f419801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66191e915de8b9e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 1 -- 10.20.193.7:0/714461522 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980b1070 con 0x7f41a408e3b0 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: dump: 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.278 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: _finish_auth 0 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: _check_auth_tickets 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 1 -- 10.20.193.7:0/714461522 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980ac450 con 0x7f41a408e3b0 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 1 -- 10.20.193.7:0/714461522 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980ac820 con 0x7f41a408e3b0 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 5 monclient: authenticate success, global_id 64394 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: get_monmap_and_config success 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 4 set_mon_vals no callback set 2026-02-22T20:55:53.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a893a640 10 monclient: dump: 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: shutdown 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/714461522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 msgr2=0x7f41a408e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- 10.20.193.7:0/714461522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f419801c520 comp rx=0 tx=0).stop 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/714461522 shutdown_connections 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- 10.20.193.7:0/714461522 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a408e3b0 0x7f41a408e7c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- 10.20.193.7:0/714461522 >> v2:10.20.193.7:3300/0 conn(0x7f41a4089130 0x7f41a4089500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/714461522 >> 10.20.193.7:0/714461522 conn(0x7f41a408faa0 msgr2=0x7f41a408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/714461522 shutdown_connections 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/714461522 wait complete. 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: build_initial_monmap 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: monmap: 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:55:53.281 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 Processor -- start 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- start start 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: init 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _reopen_session rank -1 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:55:53.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-c con 0x7f41a4089130 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41a408e3b0 0x7f41a412bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-a con 0x7f41a408e3b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a408ed00 0x7f41a405ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): picked mon.noname-b con 0x7f41a408ed00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f41a408a020 con 0x7f41a408e3b0 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f41a4089ea0 con 0x7f41a408ed00 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f41a408a1a0 con 0x7f41a4089130 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): _renew_subs 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): authenticate will time out at 765.742734s 2026-02-22T20:55:53.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41a408e3b0 msgr2=0x7f41a412bed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41a408e3b0 0x7f41a412bed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49090/0 (socket says 10.20.193.7:49090) 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 -- 10.20.193.7:0/2561269362 learned_addr learned my addr 10.20.193.7:0/2561269362 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): get_auth_request con 0x7f41a4089130 auth_method 0 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient(hunting): handle_auth_done global_id 64397 payload 824 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a408ed00 msgr2=0x7f41a405ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a408ed00 0x7f41a405ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41a408e3b0 msgr2=0x7f41a412bed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f41a408e3b0 0x7f41a412bed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient: _finish_hunting 0 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 monclient: found mon.noname-c 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a41a2fb0 con 0x7f41a4089130 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a993c640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f419400b520 tx=0x7f419400b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41940060d0 con 0x7f41a4089130 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: dump: 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.285 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: _finish_auth 0 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: _check_auth_tickets 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194014070 con 0x7f41a4089130 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 5 monclient: authenticate success, global_id 64397 2026-02-22T20:55:53.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _renew_subs 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a405d220 con 0x7f41a4089130 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194006490 con 0x7f41a4089130 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 10 monclient: dump: 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.287 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f4193fff640 4 set_mon_vals no callback set 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _renew_subs 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a41a29c0 con 0x7f41a4089130 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 0x7f41a405b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f41a405ba80 con 0x7f41a405b170 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 0x7f41a405b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient: get_auth_request con 0x7f41a405b170 auth_method 0 2026-02-22T20:55:53.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4194006630 con 0x7f41a4089130 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.264+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 --2- 10.20.193.7:0/2561269362 >> v2:10.20.193.61:6800/2336688312 conn(0x7f417403aa90 0x7f417405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41a913b640 10 monclient(hunting): handle_auth_done global_id 74179 payload 824 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41a913b640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41a4089500 con 0x7f41a405b170 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(120..120 src has 64..120) ==== 3897+0+0 (secure 0 0 0) 0x7f419404e3d0 con 0x7f41a4089130 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41aa13d640 1 --2- 10.20.193.7:0/2561269362 >> v2:10.20.193.61:6800/2336688312 conn(0x7f417403aa90 0x7f417405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41aa13d640 10 monclient: get_auth_request con 0x7f417403aa90 auth_method 0 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41a913b640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 0x7f41a405b540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f41980192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980b1050 con 0x7f41a405b170 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 10 monclient: dump: 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f41980b2040 con 0x7f41a405b170 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 msgr2=0x7f41a405b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 0x7f41a405b540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f41980192c0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 msgr2=0x7f41a405b540 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41927fc640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a405b170 0x7f41a405b540 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f41980192c0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41aa13d640 1 --2- 10.20.193.7:0/2561269362 >> v2:10.20.193.61:6800/2336688312 conn(0x7f417403aa90 0x7f417405af40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41a41a28c0 tx=0x7f41a0009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41abbc7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41abbc7640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 0x7f41a411d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41abbc7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.268+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f41a405fc70 con 0x7f41a411cd60 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 0x7f41a411d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient: get_auth_request con 0x7f41a411cd60 auth_method 0 2026-02-22T20:55:53.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 10 monclient(hunting): handle_auth_done global_id 74182 payload 824 2026-02-22T20:55:53.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 1 -- 10.20.193.7:0/2561269362 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41a41a2c00 con 0x7f41a411cd60 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41a913b640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 0x7f41a411d160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f4198009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41980044f0 con 0x7f41a411cd60 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 10 monclient: dump: 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f41980044f0 con 0x7f41a411cd60 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 msgr2=0x7f41a411d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 0x7f41a411d160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f4198009300 comp rx=0 tx=0).stop 2026-02-22T20:55:53.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 msgr2=0x7f41a411d160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41927fc640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f41a411cd60 0x7f41a411d160 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f41980090a0 tx=0x7f4198009300 comp rx=0 tx=0).stop 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 34, 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 20665, 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.297 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.298 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:55:53.299 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.300 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.301 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 >> v2:10.20.193.61:6800/2336688312 conn(0x7f417403aa90 msgr2=0x7f417405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 --2- 10.20.193.7:0/2561269362 >> v2:10.20.193.61:6800/2336688312 conn(0x7f417403aa90 0x7f417405af40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41a41a28c0 tx=0x7f41a0009230 comp rx=0 tx=0).stop 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 10 monclient: shutdown 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 msgr2=0x7f41a412b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41aa13d640 1 -- 10.20.193.7:0/2561269362 reap_dead start 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f419400b520 tx=0x7f419400b9e0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 shutdown_connections 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 --2- 10.20.193.7:0/2561269362 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f41a4089130 0x7f41a412b990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 >> 10.20.193.7:0/2561269362 conn(0x7f41a408faa0 msgr2=0x7f41a40577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 shutdown_connections 2026-02-22T20:55:53.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:55:53.272+0000 7f41abbc7640 1 -- 10.20.193.7:0/2561269362 wait complete. 2026-02-22T20:55:53.303 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:55:53.303 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: starting. 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20188 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: created object 0... 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: created object 25... 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: created object 49... 2026-02-22T20:55:54.055 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: finishing. 2026-02-22T20:55:54.056 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20189]: shutting down. 2026-02-22T20:55:55.009 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20190]: starting. 2026-02-22T20:55:55.010 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20190]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20188 2026-02-22T20:55:55.010 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20190]: shutting down. 2026-02-22T20:55:56.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:55:56.954 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:55:57.064 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: starting. 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20188 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: created object 0... 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: created object 25... 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: created object 49... 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: finishing. 2026-02-22T20:55:57.065 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20225]: shutting down. 2026-02-22T20:55:57.075 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:57.075 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: starting. 2026-02-22T20:55:57.075 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: listing objects. 2026-02-22T20:55:57.075 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: listed object 0... 2026-02-22T20:55:57.076 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: listed object 25... 2026-02-22T20:55:57.076 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: saw 50 objects 2026-02-22T20:55:57.076 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20227]: shutting down. 2026-02-22T20:55:58.021 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:58.022 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20226]: starting. 2026-02-22T20:55:58.022 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20226]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20188 2026-02-22T20:55:58.022 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20226]: shutting down. 2026-02-22T20:55:58.023 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:58.024 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:55:58.024 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:55:58.026 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:00.082 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: starting. 2026-02-22T20:56:00.082 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20279 2026-02-22T20:56:00.082 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: created object 0... 2026-02-22T20:56:00.083 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: created object 25... 2026-02-22T20:56:00.083 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: created object 49... 2026-02-22T20:56:00.083 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: finishing. 2026-02-22T20:56:00.083 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20280]: shutting down. 2026-02-22T20:56:01.031 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20281]: starting. 2026-02-22T20:56:01.031 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20281]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20279 2026-02-22T20:56:01.031 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20281]: shutting down. 2026-02-22T20:56:01.938 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:56:01] 2026-02-22T20:56:01.938 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:56:01 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['rbd', '.mgr'] 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T20:56:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:56:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:56:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:56:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:56:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:56:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:56:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:56:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:56:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1] pools [1, 2] with 6 osds, pg_target 600 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:02.673 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:02.673 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: starting. 2026-02-22T20:56:02.673 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20279 2026-02-22T20:56:02.674 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: created object 0... 2026-02-22T20:56:02.674 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: created object 25... 2026-02-22T20:56:02.674 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: created object 49... 2026-02-22T20:56:02.674 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: finishing. 2026-02-22T20:56:02.674 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20316]: shutting down. 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: starting. 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: listing objects. 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: listed object 0... 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: listed object 25... 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: saw 50 objects 2026-02-22T20:56:02.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20318]: shutting down. 2026-02-22T20:56:03.627 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:03.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20317]: starting. 2026-02-22T20:56:03.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20317]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20279 2026-02-22T20:56:03.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20317]: shutting down. 2026-02-22T20:56:03.629 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:03.629 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:03.629 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:03.631 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:05.681 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: starting. 2026-02-22T20:56:05.681 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20370 2026-02-22T20:56:05.681 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: created object 0... 2026-02-22T20:56:05.681 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: created object 25... 2026-02-22T20:56:05.682 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: created object 49... 2026-02-22T20:56:05.682 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: finishing. 2026-02-22T20:56:05.682 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20371]: shutting down. 2026-02-22T20:56:06.633 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20372]: starting. 2026-02-22T20:56:06.633 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20372]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20370 2026-02-22T20:56:06.634 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20372]: shutting down. 2026-02-22T20:56:06.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:06.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:08.690 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:08.690 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: starting. 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20370 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: created object 0... 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: created object 25... 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: created object 49... 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: finishing. 2026-02-22T20:56:08.691 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20407]: shutting down. 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: starting. 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: listing objects. 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: listed object 0... 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: listed object 25... 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: saw 50 objects 2026-02-22T20:56:08.702 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20409]: shutting down. 2026-02-22T20:56:09.646 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:09.646 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20408]: starting. 2026-02-22T20:56:09.646 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20408]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20370 2026-02-22T20:56:09.646 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20408]: shutting down. 2026-02-22T20:56:09.648 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:09.648 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:09.648 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:09.651 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: starting. 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20461 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: created object 0... 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: created object 25... 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: created object 49... 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: finishing. 2026-02-22T20:56:11.701 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20462]: shutting down. 2026-02-22T20:56:11.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:11.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:12.624 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20463]: starting. 2026-02-22T20:56:12.624 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20463]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20461 2026-02-22T20:56:12.624 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20463]: shutting down. 2026-02-22T20:56:13.303 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-22T20:56:13.303 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T20:56:13.304 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T20:56:13.306 INFO:tasks.ceph.mon.a:Started 2026-02-22T20:56:13.306 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:56:13.306 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:56:13.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: get_monmap_and_config 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: build_initial_monmap 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: monmap: 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:13.362960+0000 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:13.362960+0000 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:13.372 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 Processor -- start 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 -- start start 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: init 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-a con 0x7f57b813cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:13.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f57b813d800 0x7f57b8139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-c con 0x7f57b813d800 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f57b813a110 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b805d510 con 0x7f57b813a110 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f57b808b800 con 0x7f57b813cef0 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f57b808a720 con 0x7f57b813d800 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57bd2ba640 10 monclient(hunting): authenticate will time out at 785.835836s 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:42842/0 (socket says 10.20.193.7:42842) 2026-02-22T20:56:13.374 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 1 -- 10.20.193.7:0/841896153 learned_addr learned my addr 10.20.193.7:0/841896153 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 10 monclient(hunting): get_auth_request con 0x7f57b813cef0 auth_method 0 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 1 -- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 msgr2=0x7f57b813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.356+0000 7f57b6ffd640 1 -- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 msgr2=0x7f57b813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/841896153 >> v2:10.20.193.61:3300/0 conn(0x7f57b813d800 0x7f57b8139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): get_auth_request con 0x7f57b813d800 auth_method 0 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:13.375 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 1 -- 10.20.193.7:0/841896153 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792481912 0 0) 0x7f57b805d510 con 0x7f57b813a110 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient(hunting): my global_id is 74311 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 1 -- 10.20.193.7:0/841896153 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a4003620 con 0x7f57b813a110 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_done global_id 74308 payload 274 2026-02-22T20:56:13.376 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 msgr2=0x7f57b813d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/841896153 >> v1:10.20.193.61:6789/0 conn(0x7f57b813a110 legacy=0x7f57b819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient: _finish_hunting 0 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 monclient: found mon.noname-c 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/841896153 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b808aa00 con 0x7f57b813d800 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/841896153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8139bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57a0004780 tx=0x7f57a001c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b50566d0173202d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 1 -- 10.20.193.7:0/841896153 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00ab620 con 0x7f57b813d800 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:13.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: dump: 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: _finish_auth 0 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 5 monclient: authenticate success, global_id 74308 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 1 -- 10.20.193.7:0/841896153 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a00b0070 con 0x7f57b813d800 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 1 -- 10.20.193.7:0/841896153 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00ab9c0 con 0x7f57b813d800 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b5ffb640 10 monclient: dump: 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:13.379 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 4 set_mon_vals no callback set 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: shutdown 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:13.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/841896153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 msgr2=0x7f57b8139bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/841896153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8139bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57a0004780 tx=0x7f57a001c400 comp rx=0 tx=0).stop 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/841896153 shutdown_connections 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/841896153 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8139bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/841896153 >> v2:10.20.193.7:3300/0 conn(0x7f57b813cef0 0x7f57b813d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/841896153 >> 10.20.193.7:0/841896153 conn(0x7f57b808f860 msgr2=0x7f57b808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/841896153 shutdown_connections 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/841896153 wait complete. 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: build_initial_monmap 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: monmap: 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:13.381 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 Processor -- start 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- start start 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: init 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:13.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-a con 0x7f57b813a110 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-c con 0x7f57b813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8086960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): picked mon.noname-b con 0x7f57b813d800 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8088fa0 con 0x7f57b813a110 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8088e20 con 0x7f57b813d800 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f57b81a23b0 con 0x7f57b813cef0 2026-02-22T20:56:13.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient(hunting): authenticate will time out at 785.839486s 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:42858/0 (socket says 10.20.193.7:42858) 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 -- 10.20.193.7:0/2928844467 learned_addr learned my addr 10.20.193.7:0/2928844467 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:36546/0 (socket says 10.20.193.7:36546) 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 10 monclient(hunting): get_auth_request con 0x7f57b813a110 auth_method 0 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:13.384 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): get_auth_request con 0x7f57b813cef0 auth_method 0 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 -- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 msgr2=0x7f57b81507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 -- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 msgr2=0x7f57b81507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient(hunting): handle_auth_done global_id 64478 payload 824 2026-02-22T20:56:13.385 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/2928844467 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 msgr2=0x7f57b8086960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8086960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 msgr2=0x7f57b81507c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient: _finish_hunting 0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 monclient: found mon.noname-c 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 -- 10.20.193.7:0/2928844467 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8088380 con 0x7f57b813cef0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b67fc640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f57b808a8a0 tx=0x7f57a00191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00abc10 con 0x7f57b813cef0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:13.386 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: dump: 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: _finish_auth 0 2026-02-22T20:56:13.387 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: _check_auth_tickets 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a00abdb0 con 0x7f57b813cef0 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 5 monclient: authenticate success, global_id 64478 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0004220 con 0x7f57b813cef0 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _renew_subs 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b812d780 con 0x7f57b813cef0 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57b57fa640 4 set_mon_vals no callback set 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:13.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57977fe640 10 monclient: dump: 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _renew_subs 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.360+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b812bc60 con 0x7f57b813cef0 2026-02-22T20:56:13.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57bd2ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57bd2ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57bd2ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b80382a0 con 0x7f57b813cef0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f57a00043c0 con 0x7f57b813cef0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 1 --2- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 0x7f578405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(140..140 src has 64..140) ==== 3503+0+0 (secure 0 0 0) 0x7f57a00e89b0 con 0x7f57b813cef0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 0x7f578405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57b6ffd640 10 monclient: get_auth_request con 0x7f578403ab20 auth_method 0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57b6ffd640 1 --2- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 0x7f578405afd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57ac006d60 tx=0x7f57ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f57a00c3020 con 0x7f57b813cef0 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:13.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.364+0000 7f57977fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:13.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:56:13.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:13.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:13.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f57b813d2c0 con 0x7f57b813cef0 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57977fe640 1 -- 10.20.193.7:0/2928844467 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f57a00ba030 con 0x7f57b813cef0 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57977fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":34,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 msgr2=0x7f578405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 0x7f578405afd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57ac006d60 tx=0x7f57ac008040 comp rx=0 tx=0).stop 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 10 monclient: shutdown 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 msgr2=0x7f57b8150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:13.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f57b808a8a0 tx=0x7f57a00191a0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 shutdown_connections 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> v2:10.20.193.61:6800/2336688312 conn(0x7f578403ab20 0x7f578405afd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f57b813d800 0x7f57b8086960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f57b813cef0 0x7f57b8150d00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 --2- 10.20.193.7:0/2928844467 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f57b813a110 0x7f57b81507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 >> 10.20.193.7:0/2928844467 conn(0x7f57b808f860 msgr2=0x7f57b813b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 shutdown_connections 2026-02-22T20:56:13.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:13.476+0000 7f57bd2ba640 1 -- 10.20.193.7:0/2928844467 wait complete. 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: starting. 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20461 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: created object 0... 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: created object 25... 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: created object 49... 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: finishing. 2026-02-22T20:56:14.675 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20498]: shutting down. 2026-02-22T20:56:14.685 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:14.685 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: starting. 2026-02-22T20:56:14.686 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: listing objects. 2026-02-22T20:56:14.686 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: listed object 0... 2026-02-22T20:56:14.686 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: listed object 25... 2026-02-22T20:56:14.686 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: saw 50 objects 2026-02-22T20:56:14.686 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20500]: shutting down. 2026-02-22T20:56:15.627 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:15.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20499]: starting. 2026-02-22T20:56:15.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20499]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20461 2026-02-22T20:56:15.627 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20499]: shutting down. 2026-02-22T20:56:15.629 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:15.630 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:15.630 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:15.632 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:16.491 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:56:16.580 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.552+0000 7fbc27c82640 10 monclient: get_monmap_and_config 2026-02-22T20:56:16.580 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.552+0000 7fbc27c82640 10 monclient: build_initial_monmap 2026-02-22T20:56:16.580 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.552+0000 7fbc27c82640 10 monclient: monmap: 2026-02-22T20:56:16.580 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:16.559252+0000 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:16.559252+0000 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:16.581 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.552+0000 7fbc27c82640 1 Processor -- start 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- start start 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: init 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2026-02-22T20:56:16.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 0x7fbc2013d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-a con 0x7fbc2013cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbc2013d800 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbc2013a2e0 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2005d510 con 0x7fbc2013d800 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2008b800 con 0x7fbc2013a2e0 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2008a720 con 0x7fbc2013cef0 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:16.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient(hunting): authenticate will time out at 789.032545s 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 0x7fbc2013d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fbc2013d800 0x7fbc20139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:60996/0 (socket says 10.20.193.7:60996) 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 1 -- 10.20.193.7:0/690466790 learned_addr learned my addr 10.20.193.7:0/690466790 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): get_auth_request con 0x7fbc2013cef0 auth_method 0 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 -- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 msgr2=0x7fbc2013d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 -- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 msgr2=0x7fbc2013d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 0x7fbc2013d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 0x7fbc2013d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607074743 0 0) 0x7fbc2008b800 con 0x7fbc2013a2e0 2026-02-22T20:56:16.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): _negotiate 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): my global_id is 74320 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc08003620 con 0x7fbc2013a2e0 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3357318998 0 0) 0x7fbc08003620 con 0x7fbc2013a2e0 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 msgr2=0x7fbc2013d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 --2- 10.20.193.7:0/690466790 >> v2:10.20.193.7:3300/0 conn(0x7fbc2013cef0 0x7fbc2013d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 >> v1:10.20.193.7:6789/0 conn(0x7fbc2013d800 legacy=0x7fbc20139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _finish_hunting 0 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 monclient: found mon.noname-c-legacy 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.61:6789/0 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 --> v1:10.20.193.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2008aa00 con 0x7fbc2013a2e0 2026-02-22T20:56:16.585 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _finish_auth 0 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _check_auth_tickets 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.1 v1:10.20.193.61:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fbc1c0031e0 con 0x7fbc2013a2e0 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: dump: 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.586 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] but i'm connected to v1:10.20.193.61:6789/0, reconnecting 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 >> v1:10.20.193.61:6789/0 conn(0x7fbc2013a2e0 legacy=0x7fbc2019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 0x7fbc08004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): picked mon.c con 0x7fbc08003c10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:16.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc080048d0 0x7fbc08004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): picked mon.a con 0x7fbc080048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc08045a80 0x7fbc08065e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): picked mon.b con 0x7fbc08045a80 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2008a720 con 0x7fbc080048d0 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08066450 con 0x7fbc08045a80 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbc08066650 con 0x7fbc08003c10 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:16.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 0x7fbc08004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc080048d0 0x7fbc08004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): get_auth_request con 0x7fbc08003c10 auth_method 0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): get_auth_request con 0x7fbc080048d0 auth_method 0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc08045a80 0x7fbc08065e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:16.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): get_auth_request con 0x7fbc08045a80 auth_method 0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient(hunting): handle_auth_done global_id 74320 payload 293 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 -- 10.20.193.7:0/690466790 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc08045a80 msgr2=0x7fbc08065e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc08045a80 0x7fbc08065e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 -- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc080048d0 msgr2=0x7fbc08004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc080048d0 0x7fbc08004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient: _finish_hunting 0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 monclient: found mon.c 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 -- 10.20.193.7:0/690466790 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc08003620 con 0x7fbc08003c10 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient: _finish_auth 0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 10 monclient: _check_auth_tickets 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 5 monclient: authenticate success, global_id 74320 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc261f8640 1 -- 10.20.193.7:0/690466790 reap_dead start 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc251f6640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc080048d0 0x7fbc08004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc259f7640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 0x7fbc08004020 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbc100097f0 tx=0x7fbc1001c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ec827b492446e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000f040 con 0x7fbc08003c10 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: dump: 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.590 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc100a9680 con 0x7fbc08003c10 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 1 -- 10.20.193.7:0/690466790 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc100a9a70 con 0x7fbc08003c10 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc249f5640 10 monclient: dump: 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 4 set_mon_vals no callback set 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: shutdown 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 msgr2=0x7fbc08004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 0x7fbc08004020 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbc100097f0 tx=0x7fbc1001c680 comp rx=0 tx=0).stop 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- 10.20.193.7:0/690466790 shutdown_connections 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 --2- 10.20.193.7:0/690466790 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc08003c10 0x7fbc08004020 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- 10.20.193.7:0/690466790 >> 10.20.193.7:0/690466790 conn(0x7fbc2008f860 msgr2=0x7fbc2008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- 10.20.193.7:0/690466790 shutdown_connections 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- 10.20.193.7:0/690466790 wait complete. 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: build_initial_monmap 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: monmap: 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:16.591 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 Processor -- start 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 1 -- start start 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.556+0000 7fbc27c82640 10 monclient: init 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-a con 0x7fbc08003c10 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc201294f0 0x7fbc20129940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-b con 0x7fbc201294f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 0x7fbc2023ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): picked mon.noname-c con 0x7fbc20129e80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20139d50 con 0x7fbc08003c10 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20139bd0 con 0x7fbc201294f0 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbc20139ed0 con 0x7fbc20129e80 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient(hunting): authenticate will time out at 789.036269s 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:42910/0 (socket says 10.20.193.7:42910) 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 -- 10.20.193.7:0/1218299747 learned_addr learned my addr 10.20.193.7:0/1218299747 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 10 monclient(hunting): get_auth_request con 0x7fbc08003c10 auth_method 0 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:16.592 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 0x7fbc2023ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): get_auth_request con 0x7fbc20129e80 auth_method 0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 -- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 msgr2=0x7fbc2012ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 -- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 msgr2=0x7fbc2012ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc251f6640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc201294f0 0x7fbc20129940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc251f6640 10 monclient(hunting): get_auth_request con 0x7fbc201294f0 auth_method 0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc251f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc251f6640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc251f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient(hunting): handle_auth_done global_id 64490 payload 824 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 -- 10.20.193.7:0/1218299747 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc201294f0 msgr2=0x7fbc20129940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc201294f0 0x7fbc20129940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 -- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 msgr2=0x7fbc2012ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient: _finish_hunting 0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 monclient: found mon.noname-c 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 -- 10.20.193.7:0/1218299747 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2012d220 con 0x7fbc20129e80 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc261f8640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 0x7fbc2023ac20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc2013dbd0 tx=0x7fbc1c0056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c012560 con 0x7fbc20129e80 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: dump: 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:16.593 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c012700 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 5 monclient: authenticate success, global_id 64490 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _renew_subs 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2013adf0 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0128f0 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 10 monclient: dump: 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _renew_subs 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0ffff640 4 set_mon_vals no callback set 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2012c3b0 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbc1c012a90 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2012a330 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 --2- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 0x7fbbf005afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(143..143 src has 64..143) ==== 3503+0+0 (secure 0 0 0) 0x7fbc1c04e160 con 0x7fbc20129e80 2026-02-22T20:56:16.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 0x7fbbf005afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 10 monclient: get_auth_request con 0x7fbbf003ab10 auth_method 0 2026-02-22T20:56:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.560+0000 7fbc259f7640 1 --2- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 0x7fbbf005afc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbc10002410 tx=0x7fbc100047b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.564+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fbc1c00b700 con 0x7fbc20129e80 2026-02-22T20:56:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.564+0000 7fbc0e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:16.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.564+0000 7fbc0e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:56:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbc20139990 con 0x7fbc20129e80 2026-02-22T20:56:16.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc0e7fc640 1 -- 10.20.193.7:0/1218299747 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7fbc1c04d0a0 con 0x7fbc20129e80 2026-02-22T20:56:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc0e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:16.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc0e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:16.683 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":34,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 msgr2=0x7fbbf005afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 0x7fbbf005afc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbc10002410 tx=0x7fbc100047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 10 monclient: shutdown 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 msgr2=0x7fbc2023ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:16.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 0x7fbc2023ac20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbc2013dbd0 tx=0x7fbc1c0056b0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 shutdown_connections 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc20129e80 0x7fbc2023ac20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbbf003ab10 0x7fbbf005afc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc201294f0 0x7fbc20129940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 --2- 10.20.193.7:0/1218299747 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc08003c10 0x7fbc2012ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 >> 10.20.193.7:0/1218299747 conn(0x7fbc2008f860 msgr2=0x7fbc2013c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 shutdown_connections 2026-02-22T20:56:16.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:16.676+0000 7fbc27c82640 1 -- 10.20.193.7:0/1218299747 wait complete. 2026-02-22T20:56:16.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:16.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:19.695 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: get_monmap_and_config 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: build_initial_monmap 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: monmap: 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:19.754146+0000 2026-02-22T20:56:19.755 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:19.754146+0000 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 Processor -- start 2026-02-22T20:56:19.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 -- start start 2026-02-22T20:56:19.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: init 2026-02-22T20:56:19.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:19.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2026-02-22T20:56:19.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f0f4413f290 0x7f0f4413f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-c con 0x7f0f4413f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f4413fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-a con 0x7f0f4413c680 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4408fd70 con 0x7f0f4413fba0 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4408e1f0 con 0x7f0f4413c680 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.766 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4408ec90 con 0x7f0f4413f290 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f48f28640 10 monclient(hunting): authenticate will time out at 792.227345s 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42d76640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 msgr2=0x7f0f441a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42d76640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 msgr2=0x7f0f441a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f0f4413f290 0x7f0f4413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f41d74640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f0f4413fba0 0x7f0f4413bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:47890/0 (socket says 10.20.193.7:47890) 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f41d74640 1 -- 10.20.193.7:0/2825939970 learned_addr learned my addr 10.20.193.7:0/2825939970 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:19.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): get_auth_request con 0x7f0f4413f290 auth_method 0 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient(hunting): handle_auth_done global_id 74326 payload 274 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 -- 10.20.193.7:0/2825939970 >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 msgr2=0x7f0f441a17e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 --2- 10.20.193.7:0/2825939970 >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 -- 10.20.193.7:0/2825939970 >> v1:10.20.193.61:6789/0 conn(0x7f0f4413fba0 legacy=0x7f0f4413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient: _finish_hunting 0 2026-02-22T20:56:19.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 monclient: found mon.noname-c 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.748+0000 7f0f42575640 1 -- 10.20.193.7:0/2825939970 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f44092bc0 con 0x7f0f4413f290 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42575640 1 --2- 10.20.193.7:0/2825939970 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413f290 0x7f0f4413f660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f440947c0 tx=0x7f0f3801c1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26cbe9238f3f39db server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 1 -- 10.20.193.7:0/2825939970 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380b0070 con 0x7f0f4413f290 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: dump: 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.769 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: _finish_auth 0 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: _check_auth_tickets 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 1 -- 10.20.193.7:0/2825939970 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f380ab600 con 0x7f0f4413f290 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 5 monclient: authenticate success, global_id 74326 2026-02-22T20:56:19.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 1 -- 10.20.193.7:0/2825939970 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380ab9d0 con 0x7f0f4413f290 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 4 set_mon_vals no callback set 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41573640 10 monclient: dump: 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.771 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: shutdown 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/2825939970 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413f290 msgr2=0x7f0f4413f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- 10.20.193.7:0/2825939970 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413f290 0x7f0f4413f660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f440947c0 tx=0x7f0f3801c1f0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/2825939970 shutdown_connections 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- 10.20.193.7:0/2825939970 >> v2:10.20.193.7:3300/0 conn(0x7f0f4413c680 0x7f0f441a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- 10.20.193.7:0/2825939970 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413f290 0x7f0f4413f660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/2825939970 >> 10.20.193.7:0/2825939970 conn(0x7f0f44093df0 msgr2=0x7f0f440902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/2825939970 shutdown_connections 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/2825939970 wait complete. 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: build_initial_monmap 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: monmap: 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:19.773 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 Processor -- start 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- start start 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: init 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413c680 0x7f0f4412a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-b con 0x7f0f4413c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-a con 0x7f0f4413f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0f4413fba0 0x7f0f4412ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): picked mon.noname-c con 0x7f0f4413fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44090de0 con 0x7f0f4413f290 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44090c60 con 0x7f0f4413c680 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0f441a4540 con 0x7f0f4413fba0 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:19.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient(hunting): authenticate will time out at 792.230714s 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49204/0 (socket says 10.20.193.7:49204) 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 -- 10.20.193.7:0/957750610 learned_addr learned my addr 10.20.193.7:0/957750610 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): get_auth_request con 0x7f0f4413f290 auth_method 0 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0f4413fba0 0x7f0f4412ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): get_auth_request con 0x7f0f4413fba0 auth_method 0 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f42d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient(hunting): handle_auth_done global_id 84099 payload 824 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 -- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0f4413fba0 msgr2=0x7f0f4412ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0f4413fba0 0x7f0f4412ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 -- 10.20.193.7:0/957750610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413c680 msgr2=0x7f0f4412a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413c680 0x7f0f4412a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient: _finish_hunting 0 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 monclient: found mon.noname-a 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 -- 10.20.193.7:0/957750610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4412d8d0 con 0x7f0f4413f290 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f41d74640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c520 tx=0x7f0f2c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c017070 con 0x7f0f4413f290 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: dump: 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.778 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: _finish_auth 0 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: _check_auth_tickets 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c005de0 con 0x7f0f4413f290 2026-02-22T20:56:19.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c007270 con 0x7f0f4413f290 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 10 monclient: dump: 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.780 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 5 monclient: authenticate success, global_id 84099 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _renew_subs 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f40d72640 4 set_mon_vals no callback set 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4412dbb0 con 0x7f0f4413f290 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _renew_subs 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f44057760 con 0x7f0f4413f290 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:19.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4408a9e0 con 0x7f0f4413f290 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0f2c007410 con 0x7f0f4413f290 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 --2- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 0x7f0f1005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.752+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(147..147 src has 64..147) ==== 3897+0+0 (secure 0 0 0) 0x7f0f2c04df50 con 0x7f0f4413f290 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f42575640 1 --2- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 0x7f0f1005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f42575640 10 monclient: get_auth_request con 0x7f0f1003ab20 auth_method 0 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f42575640 1 --2- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 0x7f0f1005afd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f3801c230 tx=0x7f0f38004820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f0f2c0192c0 con 0x7f0f4413f290 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f2affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:19.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.756+0000 7f0f2affd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:19.853 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: starting. 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20552 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: created object 0... 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: created object 25... 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: created object 49... 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: finishing. 2026-02-22T20:56:19.854 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20553]: shutting down. 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0f4412cd40 con 0x7f0f4413f290 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f2affd640 1 -- 10.20.193.7:0/957750610 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f0f2c006050 con 0x7f0f4413f290 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f2affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:19.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f2affd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:19.878 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:56:19.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 msgr2=0x7f0f1005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 0x7f0f1005afd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f3801c230 tx=0x7f0f38004820 comp rx=0 tx=0).stop 2026-02-22T20:56:19.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 10 monclient: shutdown 2026-02-22T20:56:19.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 msgr2=0x7f0f4412a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c520 tx=0x7f0f2c00c9e0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 shutdown_connections 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0f4413fba0 0x7f0f4412ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0f4413f290 0x7f0f4412a5c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f1003ab20 0x7f0f1005afd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 --2- 10.20.193.7:0/957750610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0f4413c680 0x7f0f4412a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 >> 10.20.193.7:0/957750610 conn(0x7f0f44093df0 msgr2=0x7f0f440865e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 shutdown_connections 2026-02-22T20:56:19.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.872+0000 7f0f48f28640 1 -- 10.20.193.7:0/957750610 wait complete. 2026-02-22T20:56:19.888 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:56:19.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:56:19.888 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:56:19.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 10 monclient: get_monmap_and_config 2026-02-22T20:56:19.955 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 10 monclient: build_initial_monmap 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 10 monclient: monmap: 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:19.955066+0000 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:19.955066+0000 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:19.956 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:19.957 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:19.957 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:19.957 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:19.957 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 1 Processor -- start 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 1 -- start start 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.948+0000 7f85f21e5640 10 monclient: init 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f85ec13f290 0x7f85ec13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-a con 0x7f85ec13f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-b con 0x7f85ec13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f85ec13c4b0 0x7f85ec13c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-c con 0x7f85ec13c4b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f85ec08e1f0 con 0x7f85ec13f290 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f85ec08ec90 con 0x7f85ec13c4b0 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec08fd70 con 0x7f85ec13fba0 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): authenticate will time out at 792.428462s 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f85ec13f290 0x7f85ec13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f85ec13f290 0x7f85ec13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49210/0 (socket says 10.20.193.7:49210) 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/699381363 learned_addr learned my addr 10.20.193.7:0/699381363 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): get_auth_request con 0x7f85ec13f290 auth_method 0 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): get_auth_request con 0x7f85ec13fba0 auth_method 0 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 1 --2- 10.20.193.7:0/699381363 >> v2:10.20.193.61:3300/0 conn(0x7f85ec13c4b0 0x7f85ec13c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): get_auth_request con 0x7f85ec13c4b0 auth_method 0 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_done global_id 84102 payload 274 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 msgr2=0x7f85ec13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/699381363 >> v2:10.20.193.61:3300/0 conn(0x7f85ec13c4b0 msgr2=0x7f85ec13c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/699381363 >> v2:10.20.193.61:3300/0 conn(0x7f85ec13c4b0 0x7f85ec13c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 monclient: found mon.noname-a 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/699381363 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec092bc0 con 0x7f85ec13f290 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13f290 0x7f85ec13f660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0935e0 tx=0x7f85d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9b42a643fce4fc server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 1 -- 10.20.193.7:0/699381363 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ab600 con 0x7f85ec13f290 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: dump: 2026-02-22T20:56:19.974 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: _finish_auth 0 2026-02-22T20:56:19.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 5 monclient: authenticate success, global_id 84102 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 1 -- 10.20.193.7:0/699381363 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80b0070 con 0x7f85ec13f290 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 1 -- 10.20.193.7:0/699381363 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ab9c0 con 0x7f85ec13f290 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 4 set_mon_vals no callback set 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ea7fc640 10 monclient: dump: 2026-02-22T20:56:19.976 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: shutdown 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:19.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13f290 msgr2=0x7f85ec13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13f290 0x7f85ec13f660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0935e0 tx=0x7f85d801c510 comp rx=0 tx=0).stop 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/699381363 shutdown_connections 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- 10.20.193.7:0/699381363 >> v2:10.20.193.61:3300/0 conn(0x7f85ec13c4b0 0x7f85ec13c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- 10.20.193.7:0/699381363 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13f290 0x7f85ec13f660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/699381363 >> 10.20.193.7:0/699381363 conn(0x7f85ec093df0 msgr2=0x7f85ec0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/699381363 shutdown_connections 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/699381363 wait complete. 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: build_initial_monmap 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: monmap: 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:19.978 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 Processor -- start 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- start start 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: init 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:19.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 0x7f85ec12c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-a con 0x7f85ec13c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85ec13f290 0x7f85ec0875d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-b con 0x7f85ec13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec087b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): picked mon.noname-c con 0x7f85ec13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec090de0 con 0x7f85ec13c4b0 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec090c60 con 0x7f85ec13f290 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec1a2ff0 con 0x7f85ec13fba0 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient(hunting): authenticate will time out at 792.431180s 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 0x7f85ec12c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 0x7f85ec12c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49222/0 (socket says 10.20.193.7:49222) 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/3871113933 learned_addr learned my addr 10.20.193.7:0/3871113933 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): get_auth_request con 0x7f85ec13c4b0 auth_method 0 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec087b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): get_auth_request con 0x7f85ec13fba0 auth_method 0 2026-02-22T20:56:19.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85ec13f290 0x7f85ec0875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): get_auth_request con 0x7f85ec13f290 auth_method 0 2026-02-22T20:56:19.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient(hunting): handle_auth_done global_id 84105 payload 824 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 msgr2=0x7f85ec087b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85ec13fba0 0x7f85ec087b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85ec13f290 msgr2=0x7f85ec0875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85ec13f290 0x7f85ec0875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 monclient: found mon.noname-a 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec13e8a0 con 0x7f85ec13c4b0 2026-02-22T20:56:19.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85eb7fe640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 0x7f85ec12c3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85d8004780 tx=0x7f85d801adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004020 con 0x7f85ec13c4b0 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: dump: 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.984 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: _finish_auth 0 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80041c0 con 0x7f85ec13c4b0 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004570 con 0x7f85ec13c4b0 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85c7fff640 10 monclient: dump: 2026-02-22T20:56:19.985 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85e9ffb640 4 set_mon_vals no callback set 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 5 monclient: authenticate success, global_id 84105 2026-02-22T20:56:19.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _renew_subs 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec08a9e0 con 0x7f85ec13c4b0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _renew_subs 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.952+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec089880 con 0x7f85ec13c4b0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85f21e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85f21e5640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 0x7f85ec088050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec08d880 con 0x7f85ec088ca0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f85d8003710 con 0x7f85ec13c4b0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 0x7f85ec088050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient: get_auth_request con 0x7f85ec088ca0 auth_method 0 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 --2- 10.20.193.7:0/3871113933 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85bc03ab20 0x7f85bc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(147..147 src has 64..147) ==== 3897+0+0 (secure 0 0 0) 0x7f85d80e8f10 con 0x7f85ec13c4b0 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 10 monclient(hunting): handle_auth_done global_id 84108 payload 824 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85ec13f660 con 0x7f85ec088ca0 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85ebfff640 1 --2- 10.20.193.7:0/3871113933 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85bc03ab20 0x7f85bc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85ebfff640 10 monclient: get_auth_request con 0x7f85bc03ab20 auth_method 0 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85eaffd640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 0x7f85ec088050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85ec088b10 tx=0x7f85dc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00f9d0 con 0x7f85ec088ca0 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 10 monclient: dump: 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.989 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f85dc00f9d0 con 0x7f85ec088ca0 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 msgr2=0x7f85ec088050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 0x7f85ec088050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85ec088b10 tx=0x7f85dc011a80 comp rx=0 tx=0).stop 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 msgr2=0x7f85ec088050 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85c7fff640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec088ca0 0x7f85ec088050 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85ec088b10 tx=0x7f85dc011a80 comp rx=0 tx=0).stop 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.956+0000 7f85ebfff640 1 --2- 10.20.193.7:0/3871113933 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85bc03ab20 0x7f85bc05afd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f85e0004b00 tx=0x7f85e0009820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:19.990 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 0x7f85ec11f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec089fa0 con 0x7f85ec11f2c0 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 0x7f85ec11f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient: get_auth_request con 0x7f85ec11f2c0 auth_method 0 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 10 monclient(hunting): handle_auth_done global_id 84111 payload 824 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 1 -- 10.20.193.7:0/3871113933 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85ec05fb50 con 0x7f85ec11f2c0 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85eaffd640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 0x7f85ec11f690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85dc010010 tx=0x7f85dc004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:19.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc022350 con 0x7f85ec11f2c0 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 10 monclient: dump: 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:19.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7f85dc022330 con 0x7f85ec11f2c0 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 msgr2=0x7f85ec11f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 0x7f85ec11f690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85dc010010 tx=0x7f85dc004820 comp rx=0 tx=0).stop 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 msgr2=0x7f85ec11f690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85c7fff640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec11f2c0 0x7f85ec11f690 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85dc010010 tx=0x7f85dc004820 comp rx=0 tx=0).stop 2026-02-22T20:56:19.993 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 6623, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:56:19.994 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:19.995 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:19.996 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:19.997 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:19.998 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:19.999 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.000 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.001 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.002 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.003 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:20.004 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85bc03ab20 msgr2=0x7f85bc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 --2- 10.20.193.7:0/3871113933 >> v2:10.20.193.61:6800/2336688312 conn(0x7f85bc03ab20 0x7f85bc05afd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f85e0004b00 tx=0x7f85e0009820 comp rx=0 tx=0).stop 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 10 monclient: shutdown 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 msgr2=0x7f85ec12c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 --2- 10.20.193.7:0/3871113933 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85ec13c4b0 0x7f85ec12c3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85d8004780 tx=0x7f85d801adb0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85ebfff640 1 -- 10.20.193.7:0/3871113933 reap_dead start 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85ebfff640 1 -- 10.20.193.7:0/3871113933 reap_dead start 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 shutdown_connections 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 >> 10.20.193.7:0/3871113933 conn(0x7f85ec093df0 msgr2=0x7f85ec13d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 shutdown_connections 2026-02-22T20:56:20.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:19.960+0000 7f85f21e5640 1 -- 10.20.193.7:0/3871113933 wait complete. 2026-02-22T20:56:20.007 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:20.007 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:56:20.007 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: get_monmap_and_config 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: monmap: 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:20.066974+0000 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:20.066974+0000 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.069 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 Processor -- start 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 -- start start 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: init 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient: _add_conns ranks=[3,0,1,4,2] 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7feee013f290 0x7feee013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): picked mon.noname-a con 0x7feee013f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feee013fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feee013c680 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee008fd70 con 0x7feee013fba0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee0092bc0 con 0x7feee013c680 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7feee008e1f0 con 0x7feee013f290 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee7136640 10 monclient(hunting): authenticate will time out at 792.539872s 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feee4eab640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7feee013f290 0x7feee013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.060+0000 7feed7fff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7feee013fba0 0x7feee013bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59932/0 (socket says 10.20.193.7:59932) 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 -- 10.20.193.7:0/3856851998 learned_addr learned my addr 10.20.193.7:0/3856851998 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): get_auth_request con 0x7feee013f290 auth_method 0 2026-02-22T20:56:20.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): handle_auth_done global_id 84114 payload 274 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 -- 10.20.193.7:0/3856851998 >> v1:10.20.193.61:6789/0 conn(0x7feee013c680 legacy=0x7feee01a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 -- 10.20.193.7:0/3856851998 >> v1:10.20.193.7:6789/0 conn(0x7feee013fba0 legacy=0x7feee013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 monclient: found mon.noname-a 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 -- 10.20.193.7:0/3856851998 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee008e6d0 con 0x7feee013f290 2026-02-22T20:56:20.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 --2- 10.20.193.7:0/3856851998 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013f290 0x7feee013f660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feed0004780 tx=0x7feed001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0483ea76cf494ee server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 1 -- 10.20.193.7:0/3856851998 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00b0070 con 0x7feee013f290 2026-02-22T20:56:20.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:20.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: dump: 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 1 -- 10.20.193.7:0/3856851998 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed00ab600 con 0x7feee013f290 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 1 -- 10.20.193.7:0/3856851998 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00ab9d0 con 0x7feee013f290 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed77fe640 10 monclient: dump: 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.082 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 5 monclient: authenticate success, global_id 84114 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 4 set_mon_vals no callback set 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: shutdown 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/3856851998 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013f290 msgr2=0x7feee013f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 --2- 10.20.193.7:0/3856851998 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013f290 0x7feee013f660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feed0004780 tx=0x7feed001c440 comp rx=0 tx=0).stop 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/3856851998 shutdown_connections 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 --2- 10.20.193.7:0/3856851998 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013f290 0x7feee013f660 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/3856851998 >> 10.20.193.7:0/3856851998 conn(0x7feee0093df0 msgr2=0x7feee00902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/3856851998 shutdown_connections 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/3856851998 wait complete. 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: monmap: 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 Processor -- start 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- start start 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: init 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feee013c680 0x7feee0129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): picked mon.noname-b con 0x7feee013c680 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 0x7feee012a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): picked mon.noname-c con 0x7feee013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013fba0 0x7feee012a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): picked mon.noname-a con 0x7feee013fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7feee01a58a0 con 0x7feee013fba0 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7feee01a5720 con 0x7feee013c680 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7feee01a5a20 con 0x7feee013f290 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient(hunting): authenticate will time out at 792.543283s 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 0x7feee012a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 0x7feee012a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41376/0 (socket says 10.20.193.7:41376) 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 -- 10.20.193.7:0/586838173 learned_addr learned my addr 10.20.193.7:0/586838173 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): get_auth_request con 0x7feee013f290 auth_method 0 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013fba0 0x7feee012a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): get_auth_request con 0x7feee013fba0 auth_method 0 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feee013c680 0x7feee0129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee56ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): get_auth_request con 0x7feee013c680 auth_method 0 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee4eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient(hunting): handle_auth_done global_id 64502 payload 824 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feee013c680 msgr2=0x7feee0129e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feee013c680 0x7feee0129e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013fba0 msgr2=0x7feee012a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feee013fba0 0x7feee012a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 monclient: found mon.noname-c 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee012d930 con 0x7feee013f290 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed7fff640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 0x7feee012a390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feec800c700 tx=0x7feec800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feee013f290 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: dump: 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.089 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 5 monclient: authenticate success, global_id 64502 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _renew_subs 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee013edd0 con 0x7feee013f290 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8005bd0 con 0x7feee013f290 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8007070 con 0x7feee013f290 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed57fa640 10 monclient: dump: 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feed6ffd640 4 set_mon_vals no callback set 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _renew_subs 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.064+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feee012b8b0 con 0x7feee013f290 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 0x7feee00875d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7feee013f660 con 0x7feee0151060 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 0x7feee00875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient: get_auth_request con 0x7feee0151060 auth_method 0 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 10 monclient(hunting): handle_auth_done global_id 64505 payload 824 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feee012dcd0 con 0x7feee0151060 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7feec8007210 con 0x7feee013f290 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee4eab640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 0x7feee00875d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed0004780 tx=0x7feed00191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 --2- 10.20.193.7:0/586838173 >> v2:10.20.193.61:6800/2336688312 conn(0x7feeb003ab20 0x7feeb005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(147..147 src has 64..147) ==== 3897+0+0 (secure 0 0 0) 0x7feec804e000 con 0x7feee013f290 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00b9020 con 0x7feee0151060 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 10 monclient: dump: 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7feed0003910 con 0x7feee0151060 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 msgr2=0x7feee00875d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 0x7feee00875d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed0004780 tx=0x7feed00191e0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 msgr2=0x7feee00875d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feed57fa640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151060 0x7feee00875d0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed0004780 tx=0x7feed00191e0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee56ac640 1 --2- 10.20.193.7:0/586838173 >> v2:10.20.193.61:6800/2336688312 conn(0x7feeb003ab20 0x7feeb005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee56ac640 10 monclient: get_auth_request con 0x7feeb003ab20 auth_method 0 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee56ac640 1 --2- 10.20.193.7:0/586838173 >> v2:10.20.193.61:6800/2336688312 conn(0x7feeb003ab20 0x7feeb005afd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feedc002b90 tx=0x7feedc003320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:20.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 0x7feee0087b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.068+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7feee008a960 con 0x7feee0151430 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 0x7feee0087b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient: get_auth_request con 0x7feee0151430 auth_method 0 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 10 monclient(hunting): handle_auth_done global_id 64508 payload 824 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 1 -- 10.20.193.7:0/586838173 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feee005fb70 con 0x7feee0151430 2026-02-22T20:56:20.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee4eab640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 0x7feee0087b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feed001a070 tx=0x7feed00a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00b9040 con 0x7feee0151430 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 10 monclient: dump: 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.097 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7feed00abb00 con 0x7feee0151430 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 msgr2=0x7feee0087b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 0x7feee0087b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feed001a070 tx=0x7feed00a8000 comp rx=0 tx=0).stop 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 msgr2=0x7feee0087b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:20.098 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feed57fa640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee0151430 0x7feee0087b10 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feed001a070 tx=0x7feed00a8000 comp rx=0 tx=0).stop 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 105676, 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:20.099 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.100 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.101 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:20.102 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.103 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.104 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.105 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.106 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.107 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.108 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.109 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:20.110 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.110 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.110 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.110 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:20.110 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 >> v2:10.20.193.61:6800/2336688312 conn(0x7feeb003ab20 msgr2=0x7feeb005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 --2- 10.20.193.7:0/586838173 >> v2:10.20.193.61:6800/2336688312 conn(0x7feeb003ab20 0x7feeb005afd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feedc002b90 tx=0x7feedc003320 comp rx=0 tx=0).stop 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 10 monclient: shutdown 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 msgr2=0x7feee012a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 --2- 10.20.193.7:0/586838173 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feee013f290 0x7feee012a390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feec800c700 tx=0x7feec800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee56ac640 1 -- 10.20.193.7:0/586838173 reap_dead start 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee56ac640 1 -- 10.20.193.7:0/586838173 reap_dead start 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 shutdown_connections 2026-02-22T20:56:20.111 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 >> 10.20.193.7:0/586838173 conn(0x7feee0093df0 msgr2=0x7feee013d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 shutdown_connections 2026-02-22T20:56:20.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.072+0000 7feee7136640 1 -- 10.20.193.7:0/586838173 wait complete. 2026-02-22T20:56:20.112 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:20.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:56:20.112 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:56:20.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.172+0000 7faadf99d640 10 monclient: get_monmap_and_config 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.172+0000 7faadf99d640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.172+0000 7faadf99d640 10 monclient: monmap: 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:20.179496+0000 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:20.179496+0000 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:20.182 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 Processor -- start 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- start start 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: init 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-b con 0x7faad8091c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7faad813f1b0 0x7faad813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-a con 0x7faad813f1b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faad813fae0 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad808e6a0 con 0x7faad813fae0 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7faad808e910 con 0x7faad813f1b0 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faad808ebf0 con 0x7faad8091c70 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): authenticate will time out at 792.652408s 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41410/0 (socket says 10.20.193.7:41410) 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3103394950 learned_addr learned my addr 10.20.193.7:0/3103394950 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): get_auth_request con 0x7faad8091c70 auth_method 0 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 1 --1- 10.20.193.7:0/3103394950 >> v1:10.20.193.7:6789/0 conn(0x7faad813fae0 0x7faad81a0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59934/0 (socket says 10.20.193.7:59934) 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 1 --2- 10.20.193.7:0/3103394950 >> v2:10.20.193.7:3300/0 conn(0x7faad813f1b0 0x7faad813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): get_auth_request con 0x7faad813f1b0 auth_method 0 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_done global_id 64511 payload 274 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3103394950 >> v2:10.20.193.7:3300/0 conn(0x7faad813f1b0 msgr2=0x7faad813f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- 10.20.193.7:0/3103394950 >> v2:10.20.193.7:3300/0 conn(0x7faad813f1b0 0x7faad813f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 1 -- 10.20.193.7:0/3103394950 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378816227 0 0) 0x7faad808e6a0 con 0x7faad813fae0 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3103394950 >> v1:10.20.193.7:6789/0 conn(0x7faad813fae0 legacy=0x7faad81a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 monclient: found mon.noname-b 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3103394950 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad808eed0 con 0x7faad8091c70 2026-02-22T20:56:20.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- 10.20.193.7:0/3103394950 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faac80090a0 tx=0x7faac801c1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee914d0e5072788a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 1 -- 10.20.193.7:0/3103394950 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80a4a20 con 0x7faad8091c70 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: dump: 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.191 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 1 -- 10.20.193.7:0/3103394950 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80a4bc0 con 0x7faad8091c70 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 1 -- 10.20.193.7:0/3103394950 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80ac430 con 0x7faad8091c70 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:20.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac7fff640 10 monclient: dump: 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 5 monclient: authenticate success, global_id 64511 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 4 set_mon_vals no callback set 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: shutdown 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3103394950 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 msgr2=0x7faad8092040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- 10.20.193.7:0/3103394950 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faac80090a0 tx=0x7faac801c1e0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3103394950 shutdown_connections 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- 10.20.193.7:0/3103394950 >> v2:10.20.193.7:3300/0 conn(0x7faad813f1b0 0x7faad813f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- 10.20.193.7:0/3103394950 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad8091c70 0x7faad8092040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3103394950 >> 10.20.193.7:0/3103394950 conn(0x7faad8093d80 msgr2=0x7faad8090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3103394950 shutdown_connections 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3103394950 wait complete. 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: monmap: 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:20.194 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 Processor -- start 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- start start 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: init 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 0x7faad8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-a con 0x7faad8091c70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad813f1b0 0x7faad8150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-b con 0x7faad813f1b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad813fae0 0x7faad812abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): picked mon.noname-c con 0x7faad813fae0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7faad81a5050 con 0x7faad8091c70 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7faad81a4ed0 con 0x7faad813f1b0 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faad81a51d0 con 0x7faad813fae0 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient(hunting): authenticate will time out at 792.655377s 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 0x7faad8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 0x7faad8150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49284/0 (socket says 10.20.193.7:49284) 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3922106307 learned_addr learned my addr 10.20.193.7:0/3922106307 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): get_auth_request con 0x7faad8091c70 auth_method 0 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad813fae0 0x7faad812abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): get_auth_request con 0x7faad813fae0 auth_method 0 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faaddf13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad813f1b0 0x7faad8150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient(hunting): handle_auth_done global_id 84129 payload 824 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad813fae0 msgr2=0x7faad812abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faad813fae0 0x7faad812abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad813f1b0 msgr2=0x7faad8150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad813f1b0 0x7faad8150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 monclient: found mon.noname-a 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad813db70 con 0x7faad8091c70 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 10 monclient: get_auth_request con 0x7faad813f1b0 auth_method 0 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad813f1b0 0x7faad8150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadd712640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 0x7faad8150520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faac8009070 tx=0x7faac80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80ba030 con 0x7faad8091c70 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: dump: 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.198 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80a4820 con 0x7faad8091c70 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80addd0 con 0x7faad8091c70 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac5ffb640 10 monclient: dump: 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.199 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 5 monclient: authenticate success, global_id 84129 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _renew_subs 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faac77fe640 4 set_mon_vals no callback set 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad808d1e0 con 0x7faad8091c70 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _renew_subs 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.176+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad812ea00 con 0x7faad8091c70 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadf99d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadf99d640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 0x7faad812b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.200 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7faad8092040 con 0x7faad812b120 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7faac80c7060 con 0x7faad8091c70 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 0x7faad812b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 --2- 10.20.193.7:0/3922106307 >> v2:10.20.193.61:6800/2336688312 conn(0x7faaa803ab20 0x7faaa805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient: get_auth_request con 0x7faad812b120 auth_method 0 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(147..147 src has 64..147) ==== 3897+0+0 (secure 0 0 0) 0x7faac80e8550 con 0x7faad8091c70 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 10 monclient(hunting): handle_auth_done global_id 74341 payload 824 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faad8092890 con 0x7faad812b120 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faaddf13640 1 --2- 10.20.193.7:0/3922106307 >> v2:10.20.193.61:6800/2336688312 conn(0x7faaa803ab20 0x7faaa805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.201 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faaddf13640 10 monclient: get_auth_request con 0x7faaa803ab20 auth_method 0 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 0x7faad812b520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc010c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc018070 con 0x7faad812b120 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 10 monclient: dump: 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.202 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faaddf13640 1 --2- 10.20.193.7:0/3922106307 >> v2:10.20.193.61:6800/2336688312 conn(0x7faaa803ab20 0x7faaa805afd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faad4002af0 tx=0x7faad4003430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7faacc004440 con 0x7faad812b120 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 msgr2=0x7faad812b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 0x7faad812b520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc010c90 comp rx=0 tx=0).stop 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 msgr2=0x7faad812b520 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.180+0000 7faac5ffb640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812b120 0x7faad812b520 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc010c90 comp rx=0 tx=0).stop 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 0x7faad80876f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7faad812d200 con 0x7faad812ba60 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 0x7faad80876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient: get_auth_request con 0x7faad812ba60 auth_method 0 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.203 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 10 monclient(hunting): handle_auth_done global_id 74344 payload 824 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 1 -- 10.20.193.7:0/3922106307 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faad805fb50 con 0x7faad812ba60 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadcf11640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 0x7faad80876f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc00f040 con 0x7faad812ba60 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 10 monclient: dump: 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.204 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7faacc0143f0 con 0x7faad812ba60 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 msgr2=0x7faad80876f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 0x7faad80876f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc0047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 msgr2=0x7faad80876f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faac5ffb640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faad812ba60 0x7faad80876f0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faad812df00 tx=0x7faacc0047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:20.205 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 47578, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.206 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.207 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:20.208 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:20.209 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.210 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.211 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.212 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.213 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:20.214 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:20.215 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 >> v2:10.20.193.61:6800/2336688312 conn(0x7faaa803ab20 msgr2=0x7faaa805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 --2- 10.20.193.7:0/3922106307 >> v2:10.20.193.61:6800/2336688312 conn(0x7faaa803ab20 0x7faaa805afd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faad4002af0 tx=0x7faad4003430 comp rx=0 tx=0).stop 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 10 monclient: shutdown 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 msgr2=0x7faad8150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.216 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 --2- 10.20.193.7:0/3922106307 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faad8091c70 0x7faad8150520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faac8009070 tx=0x7faac80192a0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faaddf13640 1 -- 10.20.193.7:0/3922106307 reap_dead start 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faaddf13640 1 -- 10.20.193.7:0/3922106307 reap_dead start 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 shutdown_connections 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 >> 10.20.193.7:0/3922106307 conn(0x7faad8093d80 msgr2=0x7faad808d630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 shutdown_connections 2026-02-22T20:56:20.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.184+0000 7faadf99d640 1 -- 10.20.193.7:0/3922106307 wait complete. 2026-02-22T20:56:20.217 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:20.217 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:56:20.217 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: get_monmap_and_config 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: monmap: 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:20.282911+0000 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:20.282911+0000 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.291 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 Processor -- start 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 -- start start 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: init 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f42a808b590 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f42a813a6a0 0x7f42a817e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-c con 0x7f42a813a6a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:20.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f42a817e8b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a8089920 con 0x7f42a817e8b0 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a808a860 con 0x7f42a808b590 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f42a813aad0 con 0x7f42a813a6a0 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.276+0000 7f42ae6a6640 10 monclient(hunting): authenticate will time out at 792.755997s 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f42a817e8b0 0x7f42a819ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59938/0 (socket says 10.20.193.7:59938) 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 1 -- 10.20.193.7:0/3865367400 learned_addr learned my addr 10.20.193.7:0/3865367400 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 1 --2- 10.20.193.7:0/3865367400 >> v2:10.20.193.61:3300/0 conn(0x7f42a813a6a0 0x7f42a817e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): get_auth_request con 0x7f42a813a6a0 auth_method 0 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101470604 0 0) 0x7f42a8089920 con 0x7f42a817e8b0 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _negotiate 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): my global_id is 84132 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c003620 con 0x7f42a817e8b0 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238913019 0 0) 0x7f42a808a860 con 0x7f42a808b590 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _negotiate 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): my global_id is 74347 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a8089920 con 0x7f42a808b590 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3628498542 0 0) 0x7f428c003620 con 0x7f42a817e8b0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 >> v2:10.20.193.61:3300/0 conn(0x7f42a813a6a0 msgr2=0x7f42a817e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 --2- 10.20.193.7:0/3865367400 >> v2:10.20.193.61:3300/0 conn(0x7f42a813a6a0 0x7f42a817e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 >> v1:10.20.193.61:6789/0 conn(0x7f42a808b590 legacy=0x7f42a8139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a8089170 con 0x7f42a817e8b0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f429c0031e0 con 0x7f42a817e8b0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:56:20.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: dump: 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 >> v1:10.20.193.7:6789/0 conn(0x7f42a817e8b0 legacy=0x7f42a819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 0x7f428c0041e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): picked mon.a con 0x7f428c003df0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f428c004920 0x7f428c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): picked mon.c con 0x7f428c004920 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c0054a0 0x7f428c065af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): picked mon.b con 0x7f428c0054a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42a813aad0 con 0x7f428c003df0 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f428c0663d0 con 0x7f428c0054a0 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f428c0665d0 con 0x7f428c004920 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:56:20.297 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 0x7f428c0041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f428c004920 0x7f428c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): get_auth_request con 0x7f428c003df0 auth_method 0 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): get_auth_request con 0x7f428c004920 auth_method 0 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:20.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient(hunting): handle_auth_done global_id 84132 payload 293 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 -- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f428c004920 msgr2=0x7f428c004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f428c004920 0x7f428c004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c0054a0 0x7f428c065af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 -- 10.20.193.7:0/3865367400 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c0054a0 msgr2=0x7f428c065af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c0054a0 0x7f428c065af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 monclient: found mon.a 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 -- 10.20.193.7:0/3865367400 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c003620 con 0x7f428c003df0 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 5 monclient: authenticate success, global_id 84132 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:20.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 10 monclient: get_auth_request con 0x7f428c0054a0 auth_method 0 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c0054a0 0x7f428c065af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42acc1c640 1 -- 10.20.193.7:0/3865367400 reap_dead start 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a7fff640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 0x7f428c0041e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f42940027f0 tx=0x7f429401c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88bbed6bb0fa794 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294002dc0 con 0x7f428c003df0 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: dump: 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.300 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42940052a0 con 0x7f428c003df0 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 1 -- 10.20.193.7:0/3865367400 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42940068d0 con 0x7f428c003df0 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 4 set_mon_vals no callback set 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42a6ffd640 10 monclient: dump: 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.301 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 10 monclient: shutdown 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 msgr2=0x7f428c0041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 0x7f428c0041e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f42940027f0 tx=0x7f429401c5b0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- 10.20.193.7:0/3865367400 shutdown_connections 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/3865367400 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f428c003df0 0x7f428c0041e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- 10.20.193.7:0/3865367400 >> 10.20.193.7:0/3865367400 conn(0x7f42a808faa0 msgr2=0x7f42a808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- 10.20.193.7:0/3865367400 shutdown_connections 2026-02-22T20:56:20.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- 10.20.193.7:0/3865367400 wait complete. 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 10 monclient: build_initial_monmap 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 10 monclient: monmap: 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 Processor -- start 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 1 -- start start 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.280+0000 7f42ae6a6640 10 monclient: init 2026-02-22T20:56:20.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c003df0 0x7f42a8124a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-b con 0x7f428c003df0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-a con 0x7f42a8128c40 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42a8125510 0x7f42a8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): picked mon.noname-c con 0x7f42a8125510 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f42a813db90 con 0x7f42a8128c40 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f42a813da10 con 0x7f428c003df0 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f42a813dd10 con 0x7f42a8125510 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:20.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient(hunting): authenticate will time out at 792.760160s 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42a8125510 0x7f42a8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49300/0 (socket says 10.20.193.7:49300) 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 -- 10.20.193.7:0/741092410 learned_addr learned my addr 10.20.193.7:0/741092410 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): get_auth_request con 0x7f42a8128c40 auth_method 0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): get_auth_request con 0x7f42a8125510 auth_method 0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c003df0 0x7f42a8124a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): get_auth_request con 0x7f428c003df0 auth_method 0 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:20.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42acc1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient(hunting): handle_auth_done global_id 84135 payload 824 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 -- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42a8125510 msgr2=0x7f42a8113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42a8125510 0x7f42a8113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 -- 10.20.193.7:0/741092410 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c003df0 msgr2=0x7f42a8124a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.306 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c003df0 0x7f42a8124a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient: _finish_hunting 0 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 monclient: found mon.noname-a 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 -- 10.20.193.7:0/741092410 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81279b0 con 0x7f42a8128c40 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a77fe640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42980093c0 tx=0x7f429800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298019070 con 0x7f42a8128c40 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: dump: 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.308 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: _finish_auth 0 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429800fd20 con 0x7f42a8128c40 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298004270 con 0x7f42a8128c40 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 10 monclient: dump: 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:20.309 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a67fc640 4 set_mon_vals no callback set 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 5 monclient: authenticate success, global_id 84135 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _renew_subs 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a8128820 con 0x7f42a8128c40 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _renew_subs 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a8086690 con 0x7f42a8128c40 2026-02-22T20:56:20.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a80382a0 con 0x7f42a8128c40 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4298003710 con 0x7f42a8128c40 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 --2- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 0x7f427805af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(147..147 src has 64..147) ==== 3897+0+0 (secure 0 0 0) 0x7f429804f4c0 con 0x7f42a8128c40 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 1 --2- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 0x7f427805af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 10 monclient: get_auth_request con 0x7f427803aac0 auth_method 0 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.284+0000 7f42a7fff640 1 --2- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 0x7f427805af70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f429401c5f0 tx=0x7f4294002b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:20.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.288+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f429801cc60 con 0x7f42a8128c40 2026-02-22T20:56:20.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.288+0000 7f42a4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:20.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.288+0000 7f42a4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:20.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42ae6a6640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:56:20.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42ae6a6640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:56:20.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42ae6a6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:20.403 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f42a805fc70 con 0x7f42a8128c40 2026-02-22T20:56:20.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42a4ff9640 1 -- 10.20.193.7:0/741092410 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f4298003a30 con 0x7f42a8128c40 2026-02-22T20:56:20.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42a4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:56:20.404 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.396+0000 7f42a4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=785642080,config=3140514009,health=3525617350,kv=3991984195,logm=4217030587}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=9,logm=61} crc {auth=962789816,config=3140514009,health=3525617350,kv=3703866186,logm=697902488}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=785642080,config=3140514009,health=3525617350,kv=3991984195,logm=4217030587}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.396+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=962789816,config=3140514009,health=3525617350,kv=3991984195,logm=2884553530}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2912408862}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2624434261}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2912408862}) 2026-02-22T20:56:20.405 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1940967065}) 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 msgr2=0x7f427805af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 0x7f427805af70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f429401c5f0 tx=0x7f4294002b40 comp rx=0 tx=0).stop 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 10 monclient: shutdown 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 msgr2=0x7f42a8124fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42980093c0 tx=0x7f429800f610 comp rx=0 tx=0).stop 2026-02-22T20:56:20.406 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 shutdown_connections 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f42a8125510 0x7f42a8113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f42a8128c40 0x7f42a8124fd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> v2:10.20.193.61:6800/2336688312 conn(0x7f427803aac0 0x7f427805af70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 --2- 10.20.193.7:0/741092410 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f428c003df0 0x7f42a8124a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 >> 10.20.193.7:0/741092410 conn(0x7f42a808faa0 msgr2=0x7f42a81394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 shutdown_connections 2026-02-22T20:56:20.407 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:20.400+0000 7f42ae6a6640 1 -- 10.20.193.7:0/741092410 wait complete. 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246146189}) 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=136053909}) 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246146189}) 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2732894090}) 2026-02-22T20:56:20.409 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132886199}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2380235001}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132886199}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2060830139}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255408213}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3523493605}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255408213}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2401125804}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=452793999}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1516970453}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=452793999}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=416015804}) 2026-02-22T20:56:20.410 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1435274896}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2450228355}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1435274896}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3550800224}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1288086804}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4066540287}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1288086804}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.400+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4250588854}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262849848}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3718937160}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262849848}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3364735549}) 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.411 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2590162198}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=413218045}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2590162198}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2736626329}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=415179894}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3213358352}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=415179894}) 2026-02-22T20:56:20.412 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2066577650}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {logm=3059071217,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=207640111,mon_config_key=2253064668,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2580956735,osd_pg_creating=1780997533,osd_snap=4133920409,osdmap=1290156368}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=27,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=34} crc {logm=4076740929,mdsmap=1256979634,mgr=837930825,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=831471665,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=935146538,osd_metadata=2506443526,osd_pg_creating=1780997533,osd_snap=4133920409,osdmap=1513119418}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {logm=3059071217,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=207640111,mon_config_key=2253064668,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2580956735,osd_pg_creating=1780997533,osd_snap=4133920409,osdmap=1290156368}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.404+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=23,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=38} crc {logm=569072066,mdsmap=774328894,mgr=1069082712,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=207640111,mon_config_key=1023171130,monmap=117723248,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1780997533,osd_snap=4133920409,osdmap=333957813}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=99} crc {osdmap=2092810601}) 2026-02-22T20:56:20.413 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3609971840}) 2026-02-22T20:56:20.414 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:56:20.414 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=99} crc {osdmap=2092810601}) 2026-02-22T20:56:20.414 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:56:20.408+0000 7f0e3f832640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3017708232}) 2026-02-22T20:56:20.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:56:20.688 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20554]: starting. 2026-02-22T20:56:20.689 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20554]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20552 2026-02-22T20:56:20.689 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20554]: shutting down. 2026-02-22T20:56:21.415 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:56:21.416 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:56:21.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: get_monmap_and_config 2026-02-22T20:56:21.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: monmap: 2026-02-22T20:56:21.489 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.489 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:21.486189+0000 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:21.486189+0000 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:21.490 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 Processor -- start 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 -- start start 2026-02-22T20:56:21.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: init 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 0x7f489005d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): picked mon.noname-c con 0x7f489013c6e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): picked mon.noname-b con 0x7f489013f180 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f489013fae0 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f489008a850 con 0x7f489013fae0 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f489008a610 con 0x7f489013c6e0 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f489008bc70 con 0x7f489013f180 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f4896062640 10 monclient(hunting): authenticate will time out at 793.959243s 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41450/0 (socket says 10.20.193.7:41450) 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 -- 10.20.193.7:0/1312601129 learned_addr learned my addr 10.20.193.7:0/1312601129 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): get_auth_request con 0x7f489013f180 auth_method 0 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.493 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 1 --2- 10.20.193.7:0/1312601129 >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 0x7f489005d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 10 monclient(hunting): get_auth_request con 0x7f489013c6e0 auth_method 0 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.494 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient(hunting): handle_auth_done global_id 64532 payload 274 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 -- 10.20.193.7:0/1312601129 >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 msgr2=0x7f489005d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 --2- 10.20.193.7:0/1312601129 >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 0x7f489005d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 -- 10.20.193.7:0/1312601129 >> v1:10.20.193.61:6789/0 conn(0x7f489013fae0 legacy=0x7f48901a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.495 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 monclient: found mon.noname-b 2026-02-22T20:56:21.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488effd640 1 -- 10.20.193.7:0/1312601129 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489008a390 con 0x7f489013f180 2026-02-22T20:56:21.496 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.480+0000 7f488f7fe640 1 --2- 10.20.193.7:0/1312601129 >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 0x7f489005d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:56:21.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 1 --2- 10.20.193.7:0/1312601129 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48800090a0 tx=0x7f488001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601c61c3ce3cf7d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 1 -- 10.20.193.7:0/1312601129 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48800ad630 con 0x7f489013f180 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: dump: 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.504 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.505 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 1 -- 10.20.193.7:0/1312601129 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48800ad7d0 con 0x7f489013f180 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 1 -- 10.20.193.7:0/1312601129 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48800adba0 con 0x7f489013f180 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 5 monclient: authenticate success, global_id 64532 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:21.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488e7fc640 10 monclient: dump: 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.507 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 4 set_mon_vals no callback set 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: shutdown 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/1312601129 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 msgr2=0x7f489013f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- 10.20.193.7:0/1312601129 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48800090a0 tx=0x7f488001c500 comp rx=0 tx=0).stop 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/1312601129 shutdown_connections 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- 10.20.193.7:0/1312601129 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013f180 0x7f489013f5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- 10.20.193.7:0/1312601129 >> v2:10.20.193.61:3300/0 conn(0x7f489013c6e0 0x7f489005d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/1312601129 >> 10.20.193.7:0/1312601129 conn(0x7f489008f860 msgr2=0x7f489008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/1312601129 shutdown_connections 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/1312601129 wait complete. 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: monmap: 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.509 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 Processor -- start 2026-02-22T20:56:21.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- start start 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: init 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f489013c6e0 0x7f48901504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): picked mon.noname-a con 0x7f489013c6e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f489013f180 0x7f4890150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): picked mon.noname-b con 0x7f489013f180 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): picked mon.noname-c con 0x7f489013fae0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f489005d970 con 0x7f489013c6e0 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f489005d7f0 con 0x7f489013f180 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f48901a4450 con 0x7f489013fae0 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient(hunting): authenticate will time out at 793.963338s 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41462/0 (socket says 10.20.193.7:41462) 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 -- 10.20.193.7:0/3082833364 learned_addr learned my addr 10.20.193.7:0/3082833364 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): get_auth_request con 0x7f489013fae0 auth_method 0 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f489013c6e0 0x7f48901504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f489013f180 0x7f4890150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.513 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): get_auth_request con 0x7f489013c6e0 auth_method 0 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 10 monclient(hunting): get_auth_request con 0x7f489013f180 auth_method 0 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.514 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient(hunting): handle_auth_done global_id 64535 payload 824 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 -- 10.20.193.7:0/3082833364 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f489013f180 msgr2=0x7f4890150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f489013f180 0x7f4890150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 -- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f489013c6e0 msgr2=0x7f48901504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f489013c6e0 0x7f48901504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 monclient: found mon.noname-c 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.515 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 -- 10.20.193.7:0/3082833364 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4890086620 con 0x7f489013fae0 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488ffff640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f488400cc00 tx=0x7f488400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488400ad40 con 0x7f489013fae0 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: dump: 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.516 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884004a60 con 0x7f489013fae0 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884004e50 con 0x7f489013fae0 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f486bfff640 10 monclient: dump: 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.518 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f488dffb640 4 set_mon_vals no callback set 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 5 monclient: authenticate success, global_id 64535 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _renew_subs 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489013b930 con 0x7f489013fae0 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _renew_subs 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.484+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f489012cae0 con 0x7f489013fae0 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f4896062640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f4896062640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f4896062640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48900382a0 con 0x7f489013fae0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4884023060 con 0x7f489013fae0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 1 --2- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 0x7f486005b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(148..148 src has 64..148) ==== 3503+0+0 (secure 0 0 0) 0x7f488404ee50 con 0x7f489013fae0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f488f7fe640 1 --2- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 0x7f486005b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f488f7fe640 10 monclient: get_auth_request con 0x7f486003acc0 auth_method 0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f488f7fe640 1 --2- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 0x7f486005b170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f489008b330 tx=0x7f487c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f48840161c0 con 0x7f489013fae0 2026-02-22T20:56:21.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.488+0000 7f486bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f489012b020 con 0x7f489013fae0 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f486bfff640 1 -- 10.20.193.7:0/3082833364 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f4884050070 con 0x7f489013fae0 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f486bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f486bfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:21.606 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 msgr2=0x7f486005b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 0x7f486005b170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f489008b330 tx=0x7f487c008040 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 10 monclient: shutdown 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 msgr2=0x7f4890129690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f488400cc00 tx=0x7f488400a430 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 shutdown_connections 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f489013fae0 0x7f4890129690 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> v2:10.20.193.61:6800/2336688312 conn(0x7f486003acc0 0x7f486005b170 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f489013f180 0x7f4890150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 --2- 10.20.193.7:0/3082833364 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f489013c6e0 0x7f48901504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 >> 10.20.193.7:0/3082833364 conn(0x7f489008f860 msgr2=0x7f489005bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 shutdown_connections 2026-02-22T20:56:21.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.600+0000 7f4896062640 1 -- 10.20.193.7:0/3082833364 wait complete. 2026-02-22T20:56:21.616 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:56:21.616 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:56:21.617 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:56:21.617 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:56:21.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: get_monmap_and_config 2026-02-22T20:56:21.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: monmap: 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:21.674727+0000 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:21.674727+0000 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:21.676 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 Processor -- start 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 -- start start 2026-02-22T20:56:21.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: init 2026-02-22T20:56:21.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-b con 0x7f32d413f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f32d4055a70 0x7f32d4055ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-a con 0x7f32d4055a70 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f32d40563e0 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d4056880 con 0x7f32d40563e0 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f32d413f110 con 0x7f32d4055a70 2026-02-22T20:56:21.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f32d4087300 con 0x7f32d413f780 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d9d5e640 10 monclient(hunting): authenticate will time out at 794.147905s 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32d8d5c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.668+0000 7f32cbfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f32d4055a70 0x7f32d4055ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f32d4055a70 0x7f32d4055ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49320/0 (socket says 10.20.193.7:49320) 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/2300176815 learned_addr learned my addr 10.20.193.7:0/2300176815 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d413fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41468/0 (socket says 10.20.193.7:41468) 2026-02-22T20:56:21.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): get_auth_request con 0x7f32d4055a70 auth_method 0 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request con 0x7f32d413f780 auth_method 0 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_done global_id 84153 payload 274 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 msgr2=0x7f32d413fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d413fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/2300176815 >> v1:10.20.193.61:6789/0 conn(0x7f32d40563e0 legacy=0x7f32d41a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 monclient: found mon.noname-a 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/2300176815 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d4091820 con 0x7f32d4055a70 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d4055a70 0x7f32d4055ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0090a0 tx=0x7f32bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c47ebf37a8a3abc server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 1 -- 10.20.193.7:0/2300176815 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0aa680 con 0x7f32d4055a70 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: dump: 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.693 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 1 -- 10.20.193.7:0/2300176815 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc0af070 con 0x7f32d4055a70 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 5 monclient: authenticate success, global_id 84153 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 1 -- 10.20.193.7:0/2300176815 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0aaa40 con 0x7f32d4055a70 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cb7fe640 10 monclient: dump: 2026-02-22T20:56:21.695 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:21.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 4 set_mon_vals no callback set 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: shutdown 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d4055a70 msgr2=0x7f32d4055ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d4055a70 0x7f32d4055ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0090a0 tx=0x7f32bc01c500 comp rx=0 tx=0).stop 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/2300176815 shutdown_connections 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d4055a70 0x7f32d4055ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/2300176815 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d413fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/2300176815 >> 10.20.193.7:0/2300176815 conn(0x7f32d40906f0 msgr2=0x7f32d4090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/2300176815 shutdown_connections 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/2300176815 wait complete. 2026-02-22T20:56:21.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: monmap: 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 Processor -- start 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- start start 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: init 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32d4055a70 0x7f32d4150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-b con 0x7f32d4055a70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 0x7f32d4150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-a con 0x7f32d40563e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d412cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): picked mon.noname-c con 0x7f32d413f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41a4500 con 0x7f32d40563e0 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41a4380 con 0x7f32d4055a70 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f32d41a4680 con 0x7f32d413f780 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient(hunting): authenticate will time out at 794.151363s 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 0x7f32d4150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 0x7f32d4150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49322/0 (socket says 10.20.193.7:49322) 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/1771987175 learned_addr learned my addr 10.20.193.7:0/1771987175 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): get_auth_request con 0x7f32d40563e0 auth_method 0 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d412cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): get_auth_request con 0x7f32d413f780 auth_method 0 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32d4055a70 0x7f32d4150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d955d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request con 0x7f32d4055a70 auth_method 0 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d8d5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient(hunting): handle_auth_done global_id 84156 payload 824 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 msgr2=0x7f32d412cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f32d413f780 0x7f32d412cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32d4055a70 msgr2=0x7f32d4150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f32d4055a70 0x7f32d4150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 monclient: found mon.noname-a 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d408a0c0 con 0x7f32d40563e0 2026-02-22T20:56:21.703 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32cbfff640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 0x7f32d4150a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f32bc002410 tx=0x7f32bc01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc004220 con 0x7f32d40563e0 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: dump: 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.704 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc0043c0 con 0x7f32d40563e0 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0aae30 con 0x7f32d40563e0 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32c97fa640 10 monclient: dump: 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.706 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 5 monclient: authenticate success, global_id 84156 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32caffd640 4 set_mon_vals no callback set 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _renew_subs 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d408a9e0 con 0x7f32d40563e0 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _renew_subs 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.672+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4130890 con 0x7f32d40563e0 2026-02-22T20:56:21.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d9d5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 0x7f32d412d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32d413fb50 con 0x7f32d412d140 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 0x7f32d412d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient: get_auth_request con 0x7f32d412d140 auth_method 0 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f32bc003710 con 0x7f32d40563e0 2026-02-22T20:56:21.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_done global_id 84159 payload 824 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32d4056b30 con 0x7f32d412d140 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 --2- 10.20.193.7:0/1771987175 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32a403ab20 0x7f32a405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(148..148 src has 64..148) ==== 3503+0+0 (secure 0 0 0) 0x7f32bc0e9450 con 0x7f32d40563e0 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d8d5c640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 0x7f32d412d510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32c4004780 tx=0x7f32c4011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c400fa30 con 0x7f32d412d140 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 10 monclient: dump: 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.709 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d955d640 1 --2- 10.20.193.7:0/1771987175 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32a403ab20 0x7f32a405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d955d640 10 monclient: get_auth_request con 0x7f32a403ab20 auth_method 0 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f32c400fa30 con 0x7f32d412d140 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 msgr2=0x7f32d412d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 0x7f32d412d510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32c4004780 tx=0x7f32c4011c90 comp rx=0 tx=0).stop 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 msgr2=0x7f32d412d510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32c97fa640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412d140 0x7f32d412d510 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32c4004780 tx=0x7f32c4011c90 comp rx=0 tx=0).stop 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.676+0000 7f32d955d640 1 --2- 10.20.193.7:0/1771987175 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32a403ab20 0x7f32a405afd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f32d0002b90 tx=0x7f32d0003320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 0x7f32d408bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32d412f090 con 0x7f32d412da50 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 0x7f32d408bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient: get_auth_request con 0x7f32d412da50 auth_method 0 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 10 monclient(hunting): handle_auth_done global_id 84162 payload 824 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 1 -- 10.20.193.7:0/1771987175 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32d405faa0 con 0x7f32d412da50 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d8d5c640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 0x7f32d408bc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32c4019000 tx=0x7f32c40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4022b30 con 0x7f32d412da50 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 10 monclient: dump: 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.712 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7f32c4026070 con 0x7f32d412da50 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:21.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 msgr2=0x7f32d408bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 0x7f32d408bc00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32c4019000 tx=0x7f32c40047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 msgr2=0x7f32d408bc00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32c97fa640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d412da50 0x7f32d408bc00 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f32c4019000 tx=0x7f32c40047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 8343, 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:21.715 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.716 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.717 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:21.718 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.719 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.720 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.721 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.722 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:21.723 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:21.724 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:21.725 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32a403ab20 msgr2=0x7f32a405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/1771987175 >> v2:10.20.193.61:6800/2336688312 conn(0x7f32a403ab20 0x7f32a405afd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f32d0002b90 tx=0x7f32d0003320 comp rx=0 tx=0).stop 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 10 monclient: shutdown 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 msgr2=0x7f32d4150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 --2- 10.20.193.7:0/1771987175 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f32d40563e0 0x7f32d4150a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f32bc002410 tx=0x7f32bc01ad40 comp rx=0 tx=0).stop 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d955d640 1 -- 10.20.193.7:0/1771987175 reap_dead start 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d955d640 1 -- 10.20.193.7:0/1771987175 reap_dead start 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 shutdown_connections 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 >> 10.20.193.7:0/1771987175 conn(0x7f32d40906f0 msgr2=0x7f32d408f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 shutdown_connections 2026-02-22T20:56:21.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.680+0000 7f32d9d5e640 1 -- 10.20.193.7:0/1771987175 wait complete. 2026-02-22T20:56:21.727 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:21.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:56:21.728 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: get_monmap_and_config 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: monmap: 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:21.791001+0000 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:21.791001+0000 2026-02-22T20:56:21.800 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 Processor -- start 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 -- start start 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: init 2026-02-22T20:56:21.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient: _add_conns ranks=[3,0,4,1,2] 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f16bc13f290 0x7f16bc13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc13f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f16bc13fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f16bc13c680 0x7f16bc1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc13c680 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc08fd70 con 0x7f16bc13fba0 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc08e1f0 con 0x7f16bc13f290 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc08ec90 con 0x7f16bc13c680 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.784+0000 7f16c0c35640 10 monclient(hunting): authenticate will time out at 794.263991s 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f16bc13f290 0x7f16bc13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f16bc13fba0 0x7f16bc13bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59948/0 (socket says 10.20.193.7:59948) 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 1 -- 10.20.193.7:0/599424951 learned_addr learned my addr 10.20.193.7:0/599424951 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): get_auth_request con 0x7f16bc13f290 auth_method 0 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 1 --2- 10.20.193.7:0/599424951 >> v2:10.20.193.61:3300/0 conn(0x7f16bc13c680 0x7f16bc1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): get_auth_request con 0x7f16bc13c680 auth_method 0 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_done global_id 84165 payload 274 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/599424951 >> v2:10.20.193.61:3300/0 conn(0x7f16bc13c680 msgr2=0x7f16bc1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- 10.20.193.7:0/599424951 >> v2:10.20.193.61:3300/0 conn(0x7f16bc13c680 0x7f16bc1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/599424951 >> v1:10.20.193.7:6789/0 conn(0x7f16bc13fba0 legacy=0x7f16bc13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 monclient: found mon.noname-a 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/599424951 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc092bc0 con 0x7f16bc13f290 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- 10.20.193.7:0/599424951 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13f290 0x7f16bc13f660 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16bc08f390 tx=0x7f16b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c896cfc92a6935 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 1 -- 10.20.193.7:0/599424951 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00b1070 con 0x7f16bc13f290 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: dump: 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.805 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 1 -- 10.20.193.7:0/599424951 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b00ac630 con 0x7f16bc13f290 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 1 -- 10.20.193.7:0/599424951 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00a8050 con 0x7f16bc13f290 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9573640 10 monclient: dump: 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.807 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 5 monclient: authenticate success, global_id 84165 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 4 set_mon_vals no callback set 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: shutdown 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- 10.20.193.7:0/599424951 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13f290 msgr2=0x7f16bc13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- 10.20.193.7:0/599424951 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13f290 0x7f16bc13f660 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16bc08f390 tx=0x7f16b001c3d0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- 10.20.193.7:0/599424951 shutdown_connections 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- 10.20.193.7:0/599424951 >> v2:10.20.193.61:3300/0 conn(0x7f16bc13c680 0x7f16bc1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- 10.20.193.7:0/599424951 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13f290 0x7f16bc13f660 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- 10.20.193.7:0/599424951 >> 10.20.193.7:0/599424951 conn(0x7f16bc093df0 msgr2=0x7f16bc0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- 10.20.193.7:0/599424951 shutdown_connections 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- 10.20.193.7:0/599424951 wait complete. 2026-02-22T20:56:21.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: monmap: 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 Processor -- start 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- start start 2026-02-22T20:56:21.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: init 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc13c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16bc13f290 0x7f16bc12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-b con 0x7f16bc13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc13fba0 0x7f16bc12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc090de0 con 0x7f16bc13c680 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc090c60 con 0x7f16bc13f290 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc1a4540 con 0x7f16bc13fba0 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16c0c35640 10 monclient(hunting): authenticate will time out at 794.267598s 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49360/0 (socket says 10.20.193.7:49360) 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/1548091677 learned_addr learned my addr 10.20.193.7:0/1548091677 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): get_auth_request con 0x7f16bc13c680 auth_method 0 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc13fba0 0x7f16bc12a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): get_auth_request con 0x7f16bc13fba0 auth_method 0 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16bc13f290 0x7f16bc12a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 10 monclient(hunting): get_auth_request con 0x7f16bc13f290 auth_method 0 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16bad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient(hunting): handle_auth_done global_id 84171 payload 824 2026-02-22T20:56:21.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc13fba0 msgr2=0x7f16bc12a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc13fba0 0x7f16bc12a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16bc13f290 msgr2=0x7f16bc12a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f16bc13f290 0x7f16bc12a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 monclient: found mon.noname-a 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc12d4d0 con 0x7f16bc13c680 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.788+0000 7f16ba575640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16b001c940 tx=0x7f16b0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00b1040 con 0x7f16bc13c680 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: dump: 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.813 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b00ba070 con 0x7f16bc13c680 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00ac9e0 con 0x7f16bc13c680 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: dump: 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b8d72640 4 set_mon_vals no callback set 2026-02-22T20:56:21.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 5 monclient: authenticate success, global_id 84171 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 monclient: _renew_subs 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc12d7b0 con 0x7f16bc13c680 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 monclient: _renew_subs 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc12cc20 con 0x7f16bc13c680 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 0x7f16bc0889b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc12d1f0 con 0x7f16bc0885e0 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 0x7f16bc0889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient: get_auth_request con 0x7f16bc0885e0 auth_method 0 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f16b00b4070 con 0x7f16bc13c680 2026-02-22T20:56:21.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 10 monclient(hunting): handle_auth_done global_id 64547 payload 824 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16bc13f660 con 0x7f16bc0885e0 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 --2- 10.20.193.7:0/1548091677 >> v2:10.20.193.61:6800/2336688312 conn(0x7f168803ab70 0x7f168805b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(149..149 src has 64..149) ==== 3897+0+0 (secure 0 0 0) 0x7f16b00e7f20 con 0x7f16bc13c680 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16b9d74640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 0x7f16bc0889b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a40059b0 con 0x7f16bc0885e0 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: dump: 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.817 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16bad76640 1 --2- 10.20.193.7:0/1548091677 >> v2:10.20.193.61:6800/2336688312 conn(0x7f168803ab70 0x7f168805b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16bad76640 10 monclient: get_auth_request con 0x7f168803ab70 auth_method 0 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f16a4018070 con 0x7f16bc0885e0 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 msgr2=0x7f16bc0889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 0x7f16bc0889b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a400eb90 comp rx=0 tx=0).stop 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 msgr2=0x7f16bc0889b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16a2ffd640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc0885e0 0x7f16bc0889b0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a400eb90 comp rx=0 tx=0).stop 2026-02-22T20:56:21.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.792+0000 7f16bad76640 1 --2- 10.20.193.7:0/1548091677 >> v2:10.20.193.61:6800/2336688312 conn(0x7f168803ab70 0x7f168805b020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16ac004b00 tx=0x7f16ac009820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 0x7f16bc1908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc13c3c0 con 0x7f16bc088ef0 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 0x7f16bc1908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient: get_auth_request con 0x7f16bc088ef0 auth_method 0 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 10 monclient(hunting): handle_auth_done global_id 64550 payload 824 2026-02-22T20:56:21.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 1 -- 10.20.193.7:0/1548091677 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16bc05fb50 con 0x7f16bc088ef0 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16b9d74640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 0x7f16bc1908c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a40058f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4005c80 con 0x7f16bc088ef0 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 10 monclient: dump: 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7f16a4005c80 con 0x7f16bc088ef0 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 msgr2=0x7f16bc1908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 0x7f16bc1908c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a40058f0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 msgr2=0x7f16bc1908c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16a2ffd640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f16bc088ef0 0x7f16bc1908c0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002770 tx=0x7f16a40058f0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 107400, 2026-02-22T20:56:21.822 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.823 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.824 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:21.825 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:21.826 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.827 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.829 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:21.831 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 >> v2:10.20.193.61:6800/2336688312 conn(0x7f168803ab70 msgr2=0x7f168805b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 --2- 10.20.193.7:0/1548091677 >> v2:10.20.193.61:6800/2336688312 conn(0x7f168803ab70 0x7f168805b020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16ac004b00 tx=0x7f16ac009820 comp rx=0 tx=0).stop 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 10 monclient: shutdown 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 msgr2=0x7f16bc129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16bad76640 1 -- 10.20.193.7:0/1548091677 reap_dead start 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f16b001c940 tx=0x7f16b0019170 comp rx=0 tx=0).stop 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 shutdown_connections 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 --2- 10.20.193.7:0/1548091677 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f16bc13c680 0x7f16bc129e50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 >> 10.20.193.7:0/1548091677 conn(0x7f16bc093df0 msgr2=0x7f16bc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 shutdown_connections 2026-02-22T20:56:21.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.796+0000 7f16c0c35640 1 -- 10.20.193.7:0/1548091677 wait complete. 2026-02-22T20:56:21.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:21.833 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:56:21.833 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:56:21.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.884+0000 7f4d87395640 10 monclient: get_monmap_and_config 2026-02-22T20:56:21.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.884+0000 7f4d87395640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.884+0000 7f4d87395640 10 monclient: monmap: 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:21.891345+0000 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:21.891345+0000 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:21.892 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 Processor -- start 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- start start 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: init 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 0x7f4d80139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-c con 0x7f4d8008b590 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 0x7f4d8013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-b con 0x7f4d8013a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4d8013d530 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d80089920 con 0x7f4d8013d530 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8008ab40 con 0x7f4d8008b590 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8008a860 con 0x7f4d8013a4d0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient(hunting): authenticate will time out at 794.364635s 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 0x7f4d8013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d8590b640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f4d8013d530 0x7f4d8019e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:59954/0 (socket says 10.20.193.7:59954) 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d8590b640 1 -- 10.20.193.7:0/4246134359 learned_addr learned my addr 10.20.193.7:0/4246134359 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): get_auth_request con 0x7f4d8013a4d0 auth_method 0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d8510a640 1 --2- 10.20.193.7:0/4246134359 >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 0x7f4d80139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient(hunting): handle_auth_done global_id 64553 payload 274 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 -- 10.20.193.7:0/4246134359 >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 msgr2=0x7f4d80139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 --2- 10.20.193.7:0/4246134359 >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 0x7f4d80139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 -- 10.20.193.7:0/4246134359 >> v1:10.20.193.7:6789/0 conn(0x7f4d8013d530 legacy=0x7f4d8019e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 monclient: found mon.noname-b 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 -- 10.20.193.7:0/4246134359 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d80089170 con 0x7f4d8013a4d0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d8510a640 10 monclient: get_auth_request con 0x7f4d8008b590 auth_method 0 2026-02-22T20:56:21.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d8510a640 1 --2- 10.20.193.7:0/4246134359 >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 0x7f4d80139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:56:21.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d84909640 1 --2- 10.20.193.7:0/4246134359 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 0x7f4d8013cff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d74004780 tx=0x7f4d7401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b501fe9bd7e033f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 1 -- 10.20.193.7:0/4246134359 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740b1070 con 0x7f4d8013a4d0 2026-02-22T20:56:21.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: dump: 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 1 -- 10.20.193.7:0/4246134359 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d740a8050 con 0x7f4d8013a4d0 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 1 -- 10.20.193.7:0/4246134359 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740ac860 con 0x7f4d8013a4d0 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d6ffff640 10 monclient: dump: 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.896 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 5 monclient: authenticate success, global_id 64553 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 4 set_mon_vals no callback set 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: shutdown 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- 10.20.193.7:0/4246134359 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 msgr2=0x7f4d8013cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 --2- 10.20.193.7:0/4246134359 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 0x7f4d8013cff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d74004780 tx=0x7f4d7401c4d0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- 10.20.193.7:0/4246134359 shutdown_connections 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 --2- 10.20.193.7:0/4246134359 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013a4d0 0x7f4d8013cff0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 --2- 10.20.193.7:0/4246134359 >> v2:10.20.193.61:3300/0 conn(0x7f4d8008b590 0x7f4d80139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- 10.20.193.7:0/4246134359 >> 10.20.193.7:0/4246134359 conn(0x7f4d8008faa0 msgr2=0x7f4d8008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- 10.20.193.7:0/4246134359 shutdown_connections 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- 10.20.193.7:0/4246134359 wait complete. 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: build_initial_monmap 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: monmap: 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:21.897 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 Processor -- start 2026-02-22T20:56:21.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 1 -- start start 2026-02-22T20:56:21.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.888+0000 7f4d87395640 10 monclient: init 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8008b590 0x7f4d801506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-b con 0x7f4d8008b590 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-a con 0x7f4d8013a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013d530 0x7f4d80139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): picked mon.noname-c con 0x7f4d8013d530 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801a2440 con 0x7f4d8013a4d0 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801a22c0 con 0x7f4d8008b590 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4d801a25c0 con 0x7f4d8013d530 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): authenticate will time out at 794.368167s 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49362/0 (socket says 10.20.193.7:49362) 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 -- 10.20.193.7:0/2322538038 learned_addr learned my addr 10.20.193.7:0/2322538038 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): get_auth_request con 0x7f4d8013a4d0 auth_method 0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013d530 0x7f4d80139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): get_auth_request con 0x7f4d8013d530 auth_method 0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8008b590 0x7f4d801506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): get_auth_request con 0x7f4d8008b590 auth_method 0 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient(hunting): handle_auth_done global_id 84177 payload 824 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013d530 msgr2=0x7f4d80139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4d8013d530 0x7f4d80139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8008b590 msgr2=0x7f4d801506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8008b590 0x7f4d801506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient: _finish_hunting 0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 monclient: found mon.noname-a 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8012b6e0 con 0x7f4d8013a4d0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8008b590 0x7f4d801506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d84909640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d7401ca40 tx=0x7f4d74019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740b1040 con 0x7f4d8013a4d0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: dump: 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: _finish_auth 0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d740ba070 con 0x7f4d8013a4d0 2026-02-22T20:56:21.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74003bd0 con 0x7f4d8013a4d0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6f7fe640 4 set_mon_vals no callback set 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: dump: 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 5 monclient: authenticate success, global_id 84177 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _renew_subs 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8013cd40 con 0x7f4d8013a4d0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _renew_subs 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8012da40 con 0x7f4d8013a4d0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 0x7f4d8012a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4d800382a0 con 0x7f4d80129d10 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4d740b4070 con 0x7f4d8013a4d0 2026-02-22T20:56:21.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 0x7f4d8012a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient: get_auth_request con 0x7f4d80129d10 auth_method 0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 --2- 10.20.193.7:0/2322538038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4d5003ab10 0x7f4d5005afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 10 monclient(hunting): handle_auth_done global_id 74395 payload 824 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(149..149 src has 64..149) ==== 3897+0+0 (secure 0 0 0) 0x7f4d740e83d0 con 0x7f4d8013a4d0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d80139f90 con 0x7f4d80129d10 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 1 --2- 10.20.193.7:0/2322538038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4d5003ab10 0x7f4d5005afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 10 monclient: get_auth_request con 0x7f4d5003ab10 auth_method 0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 0x7f4d8012a0e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d7000fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70018070 con 0x7f4d80129d10 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: dump: 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.904 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d8590b640 1 --2- 10.20.193.7:0/2322538038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4d5003ab10 0x7f4d5005afc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c002af0 tx=0x7f4d7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f4d7000d980 con 0x7f4d80129d10 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 msgr2=0x7f4d8012a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 0x7f4d8012a0e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d7000fc10 comp rx=0 tx=0).stop 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 msgr2=0x7f4d8012a0e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.892+0000 7f4d6dffb640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d80129d10 0x7f4d8012a0e0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d7000fc10 comp rx=0 tx=0).stop 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 0x7f4d80125b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8012c240 con 0x7f4d8012a620 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 0x7f4d80125b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient: get_auth_request con 0x7f4d8012a620 auth_method 0 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 10 monclient(hunting): handle_auth_done global_id 74398 payload 824 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 1 -- 10.20.193.7:0/2322538038 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d8005fc70 con 0x7f4d8012a620 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8510a640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 0x7f4d80125b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d700047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7001d650 con 0x7f4d8012a620 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 10 monclient: dump: 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:21.906 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7f4d7001d650 con 0x7f4d8012a620 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 msgr2=0x7f4d80125b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 0x7f4d80125b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d700047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 msgr2=0x7f4d80125b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d6dffb640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4d8012a620 0x7f4d80125b00 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d70004780 tx=0x7f4d700047b0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 38, 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 49290, 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:21.907 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.908 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:21.909 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.910 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.911 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.912 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T20:56:21.913 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4d5003ab10 msgr2=0x7f4d5005afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 --2- 10.20.193.7:0/2322538038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4d5003ab10 0x7f4d5005afc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c002af0 tx=0x7f4d7c009040 comp rx=0 tx=0).stop 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 10 monclient: shutdown 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 msgr2=0x7f4d80139010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d7401ca40 tx=0x7f4d74019270 comp rx=0 tx=0).stop 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d8590b640 1 -- 10.20.193.7:0/2322538038 reap_dead start 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 shutdown_connections 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 --2- 10.20.193.7:0/2322538038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4d8013a4d0 0x7f4d80139010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 >> 10.20.193.7:0/2322538038 conn(0x7f4d8008faa0 msgr2=0x7f4d8005cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 shutdown_connections 2026-02-22T20:56:21.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:21.896+0000 7f4d87395640 1 -- 10.20.193.7:0/2322538038 wait complete. 2026-02-22T20:56:21.915 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:56:21.915 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-22T20:56:21.915 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-22T20:56:21.915 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-22T20:56:21.915 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-22T20:56:21.915 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T20:56:21.916 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:56:21.927 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T20:56:21.927 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T20:56:21.927 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T20:56:21.927 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2026-02-22T20:56:21.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:21.955 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:26.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:26.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:31.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:56:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:56:31.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:31.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:36.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:36.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:41.927 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T20:56:41.928 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T20:56:41.928 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:56:41.929 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:56:41.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:41.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:41.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: get_monmap_and_config 2026-02-22T20:56:41.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: build_initial_monmap 2026-02-22T20:56:41.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: monmap: 2026-02-22T20:56:41.994 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:41.990018+0000 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:41.990018+0000 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:41.995 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:41.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 Processor -- start 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 -- start start 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: init 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-a con 0x7fd60813cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:41.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd60813d800 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-b con 0x7fd60813a2e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60805d510 con 0x7fd60813d800 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd60808b800 con 0x7fd60813cef0 2026-02-22T20:56:41.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd60808a720 con 0x7fd60813a2e0 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606575640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 msgr2=0x7fd60813d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd60cde5640 10 monclient(hunting): authenticate will time out at 814.463020s 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:41.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd605d74640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7fd60813d800 legacy=0x7fd608139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57290/0 (socket says 10.20.193.7:57290) 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 learned_addr learned my addr 10.20.193.7:0/1844324448 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd60813a2e0 auth_method 0 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:42.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:42.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:56:42.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:42.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:42.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:41.987+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:42.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 msgr2=0x7fd60813d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:42.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 >> v1:10.20.193.7:6789/0 conn(0x7fd60813d800 legacy=0x7fd608139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:56:42.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:56:42.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd60813a2e0 auth_method 0 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:42.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.191+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:56:42.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:42.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd60813a2e0 auth_method 0 2026-02-22T20:56:42.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 >> v1:10.20.193.7:6789/0 conn(0x7fd60813d800 legacy=0x7fd608139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 msgr2=0x7fd60813d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:42.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:42.595+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:56:43.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:43.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd60813a2e0 auth_method 0 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 >> v1:10.20.193.7:6789/0 conn(0x7fd60813d800 legacy=0x7fd608139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 msgr2=0x7fd60813d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:43.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:43.399+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:56:44.420 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:56:44.420 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:56:44.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:56:44.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:56:44.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:56:44.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:56:44.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:56:44.991 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): tick 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 monclient(hunting): continuing hunt 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 msgr2=0x7fd60819f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd60813a2e0 0x7fd60819f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 msgr2=0x7fd60813d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.7:3300/0 conn(0x7fd60813cef0 0x7fd60813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 -- 10.20.193.7:0/1844324448 >> v1:10.20.193.7:6789/0 conn(0x7fd60813d800 legacy=0x7fd608139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient: _add_conns ranks=[4,1] 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): picked mon.noname-c con 0x7fd5e40037a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd5e4024300 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 -- 10.20.193.7:0/1844324448 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60808aa00 con 0x7fd5e4024300 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 1 -- 10.20.193.7:0/1844324448 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd60808b800 con 0x7fd5e40037a0 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd5effff640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 10 monclient(hunting): get_auth_request con 0x7fd5e40037a0 auth_method 0 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:44.992 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:44.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:44.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:44.993 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:44.987+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 10 monclient(hunting): get_auth_request con 0x7fd5e40037a0 auth_method 0 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:45.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.191+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:56:45.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 10 monclient(hunting): get_auth_request con 0x7fd5e40037a0 auth_method 0 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:45.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:45.595+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:56:46.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:46.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 10 monclient(hunting): get_auth_request con 0x7fd5e40037a0 auth_method 0 2026-02-22T20:56:46.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:46.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:46.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:56:46.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:56:46.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:56:46.402 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.399+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:56:46.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:46.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:46.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995518759 0 0) 0x7fd60808aa00 con 0x7fd5e4024300 2026-02-22T20:56:46.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): _negotiate 2026-02-22T20:56:46.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:46.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): my global_id is 74401 2026-02-22T20:56:46.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4003620 con 0x7fd5e4024300 2026-02-22T20:56:46.977 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828287786 0 0) 0x7fd5f4003620 con 0x7fd5e4024300 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 msgr2=0x7fd5e4023c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 --2- 10.20.193.7:0/1844324448 >> v2:10.20.193.61:3300/0 conn(0x7fd5e40037a0 0x7fd5e4023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _finish_hunting 0 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 monclient: found mon.noname-c-legacy 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.61:6789/0 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 --> v1:10.20.193.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60805d510 con 0x7fd5e4024300 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _finish_auth 0 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _check_auth_tickets 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:46.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.1 v1:10.20.193.61:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fd5f0004230 con 0x7fd5e4024300 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: dump: 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:46.979 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] but i'm connected to v1:10.20.193.61:6789/0, reconnecting 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 >> v1:10.20.193.61:6789/0 conn(0x7fd5e4024300 legacy=0x7fd5e40447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 1 -- 10.20.193.7:0/1844324448 reap_dead start 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd5f4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): picked mon.a con 0x7fd5f4003b20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 0x7fd5f4004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.980 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): picked mon.c con 0x7fd5f40048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f4005480 0x7fd5f4065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): picked mon.b con 0x7fd5f4005480 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd60808b800 con 0x7fd5f4003b20 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f4066300 con 0x7fd5f4005480 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f4066500 con 0x7fd5f40048d0 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606575640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 msgr2=0x7fd5f4003f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605573640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:56:46.981 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606575640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd5f4003f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 0x7fd5f4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): get_auth_request con 0x7fd5f40048d0 auth_method 0 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f4005480 0x7fd5f4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:46.982 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd5f4005480 auth_method 0 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient(hunting): handle_auth_done global_id 74401 payload 293 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f4005480 msgr2=0x7fd5f4065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f4005480 0x7fd5f4065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 msgr2=0x7fd5f4003f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:46.983 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd5f4003f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient: _finish_hunting 0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 monclient: found mon.c 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 1 -- 10.20.193.7:0/1844324448 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4003620 con 0x7fd5f40048d0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient: _finish_auth 0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 10 monclient: _check_auth_tickets 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd605d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd60cde5640 5 monclient: authenticate success, global_id 74401 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.971+0000 7fd60cde5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 0x7fd5f4004d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007fd0 tx=0x7fd5f001cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df9f9cb9d159f1a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0007d50 con 0x7fd5f40048d0 2026-02-22T20:56:46.984 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: dump: 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:46.985 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0007030 con 0x7fd5f40048d0 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 1 -- 10.20.193.7:0/1844324448 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f00a5890 con 0x7fd5f40048d0 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 4 set_mon_vals no callback set 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605573640 10 monclient: dump: 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:46.986 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: shutdown 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 msgr2=0x7fd5f4004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 0x7fd5f4004d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007fd0 tx=0x7fd5f001cc00 comp rx=0 tx=0).stop 2026-02-22T20:56:46.987 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- 10.20.193.7:0/1844324448 shutdown_connections 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f4005480 0x7fd5f4065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f40048d0 0x7fd5f4004d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- 10.20.193.7:0/1844324448 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd5f4003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- 10.20.193.7:0/1844324448 >> 10.20.193.7:0/1844324448 conn(0x7fd60808f860 msgr2=0x7fd60808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- 10.20.193.7:0/1844324448 shutdown_connections 2026-02-22T20:56:46.988 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- 10.20.193.7:0/1844324448 wait complete. 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: build_initial_monmap 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: monmap: 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:46.994 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 Processor -- start 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- start start 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: init 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:46.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd6081d9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-a con 0x7fd5f4003b20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f40048d0 0x7fd6081da380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-b con 0x7fd5f40048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): picked mon.noname-c con 0x7fd5f4005480 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd608139d50 con 0x7fd5f4003b20 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd608139bd0 con 0x7fd5f40048d0 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:46.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd608139ed0 con 0x7fd5f4005480 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd60cde5640 10 monclient(hunting): authenticate will time out at 819.451398s 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606575640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 msgr2=0x7fd6081d9e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd6081d9e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57372/0 (socket says 10.20.193.7:57372) 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 -- 10.20.193.7:0/3213496333 learned_addr learned my addr 10.20.193.7:0/3213496333 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): get_auth_request con 0x7fd5f4005480 auth_method 0 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:46.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f40048d0 0x7fd6081da380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 10 monclient(hunting): get_auth_request con 0x7fd5f40048d0 auth_method 0 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd605d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient(hunting): handle_auth_done global_id 64559 payload 824 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 -- 10.20.193.7:0/3213496333 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f40048d0 msgr2=0x7fd6081da380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f40048d0 0x7fd6081da380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 -- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 msgr2=0x7fd6081d9e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd6081d9e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:46.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient: _finish_hunting 0 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 monclient: found mon.noname-c 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 -- 10.20.193.7:0/3213496333 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60812d3a0 con 0x7fd5f4005480 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.975+0000 7fd606d76640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4024270 tx=0x7fd5f80046a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8018630 con 0x7fd5f4005480 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: dump: 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:46.999 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: _finish_auth 0 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: _check_auth_tickets 2026-02-22T20:56:47.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f80187d0 con 0x7fd5f4005480 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 5 monclient: authenticate success, global_id 64559 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8018bc0 con 0x7fd5f4005480 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 10 monclient: dump: 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.002 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd604d72640 4 set_mon_vals no callback set 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _renew_subs 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60805cca0 con 0x7fd5f4005480 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _renew_subs 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd608139930 con 0x7fd5f4005480 2026-02-22T20:56:47.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd608140c60 con 0x7fd5f4005480 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd5f8020400 con 0x7fd5f4005480 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 --2- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 0x7fd5d405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(149..149 src has 64..149) ==== 3897+0+0 (secure 0 0 0) 0x7fd5f8005e00 con 0x7fd5f4005480 2026-02-22T20:56:47.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd606575640 1 --2- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 0x7fd5d405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd606575640 10 monclient: get_auth_request con 0x7fd5d403aa90 auth_method 0 2026-02-22T20:56:47.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.979+0000 7fd606575640 1 --2- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 0x7fd5d405af40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc003bc0 tx=0x7fd5fc005040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.983+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd5f8027030 con 0x7fd5f4005480 2026-02-22T20:56:47.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.983+0000 7fd5eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:46.983+0000 7fd5eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: starting. 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20552 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: created object 0... 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: created object 25... 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: created object 49... 2026-02-22T20:56:47.081 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: finishing. 2026-02-22T20:56:47.082 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20589]: shutting down. 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: starting. 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: listing objects. 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: listed object 0... 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: listed object 25... 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: saw 50 objects 2026-02-22T20:56:47.092 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20591]: shutting down. 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd60805fc00 con 0x7fd5f4005480 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd5eeffd640 1 -- 10.20.193.7:0/3213496333 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7fd5f801c030 con 0x7fd5f4005480 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd5eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd5eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:47.097 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":40,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 msgr2=0x7fd5d405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 0x7fd5d405af40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc003bc0 tx=0x7fd5fc005040 comp rx=0 tx=0).stop 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 10 monclient: shutdown 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 msgr2=0x7fd608129640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4024270 tx=0x7fd5f80046a0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 shutdown_connections 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd5f4005480 0x7fd608129640 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd5d403aa90 0x7fd5d405af40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd5f40048d0 0x7fd6081da380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.099 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 --2- 10.20.193.7:0/3213496333 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd5f4003b20 0x7fd6081d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 >> 10.20.193.7:0/3213496333 conn(0x7fd60808f860 msgr2=0x7fd60805b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:47.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 shutdown_connections 2026-02-22T20:56:47.100 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.095+0000 7fd60cde5640 1 -- 10.20.193.7:0/3213496333 wait complete. 2026-02-22T20:56:47.109 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:56:47.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:56:47.110 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: get_monmap_and_config 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: build_initial_monmap 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: monmap: 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:47.168571+0000 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:47.168571+0000 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:47.168 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 Processor -- start 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 -- start start 2026-02-22T20:56:47.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: init 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-b con 0x7fd07c13f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd07c13fba0 addr v1:10.20.193.7:6789/0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 0x7fd07c1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-a con 0x7fd07c13c680 addr v2:10.20.193.7:3300/0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c08fd70 con 0x7fd07c13fba0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd07c08e1f0 con 0x7fd07c13c680 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c08ec90 con 0x7fd07c13f290 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient(hunting): authenticate will time out at 819.641904s 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079d74640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7fd07c13fba0 legacy=0x7fd07c13bf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07ad76640 1 -- >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 msgr2=0x7fd07c1a17e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07ad76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 0x7fd07c1a17e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57378/0 (socket says 10.20.193.7:57378) 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 -- 10.20.193.7:0/679984089 learned_addr learned my addr 10.20.193.7:0/679984089 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): get_auth_request con 0x7fd07c13f290 auth_method 0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient(hunting): handle_auth_done global_id 64562 payload 274 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 -- 10.20.193.7:0/679984089 >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 msgr2=0x7fd07c1a17e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 --2- 10.20.193.7:0/679984089 >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 0x7fd07c1a17e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 -- 10.20.193.7:0/679984089 >> v1:10.20.193.7:6789/0 conn(0x7fd07c13fba0 legacy=0x7fd07c13bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient: _finish_hunting 0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 monclient: found mon.noname-b 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 -- 10.20.193.7:0/679984089 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c092bc0 con 0x7fd07c13f290 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd07a575640 1 --2- 10.20.193.7:0/679984089 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0700090a0 tx=0x7fd07001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff20805ce11889b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 1 -- 10.20.193.7:0/679984089 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700b0070 con 0x7fd07c13f290 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: dump: 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.171 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: _finish_auth 0 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: _check_auth_tickets 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 1 -- 10.20.193.7:0/679984089 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700ab600 con 0x7fd07c13f290 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 5 monclient: authenticate success, global_id 64562 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 1 -- 10.20.193.7:0/679984089 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700ab9d0 con 0x7fd07c13f290 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd079573640 10 monclient: dump: 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:47.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.167+0000 7fd080a7e640 4 set_mon_vals no callback set 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: shutdown 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/679984089 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 msgr2=0x7fd07c13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- 10.20.193.7:0/679984089 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0700090a0 tx=0x7fd07001c3d0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/679984089 shutdown_connections 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- 10.20.193.7:0/679984089 >> v2:10.20.193.7:3300/0 conn(0x7fd07c13c680 0x7fd07c1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- 10.20.193.7:0/679984089 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13f290 0x7fd07c13f660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/679984089 >> 10.20.193.7:0/679984089 conn(0x7fd07c093df0 msgr2=0x7fd07c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/679984089 shutdown_connections 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/679984089 wait complete. 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: build_initial_monmap 2026-02-22T20:56:47.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: monmap: 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 Processor -- start 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- start start 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: init 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:47.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-c con 0x7fd07c13c680 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd07c13f290 0x7fd07c12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-b con 0x7fd07c13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd07c13fba0 0x7fd07c12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): picked mon.noname-a con 0x7fd07c13fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c1a46c0 con 0x7fd07c13fba0 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c1a4540 con 0x7fd07c13f290 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c1a4840 con 0x7fd07c13c680 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): authenticate will time out at 819.645481s 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07ad76640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd07c13fba0 msgr2=0x7fd07c12a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:47.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07ad76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd07c13fba0 0x7fd07c12a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57384/0 (socket says 10.20.193.7:57384) 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 -- 10.20.193.7:0/103064982 learned_addr learned my addr 10.20.193.7:0/103064982 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): get_auth_request con 0x7fd07c13c680 auth_method 0 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd07c13f290 0x7fd07c12a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): get_auth_request con 0x7fd07c13f290 auth_method 0 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient(hunting): handle_auth_done global_id 64565 payload 824 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd07c13f290 msgr2=0x7fd07c12a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd07c13f290 0x7fd07c12a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd07c13fba0 msgr2=0x7fd07c12a8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd07c13fba0 0x7fd07c12a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient: _finish_hunting 0 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 monclient: found mon.noname-c 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c13c470 con 0x7fd07c13c680 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07a575640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd07001cc70 tx=0x7fd070019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700b0050 con 0x7fd07c13c680 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: dump: 2026-02-22T20:56:47.181 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: _finish_auth 0 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700b1040 con 0x7fd07c13c680 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 5 monclient: authenticate success, global_id 64565 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _renew_subs 2026-02-22T20:56:47.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c12db40 con 0x7fd07c13c680 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070004020 con 0x7fd07c13c680 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: dump: 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd078d72640 4 set_mon_vals no callback set 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _renew_subs 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07c13ef20 con 0x7fd07c13c680 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 0x7fd07c1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c12e040 con 0x7fd07c12d4e0 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd0700041c0 con 0x7fd07c13c680 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 0x7fd07c1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient: get_auth_request con 0x7fd07c12d4e0 auth_method 0 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 --2- 10.20.193.7:0/103064982 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd04803aa90 0x7fd04805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(150..150 src has 64..150) ==== 3897+0+0 (secure 0 0 0) 0x7fd0700e8620 con 0x7fd07c13c680 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 10 monclient(hunting): handle_auth_done global_id 64568 payload 824 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd07c13f660 con 0x7fd07c12d4e0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07ad76640 1 --2- 10.20.193.7:0/103064982 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd04803aa90 0x7fd04805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07ad76640 10 monclient: get_auth_request con 0x7fd04803aa90 auth_method 0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd079d74640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 0x7fd07c1508a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c13bcc0 tx=0x7fd06400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064003ab0 con 0x7fd07c12d4e0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: dump: 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.185 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd07ad76640 1 --2- 10.20.193.7:0/103064982 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd04803aa90 0x7fd04805af40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd06c003e00 tx=0x7fd06c009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fd064017070 con 0x7fd07c12d4e0 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 msgr2=0x7fd07c1508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 0x7fd07c1508a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c13bcc0 tx=0x7fd06400db90 comp rx=0 tx=0).stop 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 msgr2=0x7fd07c1508a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:47.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.171+0000 7fd062ffd640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c12d4e0 0x7fd07c1508a0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c13bcc0 tx=0x7fd06400db90 comp rx=0 tx=0).stop 2026-02-22T20:56:47.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:47.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 0x7fd07c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c151720 con 0x7fd07c150de0 2026-02-22T20:56:47.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 0x7fd07c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient: get_auth_request con 0x7fd07c150de0 auth_method 0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 10 monclient(hunting): handle_auth_done global_id 64571 payload 824 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 1 -- 10.20.193.7:0/103064982 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd07c08a960 con 0x7fd07c150de0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd079d74640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 0x7fd07c1511e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd064007230 tx=0x7fd064005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064003d80 con 0x7fd07c150de0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 10 monclient: dump: 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.188 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5037 (secure 0 0 0) 0x7fd064003d80 con 0x7fd07c150de0 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 msgr2=0x7fd07c1511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 0x7fd07c1511e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd064007230 tx=0x7fd064005ad0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 msgr2=0x7fd07c1511e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd062ffd640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c150de0 0x7fd07c1511e0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd064007230 tx=0x7fd064005ad0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 40, 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 132780, 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.189 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.190 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.191 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.192 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:47.193 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd04803aa90 msgr2=0x7fd04805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 --2- 10.20.193.7:0/103064982 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd04803aa90 0x7fd04805af40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd06c003e00 tx=0x7fd06c009230 comp rx=0 tx=0).stop 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 10 monclient: shutdown 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 msgr2=0x7fd07c129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd07001cc70 tx=0x7fd070019170 comp rx=0 tx=0).stop 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd07ad76640 1 -- 10.20.193.7:0/103064982 reap_dead start 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 shutdown_connections 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 --2- 10.20.193.7:0/103064982 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd07c13c680 0x7fd07c129e50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 >> 10.20.193.7:0/103064982 conn(0x7fd07c093df0 msgr2=0x7fd07c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 shutdown_connections 2026-02-22T20:56:47.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.175+0000 7fd080a7e640 1 -- 10.20.193.7:0/103064982 wait complete. 2026-02-22T20:56:47.194 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:56:47.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T20:56:47.195 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 10 monclient: get_monmap_and_config 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 10 monclient: build_initial_monmap 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 10 monclient: monmap: 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:56:47.255145+0000 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:56:47.255145+0000 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:56:47.255 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 1 Processor -- start 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 1 -- start start 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.251+0000 7f36c3676640 10 monclient: init 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-b con 0x7f36bc08b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f36bc13a4d0 0x7f36bc13cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-c con 0x7f36bc13a4d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f36bc13d530 addr v1:10.20.193.61:6789/0 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc089920 con 0x7f36bc13d530 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f36bc08ab40 con 0x7f36bc13a4d0 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc08a860 con 0x7f36bc08b590 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): authenticate will time out at 819.728248s 2026-02-22T20:56:47.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57420/0 (socket says 10.20.193.7:57420) 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/2536612012 learned_addr learned my addr 10.20.193.7:0/2536612012 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): get_auth_request con 0x7f36bc08b590 auth_method 0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 1 --2- 10.20.193.7:0/2536612012 >> v2:10.20.193.61:3300/0 conn(0x7f36bc13a4d0 0x7f36bc13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 10 monclient(hunting): get_auth_request con 0x7f36bc13a4d0 auth_method 0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_done global_id 64574 payload 274 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/2536612012 >> v2:10.20.193.61:3300/0 conn(0x7f36bc13a4d0 msgr2=0x7f36bc13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- 10.20.193.7:0/2536612012 >> v2:10.20.193.61:3300/0 conn(0x7f36bc13a4d0 0x7f36bc13cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/2536612012 >> v1:10.20.193.61:6789/0 conn(0x7f36bc13d530 legacy=0x7f36bc19e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient: _finish_hunting 0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 monclient: found mon.noname-b 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/2536612012 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc089170 con 0x7f36bc08b590 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- 10.20.193.7:0/2536612012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0090a0 tx=0x7f36ac01c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a58cbeeee22c1b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 1 -- 10.20.193.7:0/2536612012 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0ab610 con 0x7f36bc08b590 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: dump: 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: _finish_auth 0 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: _check_auth_tickets 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 1 -- 10.20.193.7:0/2536612012 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac0b0070 con 0x7f36bc08b590 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 1 -- 10.20.193.7:0/2536612012 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0ab9d0 con 0x7f36bc08b590 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36abfff640 10 monclient: dump: 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 5 monclient: authenticate success, global_id 64574 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: get_monmap_and_config success 2026-02-22T20:56:47.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 4 set_mon_vals no callback set 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: shutdown 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- 10.20.193.7:0/2536612012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 msgr2=0x7f36bc139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- 10.20.193.7:0/2536612012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0090a0 tx=0x7f36ac01c590 comp rx=0 tx=0).stop 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- 10.20.193.7:0/2536612012 shutdown_connections 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- 10.20.193.7:0/2536612012 >> v2:10.20.193.61:3300/0 conn(0x7f36bc13a4d0 0x7f36bc13cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- 10.20.193.7:0/2536612012 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc139f90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- 10.20.193.7:0/2536612012 >> 10.20.193.7:0/2536612012 conn(0x7f36bc08faa0 msgr2=0x7f36bc08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- 10.20.193.7:0/2536612012 shutdown_connections 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- 10.20.193.7:0/2536612012 wait complete. 2026-02-22T20:56:47.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: build_initial_monmap 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: monmap: 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 Processor -- start 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- start start 2026-02-22T20:56:47.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: init 2026-02-22T20:56:47.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: _reopen_session rank -1 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-c con 0x7f36bc08b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f36bc13a4d0 0x7f36bc138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-a con 0x7f36bc13a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc13d530 0x7f36bc1391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): picked mon.noname-b con 0x7f36bc13d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1a22c0 con 0x7f36bc13a4d0 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc13aab0 con 0x7f36bc13d530 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc1a2440 con 0x7f36bc08b590 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): _renew_subs 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c3676640 10 monclient(hunting): authenticate will time out at 819.731713s 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f36bc13a4d0 msgr2=0x7f36bc138c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c0bea640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f36bc13a4d0 0x7f36bc138c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57432/0 (socket says 10.20.193.7:57432) 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/166257236 learned_addr learned my addr 10.20.193.7:0/166257236 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): get_auth_request con 0x7f36bc08b590 auth_method 0 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c1bec640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc13d530 0x7f36bc1391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c1bec640 10 monclient(hunting): get_auth_request con 0x7f36bc13d530 auth_method 0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c1bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c1bec640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c1bec640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient(hunting): handle_auth_done global_id 64577 payload 824 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc13d530 msgr2=0x7f36bc1391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc13d530 0x7f36bc1391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f36bc13a4d0 msgr2=0x7f36bc138c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f36bc13a4d0 0x7f36bc138c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient: _finish_hunting 0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 monclient: found mon.noname-c 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.255+0000 7f36c13eb640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc12d4b0 con 0x7f36bc08b590 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c13eb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc150190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36ac002410 tx=0x7f36ac01add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004230 con 0x7f36bc08b590 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: dump: 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.264 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: _finish_auth 0 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac0043d0 con 0x7f36bc08b590 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003710 con 0x7f36bc08b590 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36ab7fe640 4 set_mon_vals no callback set 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: dump: 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 5 monclient: authenticate success, global_id 64577 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 monclient: _renew_subs 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc12d790 con 0x7f36bc08b590 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 monclient: _renew_subs 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc13ce20 con 0x7f36bc08b590 2026-02-22T20:56:47.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 0x7f36bc058ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0382a0 con 0x7f36bc087190 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 0x7f36bc058ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient: get_auth_request con 0x7f36bc087190 auth_method 0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f36ac0038b0 con 0x7f36bc08b590 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 --2- 10.20.193.7:0/166257236 >> v2:10.20.193.61:6800/2336688312 conn(0x7f368c03aa80 0x7f368c05af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(150..150 src has 64..150) ==== 3897+0+0 (secure 0 0 0) 0x7f36ac0e9120 con 0x7f36bc08b590 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 10 monclient(hunting): handle_auth_done global_id 74416 payload 824 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36bc139f90 con 0x7f36bc087190 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c1bec640 1 --2- 10.20.193.7:0/166257236 >> v2:10.20.193.61:6800/2336688312 conn(0x7f368c03aa80 0x7f368c05af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c1bec640 10 monclient: get_auth_request con 0x7f368c03aa80 auth_method 0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c0bea640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 0x7f36bc058ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b000eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0017070 con 0x7f36bc087190 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: dump: 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.266 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36c1bec640 1 --2- 10.20.193.7:0/166257236 >> v2:10.20.193.61:6800/2336688312 conn(0x7f368c03aa80 0x7f368c05af30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f36bc088ad0 tx=0x7f36b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f36b0004020 con 0x7f36bc087190 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 msgr2=0x7f36bc058ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 0x7f36bc058ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b000eba0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 msgr2=0x7f36bc058ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:47.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.259+0000 7f36a9ffb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087190 0x7f36bc058ee0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b000eba0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 0x7f36bc059420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 10 monclient(hunting): start opening mon connection 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc05fc70 con 0x7f36bc087590 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 0x7f36bc059420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient: get_auth_request con 0x7f36bc087590 auth_method 0 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 10 monclient(hunting): handle_auth_done global_id 74419 payload 824 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 1 -- 10.20.193.7:0/166257236 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36bc12d130 con 0x7f36bc087590 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c0bea640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 0x7f36bc059420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b0004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b000f040 con 0x7f36bc087590 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 10 monclient: dump: 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:56:47.268 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f36b000cb20 con 0x7f36bc087590 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 msgr2=0x7f36bc059420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 0x7f36bc059420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b0004820 comp rx=0 tx=0).stop 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 msgr2=0x7f36bc059420 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36a9ffb640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f36bc087590 0x7f36bc059420 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f36bc089b60 tx=0x7f36b0004820 comp rx=0 tx=0).stop 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 40, 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 74654, 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.269 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:56:47.270 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:56:47.271 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:56:47.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.273 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:56:47.274 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 >> v2:10.20.193.61:6800/2336688312 conn(0x7f368c03aa80 msgr2=0x7f368c05af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 --2- 10.20.193.7:0/166257236 >> v2:10.20.193.61:6800/2336688312 conn(0x7f368c03aa80 0x7f368c05af30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f36bc088ad0 tx=0x7f36b8009040 comp rx=0 tx=0).stop 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 10 monclient: shutdown 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 msgr2=0x7f36bc150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 --2- 10.20.193.7:0/166257236 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f36bc08b590 0x7f36bc150190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36ac002410 tx=0x7f36ac01add0 comp rx=0 tx=0).stop 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c1bec640 1 -- 10.20.193.7:0/166257236 reap_dead start 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c1bec640 1 -- 10.20.193.7:0/166257236 reap_dead start 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 shutdown_connections 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 >> 10.20.193.7:0/166257236 conn(0x7f36bc08faa0 msgr2=0x7f36bc13b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 shutdown_connections 2026-02-22T20:56:47.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:56:47.263+0000 7f36c3676640 1 -- 10.20.193.7:0/166257236 wait complete. 2026-02-22T20:56:47.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:56:47.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:56:48.034 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:48.034 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20590]: starting. 2026-02-22T20:56:48.034 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20590]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20552 2026-02-22T20:56:48.034 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20590]: shutting down. 2026-02-22T20:56:48.036 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:48.036 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:48.036 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:48.038 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:50.088 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: starting. 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20641 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: created object 0... 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: created object 25... 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: created object 49... 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: finishing. 2026-02-22T20:56:50.089 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20642]: shutting down. 2026-02-22T20:56:51.043 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20643]: starting. 2026-02-22T20:56:51.043 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20643]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20641 2026-02-22T20:56:51.043 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20643]: shutting down. 2026-02-22T20:56:51.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:51.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: starting. 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20641 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: created object 0... 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: created object 25... 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: created object 49... 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: finishing. 2026-02-22T20:56:53.104 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20678]: shutting down. 2026-02-22T20:56:53.115 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: starting. 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: listing objects. 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: listed object 0... 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: listed object 25... 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: saw 50 objects 2026-02-22T20:56:53.116 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20680]: shutting down. 2026-02-22T20:56:54.056 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:54.056 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20679]: starting. 2026-02-22T20:56:54.056 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20679]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20641 2026-02-22T20:56:54.056 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20679]: shutting down. 2026-02-22T20:56:54.059 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:54.059 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:54.059 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:54.061 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:56:56.110 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: starting. 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20732 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: created object 0... 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: created object 25... 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: created object 49... 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: finishing. 2026-02-22T20:56:56.111 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20733]: shutting down. 2026-02-22T20:56:56.936 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20734]: starting. 2026-02-22T20:56:56.936 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20734]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20732 2026-02-22T20:56:56.936 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20734]: shutting down. 2026-02-22T20:56:56.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:56:56.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:56:58.994 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:58.994 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: starting. 2026-02-22T20:56:58.994 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20732 2026-02-22T20:56:58.994 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: created object 0... 2026-02-22T20:56:58.995 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: created object 25... 2026-02-22T20:56:58.995 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: created object 49... 2026-02-22T20:56:58.995 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: finishing. 2026-02-22T20:56:58.995 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20769]: shutting down. 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: starting. 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: listing objects. 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: listed object 0... 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: listed object 25... 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: saw 50 objects 2026-02-22T20:56:59.006 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20771]: shutting down. 2026-02-22T20:56:59.944 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:59.944 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20770]: starting. 2026-02-22T20:56:59.944 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20770]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20732 2026-02-22T20:56:59.944 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20770]: shutting down. 2026-02-22T20:56:59.946 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:59.946 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:56:59.946 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:56:59.949 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:57:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:57:01] 2026-02-22T20:57:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:57:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:57:01 2026-02-22T20:57:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:57:01.939 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.780488 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:57:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Some PGs (0.780488) are unknown; try again later 2026-02-22T20:57:01.940 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:57:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:57:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:57:01.952 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:57:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:57:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:57:01.955 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:57:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "ceph_test_rados_delete_pools_parallel.trial061-20823": { 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": {}, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:56:59.979382+0000", 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:57:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 32769, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,creating", 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "164", 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:57:01.958 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 32, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 32, 2026-02-22T20:57:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 32, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 32, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 32, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 51, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "ceph_test_rados_delete_pools_parallel.trial061-20823", 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 1.690000057220459, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 1.690000057220459, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 1.690000057220459, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 1.690000057220459, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:57:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:57:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:57:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:57:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:57:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:57:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:57:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1, -1] pools [1, 2, 51] with 6 osds, pg_target 600 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'ceph_test_rados_delete_pools_parallel.trial061-20823' root_id -1 using 0.0 of space, bias 1.0, pg target 0.0 quantized to 32 (current 32) 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:57:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: starting. 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20823 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: created object 0... 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: created object 25... 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: created object 49... 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: finishing. 2026-02-22T20:57:02.006 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20824]: shutting down. 2026-02-22T20:57:02.955 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20825]: starting. 2026-02-22T20:57:02.955 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20825]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20823 2026-02-22T20:57:02.955 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20825]: shutting down. 2026-02-22T20:57:05.015 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:05.015 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: starting. 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20823 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: created object 0... 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: created object 25... 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: created object 49... 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: finishing. 2026-02-22T20:57:05.016 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20860]: shutting down. 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: starting. 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: listing objects. 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: listed object 0... 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: listed object 25... 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: saw 50 objects 2026-02-22T20:57:05.027 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20862]: shutting down. 2026-02-22T20:57:05.968 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:05.968 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20861]: starting. 2026-02-22T20:57:05.968 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20861]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20823 2026-02-22T20:57:05.968 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20861]: shutting down. 2026-02-22T20:57:05.970 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:05.970 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:05.970 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:57:05.972 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:57:06.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:06.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:07.276 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-22T20:57:07.276 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T20:57:07.277 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T20:57:07.280 INFO:tasks.ceph.mon.a:Started 2026-02-22T20:57:07.280 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-22T20:57:07.280 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-22T20:57:07.281 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs to unfreeze mons 2026-02-22T20:57:11.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:11.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:16.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:16.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:21.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:21.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:26.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:26.958 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:27.281 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-22T20:57:27.282 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-22T20:57:27.282 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:57:27.282 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: get_monmap_and_config 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: build_initial_monmap 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: monmap: 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:27.342 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:27.342387+0000 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:27.342387+0000 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:27.343 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 Processor -- start 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 -- start start 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: init 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): picked mon.noname-b con 0x7f490813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): picked mon.noname-a con 0x7f490813d800 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f490813a110 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490805d510 con 0x7f490813a110 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f490808b800 con 0x7f490813d800 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f490808a720 con 0x7f490813cef0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f4910108640 10 monclient(hunting): authenticate will time out at 859.815537s 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51450/0 (socket says 10.20.193.7:51450) 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 learned_addr learned my addr 10.20.193.7:0/1112818496 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 10 monclient(hunting): get_auth_request con 0x7f490813cef0 auth_method 0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f490813d800 auth_method 0 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:27.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.338+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f490813d800 auth_method 0 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 10 monclient(hunting): get_auth_request con 0x7f490813cef0 auth_method 0 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:27.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.542+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:27.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f490813d800 auth_method 0 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 10 monclient(hunting): get_auth_request con 0x7f490813cef0 auth_method 0 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:27.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:27.946+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:28.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:28.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 10 monclient(hunting): get_auth_request con 0x7f490813cef0 auth_method 0 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:28.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490de7d640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f490813d800 auth_method 0 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:28.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:28.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:28.750+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:29.421 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:57:29.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:57:29.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:57:29.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:57:29.422 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:57:29.423 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:57:29.424 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:57:29.425 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:57:29.426 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:57:29.427 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:57:29.428 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:57:29.429 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): tick 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 monclient(hunting): continuing hunt 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 msgr2=0x7f490813d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f490813cef0 0x7f490813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 msgr2=0x7f4908139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f490813d800 0x7f4908139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 >> v1:10.20.193.61:6789/0 conn(0x7f490813a110 legacy=0x7f490819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient: _add_conns ranks=[0,4] 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f48ec0037a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): picked mon.noname-c con 0x7f48ec0254c0 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490808aa00 con 0x7f48ec0037a0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f490808b800 con 0x7f48ec0254c0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f48f77fe640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec0254c0 auth_method 0 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.338+0000 7f490d67c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.342+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.342+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.342+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:30.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.342+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec0254c0 auth_method 0 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:30.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.546+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:30.952 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec0254c0 auth_method 0 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:30.953 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:30.950+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec0254c0 auth_method 0 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:31.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:31.754+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:57:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:57:31.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:31.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:32.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:32.342+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> v1:10.20.193.7:6789/0 conn(0x7f48ec0037a0 legacy=0x7f48ec023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-22T20:57:32.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:32.342+0000 7f490de7d640 1 -- 10.20.193.7:0/1112818496 >> v1:10.20.193.7:6789/0 conn(0x7f48ec0037a0 legacy=0x7f48ec023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:57:32.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:32.342+0000 7f490de7d640 1 --1- 10.20.193.7:0/1112818496 >> v1:10.20.193.7:6789/0 conn(0x7f48ec0037a0 0x7f48ec023c10 :-1 s=OPENED pgs=23 cs=1 l=1).handle_message read tag failed 2026-02-22T20:57:32.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:32.342+0000 7f490de7d640 1 --1- 10.20.193.7:0/1112818496 >> v1:10.20.193.7:6789/0 conn(0x7f48ec0037a0 0x7f48ec023c10 :-1 s=OPENED pgs=23 cs=1 l=1).fault on lossy channel, failing 2026-02-22T20:57:32.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:32.342+0000 7f490ce7b640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.7:6789/0 2026-02-22T20:57:32.397 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: starting. 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20914 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: created object 0... 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: created object 25... 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: created object 49... 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: finishing. 2026-02-22T20:57:32.398 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[20915]: shutting down. 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): tick 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 monclient(hunting): continuing hunt 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 msgr2=0x7f48ec045970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec0254c0 0x7f48ec045970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 >> v1:10.20.193.7:6789/0 conn(0x7f48ec0037a0 legacy=0x7f48ec023c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f490e67e640 1 -- 10.20.193.7:0/1112818496 reap_dead start 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f48ec046080 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec046c20 0x7f48ec0458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): picked mon.noname-c con 0x7f48ec046c20 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:33.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f48ec023dc0 0x7f48ec067440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): picked mon.noname-a con 0x7f48ec023dc0 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48ec047100 con 0x7f48ec046080 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f490808b800 con 0x7f48ec023dc0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 1 -- 10.20.193.7:0/1112818496 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f490808a720 con 0x7f48ec046c20 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.338+0000 7f48f77fe640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.7:3300/0 conn(0x7f48ec023dc0 0x7f48ec067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): get_auth_request con 0x7f48ec023dc0 auth_method 0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490d67c640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec046c20 0x7f48ec0458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec046c20 auth_method 0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490d67c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient(hunting): handle_auth_done global_id 94098 payload 274 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 -- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec046c20 msgr2=0x7f48ec0458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec046c20 0x7f48ec0458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 -- 10.20.193.7:0/1112818496 >> v1:10.20.193.61:6789/0 conn(0x7f48ec046080 legacy=0x7f48ec046450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 -- 10.20.193.7:0/1112818496 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec068b00 con 0x7f48ec023dc0 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490e67e640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec023dc0 0x7f48ec067440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f490805d6e0 tx=0x7f490401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daec5339b6ea2dd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 1 -- 10.20.193.7:0/1112818496 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904003c70 con 0x7f48ec023dc0 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: dump: 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 1 -- 10.20.193.7:0/1112818496 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040a8070 con 0x7f48ec023dc0 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 1 -- 10.20.193.7:0/1112818496 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49040a4c30 con 0x7f48ec023dc0 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f490ce7b640 10 monclient: dump: 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 5 monclient: authenticate success, global_id 94098 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 4 set_mon_vals no callback set 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 10 monclient: shutdown 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 -- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec023dc0 msgr2=0x7f48ec067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec023dc0 0x7f48ec067440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f490805d6e0 tx=0x7f490401c7e0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 -- 10.20.193.7:0/1112818496 shutdown_connections 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 --2- 10.20.193.7:0/1112818496 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec023dc0 0x7f48ec067440 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 --2- 10.20.193.7:0/1112818496 >> v2:10.20.193.61:3300/0 conn(0x7f48ec046c20 0x7f48ec0458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 -- 10.20.193.7:0/1112818496 >> 10.20.193.7:0/1112818496 conn(0x7f490808f860 msgr2=0x7f490808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 -- 10.20.193.7:0/1112818496 shutdown_connections 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.342+0000 7f4910108640 1 -- 10.20.193.7:0/1112818496 wait complete. 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: monmap: 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 Processor -- start 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- start start 2026-02-22T20:57:33.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: init 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f48ec023dc0 0x7f4908127150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): picked mon.noname-b con 0x7f48ec023dc0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): picked mon.noname-c con 0x7f48ec046080 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec046c20 0x7f4908127bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): picked mon.noname-a con 0x7f48ec046c20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f490813a660 con 0x7f48ec046c20 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f490813a4e0 con 0x7f48ec023dc0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f490813a7e0 con 0x7f48ec046080 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient(hunting): authenticate will time out at 865.821305s 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51070/0 (socket says 10.20.193.7:51070) 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 -- 10.20.193.7:0/3658156053 learned_addr learned my addr 10.20.193.7:0/3658156053 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): get_auth_request con 0x7f48ec046080 auth_method 0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec046c20 0x7f4908127bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): get_auth_request con 0x7f48ec046c20 auth_method 0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f48ec023dc0 0x7f4908127150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): get_auth_request con 0x7f48ec023dc0 auth_method 0 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490e67e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient(hunting): handle_auth_done global_id 64649 payload 824 2026-02-22T20:57:33.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 -- 10.20.193.7:0/3658156053 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f48ec023dc0 msgr2=0x7f4908127150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f48ec023dc0 0x7f4908127150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 -- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec046c20 msgr2=0x7f4908127bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec046c20 0x7f4908127bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 monclient: found mon.noname-c 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 -- 10.20.193.7:0/3658156053 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490812af20 con 0x7f48ec046080 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490d67c640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f48fc006fd0 tx=0x7f48fc018f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00f040 con 0x7f48ec046080 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: dump: 2026-02-22T20:57:33.351 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc016e80 con 0x7f48ec046080 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 5 monclient: authenticate success, global_id 64649 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _renew_subs 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4908086620 con 0x7f48ec046080 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc023660 con 0x7f48ec046080 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 10 monclient: dump: 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f7fff640 4 set_mon_vals no callback set 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _renew_subs 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4908128bc0 con 0x7f48ec046080 2026-02-22T20:57:33.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f48fc015040 con 0x7f48ec046080 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 --2- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 0x7f48d805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(171..171 src has 64..171) ==== 3897+0+0 (secure 0 0 0) 0x7f48fc0504c0 con 0x7f48ec046080 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49080382a0 con 0x7f48ec046080 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 1 --2- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 0x7f48d805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 10 monclient: get_auth_request con 0x7f48d803ab20 auth_method 0 2026-02-22T20:57:33.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.346+0000 7f490de7d640 1 --2- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 0x7f48d805afd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f49081296b0 tx=0x7f48f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.350+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f48fc04de20 con 0x7f48ec046080 2026-02-22T20:57:33.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.350+0000 7f48f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.350+0000 7f48f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:33.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:57:33.464 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f490812ad00 con 0x7f48ec046080 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f48f67fc640 1 -- 10.20.193.7:0/3658156053 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f48fc028a30 con 0x7f48ec046080 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f48f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f48f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 msgr2=0x7f48d805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 0x7f48d805afd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f49081296b0 tx=0x7f48f8008040 comp rx=0 tx=0).stop 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 10 monclient: shutdown 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 msgr2=0x7f4908127690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f48fc006fd0 tx=0x7f48fc018f50 comp rx=0 tx=0).stop 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 shutdown_connections 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f48ec046c20 0x7f4908127bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f48ec046080 0x7f4908127690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> v2:10.20.193.61:6800/2336688312 conn(0x7f48d803ab20 0x7f48d805afd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 --2- 10.20.193.7:0/3658156053 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f48ec023dc0 0x7f4908127150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 >> 10.20.193.7:0/3658156053 conn(0x7f490808f860 msgr2=0x7f490813abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 shutdown_connections 2026-02-22T20:57:33.466 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.462+0000 7f4910108640 1 -- 10.20.193.7:0/3658156053 wait complete. 2026-02-22T20:57:33.475 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:57:33.476 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:57:33.476 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.530+0000 7ff8f824c640 10 monclient: get_monmap_and_config 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.530+0000 7ff8f824c640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: monmap: 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:33.535823+0000 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:33.535823+0000 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:33.536 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 Processor -- start 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- start start 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: init 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff8f0091c70 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 0x7ff8f01808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f01604e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f01a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f0180e00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f008e6a0 con 0x7ff8f0091c70 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f008e910 con 0x7ff8f01604e0 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f008ebf0 con 0x7ff8f0180e00 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient(hunting): authenticate will time out at 866.008786s 2026-02-22T20:57:33.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f5fc1640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff8f0091c70 0x7ff8f0092040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34832/0 (socket says 10.20.193.7:34832) 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f5fc1640 1 -- 10.20.193.7:0/1377575800 learned_addr learned my addr 10.20.193.7:0/1377575800 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/1377575800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f01a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): get_auth_request con 0x7ff8f0180e00 auth_method 0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 1 --2- 10.20.193.7:0/1377575800 >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 0x7ff8f01808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 10 monclient(hunting): get_auth_request con 0x7ff8f01604e0 auth_method 0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 1 -- 10.20.193.7:0/1377575800 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132435224 0 0) 0x7ff8f008e6a0 con 0x7ff8f0091c70 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient(hunting): _negotiate 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient(hunting): my global_id is 94104 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 1 -- 10.20.193.7:0/1377575800 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d8003620 con 0x7ff8f0091c70 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_done global_id 64652 payload 274 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 -- 10.20.193.7:0/1377575800 >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 msgr2=0x7ff8f01808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/1377575800 >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 0x7ff8f01808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 -- 10.20.193.7:0/1377575800 >> v1:10.20.193.7:6789/0 conn(0x7ff8f0091c70 legacy=0x7ff8f0092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 monclient: found mon.noname-b 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 -- 10.20.193.7:0/1377575800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f008eed0 con 0x7ff8f0180e00 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f57c0640 1 --2- 10.20.193.7:0/1377575800 >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 0x7ff8f01808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:57:33.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/1377575800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f01a11e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009d40 tx=0x7ff8ec01c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13bf77522f67c99c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 1 -- 10.20.193.7:0/1377575800 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0b2070 con 0x7ff8f0180e00 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: dump: 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 1 -- 10.20.193.7:0/1377575800 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0a58f0 con 0x7ff8f0180e00 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 1 -- 10.20.193.7:0/1377575800 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a5ce0 con 0x7ff8f0180e00 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f4fbf640 10 monclient: dump: 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.539 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 5 monclient: authenticate success, global_id 64652 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 4 set_mon_vals no callback set 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 10 monclient: shutdown 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- 10.20.193.7:0/1377575800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 msgr2=0x7ff8f01a11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 --2- 10.20.193.7:0/1377575800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f01a11e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009d40 tx=0x7ff8ec01c810 comp rx=0 tx=0).stop 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- 10.20.193.7:0/1377575800 shutdown_connections 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 --2- 10.20.193.7:0/1377575800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f01a11e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 --2- 10.20.193.7:0/1377575800 >> v2:10.20.193.61:3300/0 conn(0x7ff8f01604e0 0x7ff8f01808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- 10.20.193.7:0/1377575800 >> 10.20.193.7:0/1377575800 conn(0x7ff8f0093d80 msgr2=0x7ff8f0090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- 10.20.193.7:0/1377575800 shutdown_connections 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.534+0000 7ff8f824c640 1 -- 10.20.193.7:0/1377575800 wait complete. 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: monmap: 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.540 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 Processor -- start 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- start start 2026-02-22T20:57:33.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: init 2026-02-22T20:57:33.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:57:33.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff8f0091c70 0x7ff8f0186110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f0091c70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:33.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f01604e0 0x7ff8f0183af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-a con 0x7ff8f01604e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f0180e00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f01a43b0 con 0x7ff8f01604e0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f01a4230 con 0x7ff8f0091c70 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f01a4530 con 0x7ff8f0180e00 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): authenticate will time out at 866.013111s 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51084/0 (socket says 10.20.193.7:51084) 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 -- 10.20.193.7:0/2019203055 learned_addr learned my addr 10.20.193.7:0/2019203055 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f01604e0 0x7ff8f0183af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): get_auth_request con 0x7ff8f0180e00 auth_method 0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): get_auth_request con 0x7ff8f01604e0 auth_method 0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff8f0091c70 0x7ff8f0186110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): get_auth_request con 0x7ff8f0091c70 auth_method 0 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient(hunting): handle_auth_done global_id 64655 payload 824 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff8f0091c70 msgr2=0x7ff8f0186110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff8f0091c70 0x7ff8f0186110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f01604e0 msgr2=0x7ff8f0183af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f01604e0 0x7ff8f0183af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 monclient: found mon.noname-c 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f0186aa0 con 0x7ff8f0180e00 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff8f0091c70 0x7ff8f0186110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f67c2640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec01cd80 tx=0x7ff8ec0195b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0b2040 con 0x7ff8f0180e00 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: dump: 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec003c90 con 0x7ff8f0180e00 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec004260 con 0x7ff8f0180e00 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: dump: 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.544 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8dffff640 4 set_mon_vals no callback set 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 5 monclient: authenticate success, global_id 64655 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _renew_subs 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f008a970 con 0x7ff8f0180e00 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _renew_subs 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f01855b0 con 0x7ff8f0180e00 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 0x7ff8f0088830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0184940 con 0x7ff8f0184570 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 0x7ff8f0088830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient: get_auth_request con 0x7ff8f0184570 auth_method 0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_done global_id 94110 payload 824 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8f0092040 con 0x7ff8f0184570 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff8ec0b5070 con 0x7ff8f0180e00 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 0x7ff8f0088830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 --2- 10.20.193.7:0/2019203055 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff8c003ab20 0x7ff8c005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(171..171 src has 64..171) ==== 3897+0+0 (secure 0 0 0) 0x7ff8ec0e9120 con 0x7ff8f0180e00 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00059b0 con 0x7ff8f0184570 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: dump: 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.545 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 1 --2- 10.20.193.7:0/2019203055 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff8c003ab20 0x7ff8c005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7ff8e0018070 con 0x7ff8f0184570 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 msgr2=0x7ff8f0088830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 0x7ff8f0088830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e000eb90 comp rx=0 tx=0).stop 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 msgr2=0x7ff8f0088830 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8de7fc640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f0184570 0x7ff8f0088830 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e000eb90 comp rx=0 tx=0).stop 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 10 monclient: get_auth_request con 0x7ff8c003ab20 auth_method 0 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.538+0000 7ff8f57c0640 1 --2- 10.20.193.7:0/2019203055 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff8c003ab20 0x7ff8c005afd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4004780 tx=0x7ff8e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:33.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 0x7ff8f004ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0092890 con 0x7ff8f004ca80 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 0x7ff8f004ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient: get_auth_request con 0x7ff8f004ca80 auth_method 0 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 10 monclient(hunting): handle_auth_done global_id 94113 payload 824 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 1 -- 10.20.193.7:0/2019203055 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8f008b270 con 0x7ff8f004ca80 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f5fc1640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 0x7ff8f004ce80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e00058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0005bc0 con 0x7ff8f004ca80 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 10 monclient: dump: 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4715 (secure 0 0 0) 0x7ff8e0005bc0 con 0x7ff8f004ca80 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 msgr2=0x7ff8f004ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 0x7ff8f004ce80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e00058f0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 msgr2=0x7ff8f004ce80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8de7fc640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff8f004ca80 0x7ff8f004ce80 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00026e0 tx=0x7ff8e00058f0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.547 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 26227, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.548 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.549 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.550 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.551 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff8c003ab20 msgr2=0x7ff8c005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 --2- 10.20.193.7:0/2019203055 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff8c003ab20 0x7ff8c005afd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4004780 tx=0x7ff8e4008040 comp rx=0 tx=0).stop 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 10 monclient: shutdown 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 msgr2=0x7ff8f0184030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec01cd80 tx=0x7ff8ec0195b0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f67c2640 1 -- 10.20.193.7:0/2019203055 reap_dead start 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 shutdown_connections 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 --2- 10.20.193.7:0/2019203055 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff8f0180e00 0x7ff8f0184030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 >> 10.20.193.7:0/2019203055 conn(0x7ff8f0093d80 msgr2=0x7ff8f008b750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 shutdown_connections 2026-02-22T20:57:33.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.542+0000 7ff8f824c640 1 -- 10.20.193.7:0/2019203055 wait complete. 2026-02-22T20:57:33.555 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:33.555 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:57:33.555 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:57:33.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: get_monmap_and_config 2026-02-22T20:57:33.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: monmap: 2026-02-22T20:57:33.617 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:33.617667+0000 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:33.617667+0000 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:33.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 Processor -- start 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 -- start start 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: init 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): picked mon.noname-b con 0x7f716408b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f716413a4d0 0x7f716413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): picked mon.noname-a con 0x7f716413a4d0 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f716413d530 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7164089920 con 0x7f716413d530 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f716408ab40 con 0x7f716413a4d0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f716408a860 con 0x7f716408b590 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f716b302640 10 monclient(hunting): authenticate will time out at 866.090564s 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51086/0 (socket says 10.20.193.7:51086) 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 -- 10.20.193.7:0/1815264534 learned_addr learned my addr 10.20.193.7:0/1815264534 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): get_auth_request con 0x7f716408b590 auth_method 0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 1 --2- 10.20.193.7:0/1815264534 >> v2:10.20.193.7:3300/0 conn(0x7f716413a4d0 0x7f716413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): get_auth_request con 0x7f716413a4d0 auth_method 0 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient(hunting): handle_auth_done global_id 64658 payload 274 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 -- 10.20.193.7:0/1815264534 >> v2:10.20.193.7:3300/0 conn(0x7f716413a4d0 msgr2=0x7f716413cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 --2- 10.20.193.7:0/1815264534 >> v2:10.20.193.7:3300/0 conn(0x7f716413a4d0 0x7f716413cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 -- 10.20.193.7:0/1815264534 >> v1:10.20.193.7:6789/0 conn(0x7f716413d530 legacy=0x7f716419e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 monclient: found mon.noname-b 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:57:33.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 -- 10.20.193.7:0/1815264534 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7164089170 con 0x7f716408b590 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.614+0000 7f7169077640 1 --2- 10.20.193.7:0/1815264534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71540090a0 tx=0x7f715401c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fdaede93d43a61 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 1 -- 10.20.193.7:0/1815264534 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540ab610 con 0x7f716408b590 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: dump: 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 1 -- 10.20.193.7:0/1815264534 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71540b0070 con 0x7f716408b590 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 1 -- 10.20.193.7:0/1815264534 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540ab9d0 con 0x7f716408b590 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 5 monclient: authenticate success, global_id 64658 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 4 set_mon_vals no callback set 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7153fff640 10 monclient: dump: 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.621 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: shutdown 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/1815264534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 msgr2=0x7f7164139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- 10.20.193.7:0/1815264534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71540090a0 tx=0x7f715401c590 comp rx=0 tx=0).stop 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/1815264534 shutdown_connections 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- 10.20.193.7:0/1815264534 >> v2:10.20.193.7:3300/0 conn(0x7f716413a4d0 0x7f716413cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- 10.20.193.7:0/1815264534 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716408b590 0x7f7164139f90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/1815264534 >> 10.20.193.7:0/1815264534 conn(0x7f716408faa0 msgr2=0x7f716408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/1815264534 shutdown_connections 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/1815264534 wait complete. 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: monmap: 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:33.622 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 Processor -- start 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- start start 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: init 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 0x7f716414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): picked mon.noname-a con 0x7f716408b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716413a4d0 0x7f716414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): picked mon.noname-c con 0x7f716413a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f716413d530 0x7f7164127830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): picked mon.noname-b con 0x7f716413d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71641a22c0 con 0x7f716408b590 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f716413aab0 con 0x7f716413d530 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f71641a2440 con 0x7f716413a4d0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): authenticate will time out at 866.093907s 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 0x7f716414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716413a4d0 0x7f716414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 0x7f716414e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45774/0 (socket says 10.20.193.7:45774) 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 -- 10.20.193.7:0/3850544691 learned_addr learned my addr 10.20.193.7:0/3850544691 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): get_auth_request con 0x7f716408b590 auth_method 0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): get_auth_request con 0x7f716413a4d0 auth_method 0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f716413d530 0x7f7164127830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 10 monclient(hunting): get_auth_request con 0x7f716413d530 auth_method 0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient(hunting): handle_auth_done global_id 94119 payload 824 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716413a4d0 msgr2=0x7f716414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f716413a4d0 0x7f716414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f716413d530 msgr2=0x7f7164127830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f716413d530 0x7f7164127830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7164139ad0 con 0x7f716408b590 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169077640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 0x7f716414e360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7154004780 tx=0x7f715401add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154004230 con 0x7f716408b590 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: dump: 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71540043d0 con 0x7f716408b590 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540abe10 con 0x7f716408b590 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: dump: 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f71537fe640 4 set_mon_vals no callback set 2026-02-22T20:57:33.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 5 monclient: authenticate success, global_id 94119 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _renew_subs 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7164086690 con 0x7f716408b590 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _renew_subs 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716412b520 con 0x7f716408b590 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 0x7f7164058ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7164139f90 con 0x7f7164128530 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 0x7f7164058ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient: get_auth_request con 0x7f7164128530 auth_method 0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7154003710 con 0x7f716408b590 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 10 monclient(hunting): handle_auth_done global_id 64664 payload 824 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f716412b060 con 0x7f7164128530 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 --2- 10.20.193.7:0/3850544691 >> v2:10.20.193.61:6800/2336688312 conn(0x7f713403ab20 0x7f713405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(171..171 src has 64..171) ==== 3897+0+0 (secure 0 0 0) 0x7f71540e9010 con 0x7f716408b590 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7168876640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 0x7f7164058ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f716412ba10 tx=0x7f7158011e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715800fbd0 con 0x7f7164128530 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: dump: 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.627 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 1 --2- 10.20.193.7:0/3850544691 >> v2:10.20.193.61:6800/2336688312 conn(0x7f713403ab20 0x7f713405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7169878640 10 monclient: get_auth_request con 0x7f713403ab20 auth_method 0 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f715800fbd0 con 0x7f7164128530 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 msgr2=0x7f7164058ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 0x7f7164058ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f716412ba10 tx=0x7f7158011e50 comp rx=0 tx=0).stop 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 msgr2=0x7f7164058ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.618+0000 7f7151ffb640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128530 0x7f7164058ea0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f716412ba10 tx=0x7f7158011e50 comp rx=0 tx=0).stop 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7169878640 1 --2- 10.20.193.7:0/3850544691 >> v2:10.20.193.61:6800/2336688312 conn(0x7f713403ab20 0x7f713405afd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7160002b90 tx=0x7f7160009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 0x7f71640593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7164129d20 con 0x7f7164128900 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 0x7f71640593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient: get_auth_request con 0x7f7164128900 auth_method 0 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 10 monclient(hunting): handle_auth_done global_id 64667 payload 824 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 1 -- 10.20.193.7:0/3850544691 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f716412ac80 con 0x7f7164128900 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7168876640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 0x7f71640593e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7158019000 tx=0x7f7158004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158022560 con 0x7f7164128900 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 10 monclient: dump: 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7f7158022560 con 0x7f7164128900 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 msgr2=0x7f71640593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 0x7f71640593e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7158019000 tx=0x7f7158004820 comp rx=0 tx=0).stop 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 msgr2=0x7f71640593e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7151ffb640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7164128900 0x7f71640593e0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7158019000 tx=0x7f7158004820 comp rx=0 tx=0).stop 2026-02-22T20:57:33.629 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 179227, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.630 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.631 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:33.632 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:33.633 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.634 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.635 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.636 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.637 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.638 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.638 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.638 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.638 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:33.638 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 >> v2:10.20.193.61:6800/2336688312 conn(0x7f713403ab20 msgr2=0x7f713405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 --2- 10.20.193.7:0/3850544691 >> v2:10.20.193.61:6800/2336688312 conn(0x7f713403ab20 0x7f713405afd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7160002b90 tx=0x7f7160009040 comp rx=0 tx=0).stop 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 10 monclient: shutdown 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 msgr2=0x7f716414e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 --2- 10.20.193.7:0/3850544691 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f716408b590 0x7f716414e360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7154004780 tx=0x7f715401add0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7169878640 1 -- 10.20.193.7:0/3850544691 reap_dead start 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f7169878640 1 -- 10.20.193.7:0/3850544691 reap_dead start 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 shutdown_connections 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 >> 10.20.193.7:0/3850544691 conn(0x7f716408faa0 msgr2=0x7f716413b540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 shutdown_connections 2026-02-22T20:57:33.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.622+0000 7f716b302640 1 -- 10.20.193.7:0/3850544691 wait complete. 2026-02-22T20:57:33.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:33.640 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:57:33.640 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: get_monmap_and_config 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: monmap: 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:33.701918+0000 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:33.701918+0000 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.702 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:33.703 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:33.703 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:33.703 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:33.703 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:33.703 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 Processor -- start 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 -- start start 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: init 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fef1c143ad0 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fef1c089540 0x7fef1c052090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fef1c089540 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fef1c184910 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c08b560 con 0x7fef1c184910 2026-02-22T20:57:33.705 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c08b840 con 0x7fef1c143ad0 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fef1c08a4c0 con 0x7fef1c089540 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1bfff640 10 monclient(hunting): authenticate will time out at 866.174867s 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fef1c089540 0x7fef1c052090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fef1c089540 0x7fef1c052090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45788/0 (socket says 10.20.193.7:45788) 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1b7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fef1c184910 0x7fef1c1a4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34848/0 (socket says 10.20.193.7:34848) 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 -- 10.20.193.7:0/73593714 learned_addr learned my addr 10.20.193.7:0/73593714 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request con 0x7fef1c089540 auth_method 0 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_done global_id 94122 payload 274 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 -- 10.20.193.7:0/73593714 >> v1:10.20.193.61:6789/0 conn(0x7fef1c143ad0 legacy=0x7fef1c088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 -- 10.20.193.7:0/73593714 >> v1:10.20.193.7:6789/0 conn(0x7fef1c184910 legacy=0x7fef1c1a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.706 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.698+0000 7fef1a7fc640 1 -- 10.20.193.7:0/73593714 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c08a200 con 0x7fef1c089540 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/73593714 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c052090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef040090a0 tx=0x7fef0401c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4286b60caa1a4ff3 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 1 -- 10.20.193.7:0/73593714 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040a9670 con 0x7fef1c089540 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: dump: 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 1 -- 10.20.193.7:0/73593714 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040a9810 con 0x7fef1c089540 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 1 -- 10.20.193.7:0/73593714 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040a9be0 con 0x7fef1c089540 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 5 monclient: authenticate success, global_id 94122 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 4 set_mon_vals no callback set 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef19ffb640 10 monclient: dump: 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: shutdown 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/73593714 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 msgr2=0x7fef1c052090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- 10.20.193.7:0/73593714 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c052090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef040090a0 tx=0x7fef0401c590 comp rx=0 tx=0).stop 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/73593714 shutdown_connections 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- 10.20.193.7:0/73593714 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c052090 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/73593714 >> 10.20.193.7:0/73593714 conn(0x7fef1c08d850 msgr2=0x7fef1c051980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/73593714 shutdown_connections 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/73593714 wait complete. 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: monmap: 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 Processor -- start 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- start start 2026-02-22T20:57:33.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: init 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c194030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fef1c089540 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c143ad0 0x7fef1c194570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fef1c143ad0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef1c184910 0x7fef1c12fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fef1c184910 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c1a9020 con 0x7fef1c089540 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c1a8ea0 con 0x7fef1c143ad0 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c1a91a0 con 0x7fef1c184910 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): authenticate will time out at 866.177567s 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c194030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c194030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45800/0 (socket says 10.20.193.7:45800) 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 -- 10.20.193.7:0/1078203994 learned_addr learned my addr 10.20.193.7:0/1078203994 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): get_auth_request con 0x7fef1c089540 auth_method 0 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c143ad0 0x7fef1c194570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef1c184910 0x7fef1c12fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request con 0x7fef1c143ad0 auth_method 0 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): get_auth_request con 0x7fef1c184910 auth_method 0 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient(hunting): handle_auth_done global_id 94128 payload 824 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef1c184910 msgr2=0x7fef1c12fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef1c184910 0x7fef1c12fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c143ad0 msgr2=0x7fef1c194570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c143ad0 0x7fef1c194570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c088c20 con 0x7fef1c089540 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c143ad0 0x7fef1c194570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1affd640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c194030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c4f0 tx=0x7fef1000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10016020 con 0x7fef1c089540 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: dump: 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.716 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef10005220 con 0x7fef1c089540 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef100068d0 con 0x7fef1c089540 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef197fa640 4 set_mon_vals no callback set 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: dump: 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.717 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 5 monclient: authenticate success, global_id 94128 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _renew_subs 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c086540 con 0x7fef1c089540 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _renew_subs 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c133ce0 con 0x7fef1c089540 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 0x7fef1c059480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c1338b0 con 0x7fef1c130bc0 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fef10006a70 con 0x7fef1c089540 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 0x7fef1c059480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient: get_auth_request con 0x7fef1c130bc0 auth_method 0 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 --2- 10.20.193.7:0/1078203994 >> v2:10.20.193.61:6800/2336688312 conn(0x7feee803ab20 0x7feee805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(171..171 src has 64..171) ==== 3897+0+0 (secure 0 0 0) 0x7fef1004e280 con 0x7fef1c089540 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_done global_id 74533 payload 824 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef1c052090 con 0x7fef1c130bc0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 1 --2- 10.20.193.7:0/1078203994 >> v2:10.20.193.61:6800/2336688312 conn(0x7feee803ab20 0x7feee805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 10 monclient: get_auth_request con 0x7feee803ab20 auth_method 0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 0x7fef1c059480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef040090a0 tx=0x7fef0401add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040c1070 con 0x7fef1c130bc0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: dump: 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7fef1b7fe640 1 --2- 10.20.193.7:0/1078203994 >> v2:10.20.193.61:6800/2336688312 conn(0x7feee803ab20 0x7feee805afd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef0c002af0 tx=0x7fef0c0032e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fef040b18c0 con 0x7fef1c130bc0 2026-02-22T20:57:33.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 msgr2=0x7fef1c059480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 0x7fef1c059480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef040090a0 tx=0x7fef0401add0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 msgr2=0x7fef1c059480 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.702+0000 7feefb7fe640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130bc0 0x7fef1c059480 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef040090a0 tx=0x7fef0401add0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 0x7fef1c0599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c05fbe0 con 0x7fef1c130f90 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 0x7fef1c0599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient: get_auth_request con 0x7fef1c130f90 auth_method 0 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 10 monclient(hunting): handle_auth_done global_id 74536 payload 824 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 1 -- 10.20.193.7:0/1078203994 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef1c1324e0 con 0x7fef1c130f90 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1a7fc640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 0x7fef1c0599c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef040ab040 tx=0x7fef04019330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040c1040 con 0x7fef1c130f90 2026-02-22T20:57:33.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 10 monclient: dump: 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7fef04003710 con 0x7fef1c130f90 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 msgr2=0x7fef1c0599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 0x7fef1c0599c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef040ab040 tx=0x7fef04019330 comp rx=0 tx=0).stop 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 msgr2=0x7fef1c0599c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:33.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7feefb7fe640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef1c130f90 0x7fef1c0599c0 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef040ab040 tx=0x7fef04019330 comp rx=0 tx=0).stop 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 121101, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.722 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.723 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:33.724 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.725 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.726 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:33.727 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.728 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:33.729 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:33.730 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:33.730 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:33.730 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:33.730 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:33.730 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 >> v2:10.20.193.61:6800/2336688312 conn(0x7feee803ab20 msgr2=0x7feee805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 --2- 10.20.193.7:0/1078203994 >> v2:10.20.193.61:6800/2336688312 conn(0x7feee803ab20 0x7feee805afd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef0c002af0 tx=0x7fef0c0032e0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 10 monclient: shutdown 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 msgr2=0x7fef1c194030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 --2- 10.20.193.7:0/1078203994 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef1c089540 0x7fef1c194030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c4f0 tx=0x7fef1000c9b0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1b7fe640 1 -- 10.20.193.7:0/1078203994 reap_dead start 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1b7fe640 1 -- 10.20.193.7:0/1078203994 reap_dead start 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 shutdown_connections 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 >> 10.20.193.7:0/1078203994 conn(0x7fef1c08d850 msgr2=0x7fef1c057d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.731 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 shutdown_connections 2026-02-22T20:57:33.732 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.706+0000 7fef1bfff640 1 -- 10.20.193.7:0/1078203994 wait complete. 2026-02-22T20:57:33.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:33.732 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:57:33.732 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:57:33.790 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20916]: starting. 2026-02-22T20:57:33.790 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20916]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20914 2026-02-22T20:57:33.790 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[20916]: shutting down. 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: get_monmap_and_config 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: monmap: 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:33.793010+0000 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:33.793010+0000 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:33.793 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 Processor -- start 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 -- start start 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: init 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f315c13f780 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f315c13fb50 0x7f315c056180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-c con 0x7f315c13fb50 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f315c181440 0x7f315c1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-a con 0x7f315c181440 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c091820 con 0x7f315c13f780 2026-02-22T20:57:33.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f315c13f110 con 0x7f315c181440 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f315c087300 con 0x7f315c13fb50 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient(hunting): authenticate will time out at 866.265951s 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f315c181440 0x7f315c1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f315c181440 0x7f315c1a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45814/0 (socket says 10.20.193.7:45814) 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 -- 10.20.193.7:0/4203446378 learned_addr learned my addr 10.20.193.7:0/4203446378 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): get_auth_request con 0x7f315c181440 auth_method 0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3153fff640 1 --2- 10.20.193.7:0/4203446378 >> v2:10.20.193.61:3300/0 conn(0x7f315c13fb50 0x7f315c056180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3153fff640 10 monclient(hunting): get_auth_request con 0x7f315c13fb50 auth_method 0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3153fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3153fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient(hunting): handle_auth_done global_id 94131 payload 274 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 -- 10.20.193.7:0/4203446378 >> v2:10.20.193.61:3300/0 conn(0x7f315c13fb50 msgr2=0x7f315c056180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 --2- 10.20.193.7:0/4203446378 >> v2:10.20.193.61:3300/0 conn(0x7f315c13fb50 0x7f315c056180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 -- 10.20.193.7:0/4203446378 >> v1:10.20.193.61:6789/0 conn(0x7f315c13f780 legacy=0x7f315c055a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 -- 10.20.193.7:0/4203446378 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c091b00 con 0x7f315c181440 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31613a2640 1 --2- 10.20.193.7:0/4203446378 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c1a1820 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f315c08deb0 tx=0x7f315801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d80f4a004a00b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 1 -- 10.20.193.7:0/4203446378 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580b2070 con 0x7f315c181440 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: dump: 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.796 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 1 -- 10.20.193.7:0/4203446378 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31580a5a20 con 0x7f315c181440 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 1 -- 10.20.193.7:0/4203446378 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580a5e10 con 0x7f315c181440 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f31537fe640 10 monclient: dump: 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 5 monclient: authenticate success, global_id 94131 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.790+0000 7f3161ba3640 4 set_mon_vals no callback set 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: shutdown 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/4203446378 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 msgr2=0x7f315c1a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- 10.20.193.7:0/4203446378 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c1a1820 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f315c08deb0 tx=0x7f315801c940 comp rx=0 tx=0).stop 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/4203446378 shutdown_connections 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- 10.20.193.7:0/4203446378 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c1a1820 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- 10.20.193.7:0/4203446378 >> v2:10.20.193.61:3300/0 conn(0x7f315c13fb50 0x7f315c056180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/4203446378 >> 10.20.193.7:0/4203446378 conn(0x7f315c0906f0 msgr2=0x7f315c090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/4203446378 shutdown_connections 2026-02-22T20:57:33.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/4203446378 wait complete. 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: build_initial_monmap 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: monmap: 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 Processor -- start 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- start start 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: init 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f315c13f780 0x7f315c10ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-b con 0x7f315c13f780 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-c con 0x7f315c13fb50 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c12e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): picked mon.noname-a con 0x7f315c181440 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f315c056840 con 0x7f315c181440 2026-02-22T20:57:33.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0566c0 con 0x7f315c13f780 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f315c1a4580 con 0x7f315c13fb50 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient(hunting): authenticate will time out at 866.269662s 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51148/0 (socket says 10.20.193.7:51148) 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 1 -- 10.20.193.7:0/3624690718 learned_addr learned my addr 10.20.193.7:0/3624690718 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): get_auth_request con 0x7f315c13fb50 auth_method 0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c12e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): get_auth_request con 0x7f315c181440 auth_method 0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f315c13f780 0x7f315c10ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): get_auth_request con 0x7f315c13f780 auth_method 0 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient(hunting): handle_auth_done global_id 94134 payload 824 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 -- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 msgr2=0x7f315c10d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 -- 10.20.193.7:0/3624690718 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f315c13f780 msgr2=0x7f315c10ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f315c13f780 0x7f315c10ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient: _finish_hunting 0 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 monclient: found mon.noname-a 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 -- 10.20.193.7:0/3624690718 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c08fb60 con 0x7f315c181440 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3153fff640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31613a2640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c12e990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f315801a570 tx=0x7f31580196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31580b2040 con 0x7f315c181440 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: dump: 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: _finish_auth 0 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: _check_auth_tickets 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3158003dd0 con 0x7f315c181440 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 5 monclient: authenticate success, global_id 94134 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158004280 con 0x7f315c181440 2026-02-22T20:57:33.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 10 monclient: dump: 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _renew_subs 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c110290 con 0x7f315c181440 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3152ffd640 4 set_mon_vals no callback set 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _renew_subs 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c10f420 con 0x7f315c181440 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c055a70 con 0x7f315c181440 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f31580b5070 con 0x7f315c181440 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 --2- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 0x7f312c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(172..172 src has 64..172) ==== 3503+0+0 (secure 0 0 0) 0x7f31580e9100 con 0x7f315c181440 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 1 --2- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 0x7f312c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.794+0000 7f3160ba1640 10 monclient: get_auth_request con 0x7f312c03ab20 auth_method 0 2026-02-22T20:57:33.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.798+0000 7f3160ba1640 1 --2- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 0x7f312c05afd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f314c007fd0 tx=0x7f314c007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:33.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.798+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f31580165c0 con 0x7f315c181440 2026-02-22T20:57:33.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.798+0000 7f31517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:33.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.798+0000 7f31517fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:33.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:57:33.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:57:33.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:33.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f315c056b30 con 0x7f315c181440 2026-02-22T20:57:33.917 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f31517fa640 1 -- 10.20.193.7:0/3624690718 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f31580e8000 con 0x7f315c181440 2026-02-22T20:57:33.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f31517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:57:33.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f31517fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=289994738,config=3140514009,health=3423964923,kv=3991984195,logm=33240610}) 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=1,health=13,kv=10,logm=62} crc {auth=772205753,config=1228700967,health=1869875948,kv=3991984195,logm=1525645144}) 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=289994738,config=3140514009,health=3423964923,kv=3991984195,logm=33240610}) 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=1224172634,config=3140514009,health=1869875948,kv=3991984195,logm=730814318}) 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.918 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2052063760}) 2026-02-22T20:57:33.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 msgr2=0x7f312c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 0x7f312c05afd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f314c007fd0 tx=0x7f314c007f20 comp rx=0 tx=0).stop 2026-02-22T20:57:33.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 10 monclient: shutdown 2026-02-22T20:57:33.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:33.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 msgr2=0x7f315c12e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:33.919 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2970604582}) 2026-02-22T20:57:33.919 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.919 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2052063760}) 2026-02-22T20:57:33.920 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1885321921}) 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c12e990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f315801a570 tx=0x7f31580196e0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 shutdown_connections 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f315c181440 0x7f315c12e990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f315c13fb50 0x7f315c10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> v2:10.20.193.61:6800/2336688312 conn(0x7f312c03ab20 0x7f312c05afd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 --2- 10.20.193.7:0/3624690718 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f315c13f780 0x7f315c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:33.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 >> 10.20.193.7:0/3624690718 conn(0x7f315c0906f0 msgr2=0x7f315c08e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:33.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 shutdown_connections 2026-02-22T20:57:33.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:33.914+0000 7f3161ba3640 1 -- 10.20.193.7:0/3624690718 wait complete. 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54820289}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3659540075}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54820289}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4264404798}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1905119594}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=826692200}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1905119594}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=852898097}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2494791255}) 2026-02-22T20:57:33.924 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=615912125}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2494791255}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.914+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1388419875}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2077685749}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51149727}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2077685749}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=442943023}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1243554848}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1458395311}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1243554848}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3601482655}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168782605}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1882579327}) 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.925 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168782605}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1812582583}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3001619589}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3669256499}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3001619589}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2729105304}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2162570808}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3749299662}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2162570808}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=864751443}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3218927291}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3510267684}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3218927291}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1807938883}) 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.926 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082073169}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2414757120}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082073169}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=604282585}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.918+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921876989}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=991087097}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921876989}) 2026-02-22T20:57:33.927 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2130922574}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=3175417415,mdsmap=64455062,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2669019546,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=935146538,osd_metadata=3800004512,osd_pg_creating=1019389193,osd_snap=4133920409,osdmap=2662985637}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=43,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=183550487,mdsmap=774328894,mgr=2003615621,mgr_metadata=266755361,mgrstat=2669019546,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1019389193,osd_snap=4133920409,osdmap=1826746153}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=3175417415,mdsmap=64455062,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2669019546,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=935146538,osd_metadata=3800004512,osd_pg_creating=1019389193,osd_snap=4133920409,osdmap=2662985637}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=39,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=4065272898,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2669019546,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1019389193,osd_snap=4133920409,osdmap=3598219794}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=623322806}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1338419271}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=623322806}) 2026-02-22T20:57:33.928 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.922+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=149102931}) 2026-02-22T20:57:33.929 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:57:33.929 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.929 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=60} crc {osdmap=1027112807}) 2026-02-22T20:57:33.930 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=63} crc {osdmap=3899184313}) 2026-02-22T20:57:33.930 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:57:33.930 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=60} crc {osdmap=1027112807}) 2026-02-22T20:57:33.930 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:57:33.926+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=58} crc {osdmap=709092759}) 2026-02-22T20:57:34.930 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:57:34.930 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:57:34.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: get_monmap_and_config 2026-02-22T20:57:34.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: build_initial_monmap 2026-02-22T20:57:34.997 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: monmap: 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:34.997494+0000 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:34.997494+0000 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:34.998 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 Processor -- start 2026-02-22T20:57:35.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 -- start start 2026-02-22T20:57:35.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: init 2026-02-22T20:57:35.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f08cc092c20 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f08cc13f9a0 0x7f08cc1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-c con 0x7f08cc13f9a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f08cc13fe00 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08cc056c10 con 0x7f08cc13fe00 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08cc0919a0 con 0x7f08cc092c20 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f08cc091c80 con 0x7f08cc13f9a0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 10 monclient(hunting): authenticate will time out at 867.470417s 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f08cc13fe00 0x7f08cc1a0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34850/0 (socket says 10.20.193.7:34850) 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 1 -- 10.20.193.7:0/116017225 learned_addr learned my addr 10.20.193.7:0/116017225 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 1 --2- 10.20.193.7:0/116017225 >> v2:10.20.193.61:3300/0 conn(0x7f08cc13f9a0 0x7f08cc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): get_auth_request con 0x7f08cc13f9a0 auth_method 0 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931484493 0 0) 0x7f08cc056c10 con 0x7f08cc13fe00 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): my global_id is 94152 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b0003620 con 0x7f08cc13fe00 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303833554 0 0) 0x7f08cc0919a0 con 0x7f08cc092c20 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _negotiate 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): my global_id is 74566 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08cc056c10 con 0x7f08cc092c20 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3530653240 0 0) 0x7f08b0003620 con 0x7f08cc13fe00 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 >> v2:10.20.193.61:3300/0 conn(0x7f08cc13f9a0 msgr2=0x7f08cc1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 --2- 10.20.193.7:0/116017225 >> v2:10.20.193.61:3300/0 conn(0x7f08cc13f9a0 0x7f08cc1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 >> v1:10.20.193.61:6789/0 conn(0x7f08cc092c20 legacy=0x7f08cc13f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:57:35.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc091f60 con 0x7f08cc13fe00 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f08c00031e0 con 0x7f08cc13fe00 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: dump: 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 >> v1:10.20.193.7:6789/0 conn(0x7f08cc13fe00 legacy=0x7f08cc1a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 0x7f08b0004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): picked mon.a con 0x7f08b0003d80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b00048d0 0x7f08b0004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): picked mon.c con 0x7f08b00048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08b0005450 0x7f08b0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): picked mon.b con 0x7f08b0005450 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc091c80 con 0x7f08b0003d80 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f08b0066350 con 0x7f08b0005450 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f08b0066550 con 0x7f08b00048d0 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08ca7fc640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 0x7f08b0004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b00048d0 0x7f08b0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): get_auth_request con 0x7f08b00048d0 auth_method 0 2026-02-22T20:57:35.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): get_auth_request con 0x7f08b0003d80 auth_method 0 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08b0005450 0x7f08b0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 10 monclient(hunting): get_auth_request con 0x7f08b0005450 auth_method 0 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08caffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_done global_id 94152 payload 293 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 -- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b00048d0 msgr2=0x7f08b0004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b00048d0 0x7f08b0004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 -- 10.20.193.7:0/116017225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08b0005450 msgr2=0x7f08b0065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08b0005450 0x7f08b0065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 monclient: found mon.a 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 1 -- 10.20.193.7:0/116017225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b0003620 con 0x7f08b0003d80 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08b0005450 0x7f08b0065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 5 monclient: authenticate success, global_id 94152 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08d0fc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.994+0000 7f08cbfff640 1 -- 10.20.193.7:0/116017225 reap_dead start 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 0x7f08b0004170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007fd0 tx=0x7f08b801c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288c81161eac3f40 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8002dc0 con 0x7f08b0003d80 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: dump: 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:35.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8005080 con 0x7f08b0003d80 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 1 -- 10.20.193.7:0/116017225 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8005450 con 0x7f08b0003d80 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08ca7fc640 10 monclient: dump: 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 4 set_mon_vals no callback set 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: shutdown 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 msgr2=0x7f08b0004170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 0x7f08b0004170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007fd0 tx=0x7f08b801c5f0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/116017225 shutdown_connections 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/116017225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08b0003d80 0x7f08b0004170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/116017225 >> 10.20.193.7:0/116017225 conn(0x7f08cc0906f0 msgr2=0x7f08cc090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/116017225 shutdown_connections 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/116017225 wait complete. 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: monmap: 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:35.008 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 Processor -- start 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- start start 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: init 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-c con 0x7f08b0003d80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08cc13b340 0x7f08cc13b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-b con 0x7f08cc13b340 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08cc12a080 0x7f08cc12a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): picked mon.noname-a con 0x7f08cc12a080 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc13cb10 con 0x7f08cc12a080 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc13c990 con 0x7f08cc13b340 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f08cc13cc90 con 0x7f08b0003d80 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient(hunting): authenticate will time out at 867.474538s 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51176/0 (socket says 10.20.193.7:51176) 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 -- 10.20.193.7:0/4028358855 learned_addr learned my addr 10.20.193.7:0/4028358855 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): get_auth_request con 0x7f08b0003d80 auth_method 0 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08cc12a080 0x7f08cc12a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): get_auth_request con 0x7f08cc12a080 auth_method 0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08caffd640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08cc13b340 0x7f08cc13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08caffd640 10 monclient(hunting): get_auth_request con 0x7f08cc13b340 auth_method 0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08caffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient(hunting): handle_auth_done global_id 64688 payload 824 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 -- 10.20.193.7:0/4028358855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08cc13b340 msgr2=0x7f08cc13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08cc13b340 0x7f08cc13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 -- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08cc12a080 msgr2=0x7f08cc12a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08cc12a080 0x7f08cc12a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 monclient: found mon.noname-c 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 -- 10.20.193.7:0/4028358855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc12da70 con 0x7f08b0003d80 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08cb7fe640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08b801cb60 tx=0x7f08b0005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80b1070 con 0x7f08b0003d80 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: dump: 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.011 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b80068d0 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8006c80 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 10 monclient: dump: 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08c9ffb640 4 set_mon_vals no callback set 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 5 monclient: authenticate success, global_id 64688 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _renew_subs 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc12d210 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _renew_subs 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc12d790 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc1427b0 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f08b80036f0 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 --2- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 0x7f089c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:34.998+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7f08b80e79d0 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08caffd640 1 --2- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 0x7f089c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08caffd640 10 monclient: get_auth_request con 0x7f089c03ab20 auth_method 0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08caffd640 1 --2- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 0x7f089c05afd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08cc12d170 tx=0x7f08bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f08b8016310 con 0x7f08b0003d80 2026-02-22T20:57:35.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08a7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.002+0000 7f08a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f08cc05faa0 con 0x7f08b0003d80 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08a7fff640 1 -- 10.20.193.7:0/4028358855 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f08b8006e20 con 0x7f08b0003d80 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08a7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:35.116 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:57:35.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 msgr2=0x7f089c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 0x7f089c05afd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08cc12d170 tx=0x7f08bc008040 comp rx=0 tx=0).stop 2026-02-22T20:57:35.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 10 monclient: shutdown 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 msgr2=0x7f08cc1d9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08b801cb60 tx=0x7f08b0005900 comp rx=0 tx=0).stop 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 shutdown_connections 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08cc12a080 0x7f08cc12a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> v2:10.20.193.61:6800/2336688312 conn(0x7f089c03ab20 0x7f089c05afd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08cc13b340 0x7f08cc13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 --2- 10.20.193.7:0/4028358855 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08b0003d80 0x7f08cc1d9b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 >> 10.20.193.7:0/4028358855 conn(0x7f08cc0906f0 msgr2=0x7f08cc08e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 shutdown_connections 2026-02-22T20:57:35.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.114+0000 7f08d0fc6640 1 -- 10.20.193.7:0/4028358855 wait complete. 2026-02-22T20:57:35.127 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:57:35.127 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:57:35.127 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:57:35.127 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:57:35.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.182+0000 7f7a4e9bb640 10 monclient: get_monmap_and_config 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.182+0000 7f7a4e9bb640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.182+0000 7f7a4e9bb640 10 monclient: monmap: 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:35.187688+0000 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:35.187688+0000 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.191 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 Processor -- start 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- start start 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: init 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7a4805d1c0 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:35.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7a48160600 0x7f7a481809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-a con 0x7f7a48160600 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f7a48180f20 0x7f7a481a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-c con 0x7f7a48180f20 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4813fbd0 con 0x7f7a4805d1c0 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4808a6d0 con 0x7f7a48160600 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4808b770 con 0x7f7a48180f20 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): authenticate will time out at 867.660610s 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7a48160600 0x7f7a481809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7a48160600 0x7f7a481809e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45862/0 (socket says 10.20.193.7:45862) 2026-02-22T20:57:35.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 -- 10.20.193.7:0/605590025 learned_addr learned my addr 10.20.193.7:0/605590025 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): get_auth_request con 0x7f7a48160600 auth_method 0 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4cf31640 1 --2- 10.20.193.7:0/605590025 >> v2:10.20.193.61:3300/0 conn(0x7f7a48180f20 0x7f7a481a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4cf31640 10 monclient(hunting): get_auth_request con 0x7f7a48180f20 auth_method 0 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4cf31640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient(hunting): handle_auth_done global_id 94158 payload 274 2026-02-22T20:57:35.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 -- 10.20.193.7:0/605590025 >> v2:10.20.193.61:3300/0 conn(0x7f7a48180f20 msgr2=0x7f7a481a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 --2- 10.20.193.7:0/605590025 >> v2:10.20.193.61:3300/0 conn(0x7f7a48180f20 0x7f7a481a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 -- 10.20.193.7:0/605590025 >> v1:10.20.193.61:6789/0 conn(0x7f7a4805d1c0 legacy=0x7f7a4805d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 monclient: found mon.noname-a 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 -- 10.20.193.7:0/605590025 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4808ba50 con 0x7f7a48160600 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 --2- 10.20.193.7:0/605590025 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a48160600 0x7f7a481809e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7a380090a0 tx=0x7f7a3801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6f00f1c396049 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 1 -- 10.20.193.7:0/605590025 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380b0070 con 0x7f7a48160600 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: dump: 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.195 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 1 -- 10.20.193.7:0/605590025 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a380ab600 con 0x7f7a48160600 2026-02-22T20:57:35.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 1 -- 10.20.193.7:0/605590025 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380ab9d0 con 0x7f7a48160600 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 5 monclient: authenticate success, global_id 94158 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 4 set_mon_vals no callback set 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a46ffd640 10 monclient: dump: 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.197 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: shutdown 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/605590025 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a48160600 msgr2=0x7f7a481809e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/605590025 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a48160600 0x7f7a481809e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7a380090a0 tx=0x7f7a3801c2e0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/605590025 shutdown_connections 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/605590025 >> v2:10.20.193.61:3300/0 conn(0x7f7a48180f20 0x7f7a481a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/605590025 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a48160600 0x7f7a481809e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/605590025 >> 10.20.193.7:0/605590025 conn(0x7f7a4808faa0 msgr2=0x7f7a4808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/605590025 shutdown_connections 2026-02-22T20:57:35.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/605590025 wait complete. 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: monmap: 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:35.204 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 Processor -- start 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- start start 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: init 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 0x7f7a4815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-a con 0x7f7a4805d1c0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7a48160600 0x7f7a4815b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-c con 0x7f7a48160600 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7a48180f20 0x7f7a4815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): picked mon.noname-b con 0x7f7a48180f20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481a43f0 con 0x7f7a4805d1c0 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481a4270 con 0x7f7a48180f20 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7a481a4570 con 0x7f7a48160600 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a4e9bb640 10 monclient(hunting): authenticate will time out at 867.663927s 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a47fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 0x7f7a4815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 0x7f7a4815b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45874/0 (socket says 10.20.193.7:45874) 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 -- 10.20.193.7:0/2534452935 learned_addr learned my addr 10.20.193.7:0/2534452935 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.186+0000 7f7a477fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7a48160600 0x7f7a4815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): get_auth_request con 0x7f7a4805d1c0 auth_method 0 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): get_auth_request con 0x7f7a48160600 auth_method 0 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7a48180f20 0x7f7a4815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 10 monclient(hunting): get_auth_request con 0x7f7a48180f20 auth_method 0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient(hunting): handle_auth_done global_id 64691 payload 824 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7a48180f20 msgr2=0x7f7a4815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7a48180f20 0x7f7a4815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 msgr2=0x7f7a4815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 0x7f7a4815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 monclient: found mon.noname-c 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4813cbc0 con 0x7f7a48160600 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4805d1c0 0x7f7a4815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a477fe640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7a48160600 0x7f7a4815b750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a38006fd0 tx=0x7f7a38019080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380b9020 con 0x7f7a48160600 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:57:35.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: dump: 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a380b1040 con 0x7f7a48160600 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380b0050 con 0x7f7a48160600 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: dump: 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.208 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a467fc640 4 set_mon_vals no callback set 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 5 monclient: authenticate success, global_id 64691 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 monclient: _renew_subs 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a48086690 con 0x7f7a48160600 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 monclient: _renew_subs 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4815f030 con 0x7f7a48160600 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 0x7f7a48159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4815ecb0 con 0x7f7a4815d830 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7a38004220 con 0x7f7a48160600 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 0x7f7a48159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient: get_auth_request con 0x7f7a4815d830 auth_method 0 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 --2- 10.20.193.7:0/2534452935 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7a1803ab20 0x7f7a1805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7f7a380e8360 con 0x7f7a48160600 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 10 monclient(hunting): handle_auth_done global_id 94164 payload 824 2026-02-22T20:57:35.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a480382a0 con 0x7f7a4815d830 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a47fff640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 0x7f7a48159550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a34007d60 tx=0x7f7a3400d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 1 --2- 10.20.193.7:0/2534452935 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7a1803ab20 0x7f7a1805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 10 monclient: get_auth_request con 0x7f7a1803ab20 auth_method 0 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34018020 con 0x7f7a4815d830 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: dump: 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f7a3400dbd0 con 0x7f7a4815d830 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 msgr2=0x7f7a48159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 0x7f7a48159550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a34007d60 tx=0x7f7a3400d150 comp rx=0 tx=0).stop 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 msgr2=0x7f7a48159550 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a44ff9640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815d830 0x7f7a48159550 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a34007d60 tx=0x7f7a3400d150 comp rx=0 tx=0).stop 2026-02-22T20:57:35.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.190+0000 7f7a4cf31640 1 --2- 10.20.193.7:0/2534452935 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7a1803ab20 0x7f7a1805afd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a4813dea0 tx=0x7f7a3c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 0x7f7a48159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4805d590 con 0x7f7a4815f7b0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 0x7f7a48159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient: get_auth_request con 0x7f7a4815f7b0 auth_method 0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 10 monclient(hunting): handle_auth_done global_id 94167 payload 824 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 1 -- 10.20.193.7:0/2534452935 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a4805fc70 con 0x7f7a4815f7b0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a47fff640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 0x7f7a48159a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a34016000 tx=0x7f7a34003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34018030 con 0x7f7a4815f7b0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 10 monclient: dump: 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.211 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4715 (secure 0 0 0) 0x7f7a3400de30 con 0x7f7a4815f7b0 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 msgr2=0x7f7a48159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 0x7f7a48159a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a34016000 tx=0x7f7a34003850 comp rx=0 tx=0).stop 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 msgr2=0x7f7a48159a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a44ff9640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7a4815f7b0 0x7f7a48159a90 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a34016000 tx=0x7f7a34003850 comp rx=0 tx=0).stop 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:35.212 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 27879, 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.213 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:35.214 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.215 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.216 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.217 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:35.218 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.219 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.220 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.220 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.220 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:35.220 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7a1803ab20 msgr2=0x7f7a1805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/2534452935 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7a1803ab20 0x7f7a1805afd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7a4813dea0 tx=0x7f7a3c00b040 comp rx=0 tx=0).stop 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 10 monclient: shutdown 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7a48160600 msgr2=0x7f7a4815b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 --2- 10.20.193.7:0/2534452935 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7a48160600 0x7f7a4815b750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a38006fd0 tx=0x7f7a38019080 comp rx=0 tx=0).stop 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4cf31640 1 -- 10.20.193.7:0/2534452935 reap_dead start 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4cf31640 1 -- 10.20.193.7:0/2534452935 reap_dead start 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 shutdown_connections 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 >> 10.20.193.7:0/2534452935 conn(0x7f7a4808faa0 msgr2=0x7f7a4808e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 shutdown_connections 2026-02-22T20:57:35.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.194+0000 7f7a4e9bb640 1 -- 10.20.193.7:0/2534452935 wait complete. 2026-02-22T20:57:35.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:35.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:57:35.222 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: get_monmap_and_config 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: monmap: 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:35.290725+0000 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:35.290725+0000 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:35.291 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 1 Processor -- start 2026-02-22T20:57:35.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 1 -- start start 2026-02-22T20:57:35.292 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: init 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fca2408b590 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.286+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-b con 0x7fca2413a6a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fca2417e8b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca24089920 con 0x7fca2417e8b0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2408a860 con 0x7fca2408b590 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fca2413aad0 con 0x7fca2413a6a0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): authenticate will time out at 867.764046s 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fca2417e8b0 0x7fca2419ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34858/0 (socket says 10.20.193.7:34858) 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 1 -- 10.20.193.7:0/2296162903 learned_addr learned my addr 10.20.193.7:0/2296162903 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51200/0 (socket says 10.20.193.7:51200) 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): get_auth_request con 0x7fca2413a6a0 auth_method 0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient(hunting): handle_auth_done global_id 64694 payload 274 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 -- 10.20.193.7:0/2296162903 >> v1:10.20.193.61:6789/0 conn(0x7fca2408b590 legacy=0x7fca24139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 1 -- 10.20.193.7:0/2296162903 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276501113 0 0) 0x7fca24089920 con 0x7fca2417e8b0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 -- 10.20.193.7:0/2296162903 >> v1:10.20.193.7:6789/0 conn(0x7fca2417e8b0 legacy=0x7fca2419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 monclient: found mon.noname-b 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 -- 10.20.193.7:0/2296162903 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24089170 con 0x7fca2413a6a0 2026-02-22T20:57:35.293 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 --2- 10.20.193.7:0/2296162903 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca18009870 tx=0x7fca1801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9b4d3af569b1cf9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 1 -- 10.20.193.7:0/2296162903 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180b0070 con 0x7fca2413a6a0 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: dump: 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.294 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 1 -- 10.20.193.7:0/2296162903 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca180ab600 con 0x7fca2413a6a0 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 1 -- 10.20.193.7:0/2296162903 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab9d0 con 0x7fca2413a6a0 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 5 monclient: authenticate success, global_id 64694 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 4 set_mon_vals no callback set 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca28f16640 10 monclient: dump: 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.295 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: shutdown 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- 10.20.193.7:0/2296162903 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 msgr2=0x7fca2417e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/2296162903 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca18009870 tx=0x7fca1801c4f0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- 10.20.193.7:0/2296162903 shutdown_connections 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/2296162903 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2413a6a0 0x7fca2417e370 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- 10.20.193.7:0/2296162903 >> 10.20.193.7:0/2296162903 conn(0x7fca2408faa0 msgr2=0x7fca2408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- 10.20.193.7:0/2296162903 shutdown_connections 2026-02-22T20:57:35.296 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- 10.20.193.7:0/2296162903 wait complete. 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: monmap: 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:35.298 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 Processor -- start 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- start start 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: init 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-a con 0x7fca2408b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fca2413a6a0 0x7fca24139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-b con 0x7fca2413a6a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417e8b0 0x7fca240869d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): picked mon.noname-c con 0x7fca2417e8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca241a2f60 con 0x7fca2408b590 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fca241a2de0 con 0x7fca2413a6a0 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fca241a30e0 con 0x7fca2417e8b0 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2c1a3640 10 monclient(hunting): authenticate will time out at 867.767697s 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.299 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45914/0 (socket says 10.20.193.7:45914) 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 -- 10.20.193.7:0/1192118249 learned_addr learned my addr 10.20.193.7:0/1192118249 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): get_auth_request con 0x7fca2408b590 auth_method 0 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417e8b0 0x7fca240869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): get_auth_request con 0x7fca2417e8b0 auth_method 0 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29717640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fca2413a6a0 0x7fca24139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca2a719640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient(hunting): handle_auth_done global_id 94173 payload 824 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417e8b0 msgr2=0x7fca240869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417e8b0 0x7fca240869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fca2413a6a0 msgr2=0x7fca24139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fca2413a6a0 0x7fca24139690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.300 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 monclient: found mon.noname-a 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.290+0000 7fca29f18640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24058530 con 0x7fca2408b590 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29f18640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c730 tx=0x7fca1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14006ad0 con 0x7fca2408b590 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: dump: 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca14006c70 con 0x7fca2408b590 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14007230 con 0x7fca2408b590 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: dump: 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.301 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca13fff640 4 set_mon_vals no callback set 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 5 monclient: authenticate success, global_id 94173 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 monclient: _renew_subs 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca24086690 con 0x7fca2408b590 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 monclient: _renew_subs 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca24088350 con 0x7fca2408b590 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 0x7fca2417b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fca240382a0 con 0x7fca2417ac70 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 0x7fca2417b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient: get_auth_request con 0x7fca2417ac70 auth_method 0 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 10 monclient(hunting): handle_auth_done global_id 64700 payload 824 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca24139f90 con 0x7fca2417ac70 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca29717640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 0x7fca2417b040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca24088040 tx=0x7fca18019290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.302 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fca14023060 con 0x7fca2408b590 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 --2- 10.20.193.7:0/1192118249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc9f403aae0 0x7fc9f405af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7fca1404e890 con 0x7fca2408b590 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180b0040 con 0x7fca2417ac70 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: dump: 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fca180b9070 con 0x7fca2417ac70 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 msgr2=0x7fca2417b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 0x7fca2417b040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca24088040 tx=0x7fca18019290 comp rx=0 tx=0).stop 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 msgr2=0x7fca2417b040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca127fc640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2417ac70 0x7fca2417b040 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca24088040 tx=0x7fca18019290 comp rx=0 tx=0).stop 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2a719640 1 --2- 10.20.193.7:0/1192118249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc9f403aae0 0x7fc9f405af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2a719640 10 monclient: get_auth_request con 0x7fc9f403aae0 auth_method 0 2026-02-22T20:57:35.303 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.294+0000 7fca2a719640 1 --2- 10.20.193.7:0/1192118249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc9f403aae0 0x7fc9f405af90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca24088c00 tx=0x7fca20003430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 0x7fca2418d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fca2405fc70 con 0x7fca2418cd60 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 0x7fca2418d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient: get_auth_request con 0x7fca2418cd60 auth_method 0 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.304 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 10 monclient(hunting): handle_auth_done global_id 64703 payload 824 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 1 -- 10.20.193.7:0/1192118249 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca2419d5f0 con 0x7fca2418cd60 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca29717640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 0x7fca2418d160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fca180b6040 tx=0x7fca180a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180b4840 con 0x7fca2418cd60 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 10 monclient: dump: 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4881 (secure 0 0 0) 0x7fca180b4840 con 0x7fca2418cd60 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 msgr2=0x7fca2418d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 0x7fca2418d160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fca180b6040 tx=0x7fca180a8000 comp rx=0 tx=0).stop 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 msgr2=0x7fca2418d160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.305 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca127fc640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fca2418cd60 0x7fca2418d160 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fca180b6040 tx=0x7fca180a8000 comp rx=0 tx=0).stop 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 180903, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.306 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:35.307 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.308 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.309 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:35.310 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.311 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.312 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.313 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.313 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.313 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.313 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:35.313 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc9f403aae0 msgr2=0x7fc9f405af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/1192118249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc9f403aae0 0x7fc9f405af90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca24088c00 tx=0x7fca20003430 comp rx=0 tx=0).stop 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 10 monclient: shutdown 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 msgr2=0x7fca2419f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2a719640 1 -- 10.20.193.7:0/1192118249 reap_dead start 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c730 tx=0x7fca1400cbf0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 shutdown_connections 2026-02-22T20:57:35.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 --2- 10.20.193.7:0/1192118249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fca2408b590 0x7fca2419f990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 >> 10.20.193.7:0/1192118249 conn(0x7fca2408faa0 msgr2=0x7fca24059330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 shutdown_connections 2026-02-22T20:57:35.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.298+0000 7fca2c1a3640 1 -- 10.20.193.7:0/1192118249 wait complete. 2026-02-22T20:57:35.315 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:35.315 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:57:35.315 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: get_monmap_and_config 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: monmap: 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:35.377767+0000 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:35.377767+0000 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:35.378 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 Processor -- start 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 -- start start 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: init 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f435c08bf50 0x7f435c08c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-a con 0x7f435c08bf50 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-b con 0x7f435c08c860 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f435c13fbf0 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435c0570f0 con 0x7f435c13fbf0 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.380 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f435c0568d0 con 0x7f435c08bf50 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f435c056bc0 con 0x7f435c08c860 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f43623c2640 10 monclient(hunting): authenticate will time out at 867.851096s 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f435c08bf50 0x7f435c08c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f435c08bf50 0x7f435c08c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45928/0 (socket says 10.20.193.7:45928) 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 -- 10.20.193.7:0/99465322 learned_addr learned my addr 10.20.193.7:0/99465322 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): get_auth_request con 0x7f435c08bf50 auth_method 0 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.381 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): get_auth_request con 0x7f435c08c860 auth_method 0 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient(hunting): handle_auth_done global_id 94176 payload 274 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 -- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 msgr2=0x7f435c13f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 -- 10.20.193.7:0/99465322 >> v1:10.20.193.61:6789/0 conn(0x7f435c13fbf0 legacy=0x7f435c1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.382 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 monclient: found mon.noname-a 2026-02-22T20:57:35.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435bfff640 1 -- 10.20.193.7:0/99465322 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c090cc0 con 0x7f435c08bf50 2026-02-22T20:57:35.383 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.374+0000 7f435b7fe640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:57:35.388 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c08bf50 0x7f435c08c320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43480090a0 tx=0x7f434801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9964525f2d2916fe server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 1 -- 10.20.193.7:0/99465322 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480b0070 con 0x7f435c08bf50 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: dump: 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.389 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 1 -- 10.20.193.7:0/99465322 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43480ab600 con 0x7f435c08bf50 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 5 monclient: authenticate success, global_id 94176 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 1 -- 10.20.193.7:0/99465322 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480ab9d0 con 0x7f435c08bf50 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435affd640 10 monclient: dump: 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.390 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 4 set_mon_vals no callback set 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: shutdown 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c08bf50 msgr2=0x7f435c08c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c08bf50 0x7f435c08c320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43480090a0 tx=0x7f434801c500 comp rx=0 tx=0).stop 2026-02-22T20:57:35.391 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/99465322 shutdown_connections 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- 10.20.193.7:0/99465322 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c08bf50 0x7f435c08c320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/99465322 >> 10.20.193.7:0/99465322 conn(0x7f435c08e3f0 msgr2=0x7f435c08e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/99465322 shutdown_connections 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/99465322 wait complete. 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: monmap: 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 Processor -- start 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- start start 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: init 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.392 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c08bf50 0x7f435c13c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-b con 0x7f435c08bf50 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-c con 0x7f435c08c860 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 0x7f435c13d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): picked mon.noname-a con 0x7f435c13fbf0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f435c090a10 con 0x7f435c13fbf0 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f435c090890 con 0x7f435c08bf50 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f435c1a4840 con 0x7f435c08c860 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): authenticate will time out at 867.854123s 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 0x7f435c13d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 0x7f435c13d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45938/0 (socket says 10.20.193.7:45938) 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 learned_addr learned my addr 10.20.193.7:0/211673637 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): get_auth_request con 0x7f435c13fbf0 auth_method 0 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): get_auth_request con 0x7f435c08c860 auth_method 0 2026-02-22T20:57:35.393 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient(hunting): handle_auth_done global_id 94179 payload 824 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 msgr2=0x7f435c13cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f435c08c860 0x7f435c13cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c08bf50 0x7f435c13c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c08bf50 msgr2=0x7f435c13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c08bf50 0x7f435c13c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.394 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 monclient: found mon.noname-a 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c078130 con 0x7f435c13fbf0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4360938640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 0x7f435c13d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f435000cc00 tx=0x7f435000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000ad40 con 0x7f435c13fbf0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: dump: 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.395 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4350004a60 con 0x7f435c13fbf0 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350004e50 con 0x7f435c13fbf0 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435a7fc640 4 set_mon_vals no callback set 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: dump: 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 5 monclient: authenticate success, global_id 94179 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _renew_subs 2026-02-22T20:57:35.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c078410 con 0x7f435c13fbf0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _renew_subs 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c0878f0 con 0x7f435c13fbf0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 0x7f435c1387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f435c088740 con 0x7f435c13d6e0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 0x7f435c1387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient: get_auth_request con 0x7f435c13d6e0 auth_method 0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4350023060 con 0x7f435c13fbf0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 --2- 10.20.193.7:0/211673637 >> v2:10.20.193.61:6800/2336688312 conn(0x7f432c03acc0 0x7f432c05b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7f435004ef00 con 0x7f435c13fbf0 2026-02-22T20:57:35.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 10 monclient(hunting): handle_auth_done global_id 74578 payload 824 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f435c08c320 con 0x7f435c13d6e0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 1 --2- 10.20.193.7:0/211673637 >> v2:10.20.193.61:6800/2336688312 conn(0x7f432c03acc0 0x7f432c05b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435b7fe640 10 monclient: get_auth_request con 0x7f432c03acc0 auth_method 0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f435bfff640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 0x7f435c1387b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43480090a0 tx=0x7f434801ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480ba020 con 0x7f435c13d6e0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.378+0000 7f4358ff9640 10 monclient: dump: 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.398 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f43480b6420 con 0x7f435c13d6e0 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435b7fe640 1 --2- 10.20.193.7:0/211673637 >> v2:10.20.193.61:6800/2336688312 conn(0x7f432c03acc0 0x7f432c05b170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f435c08bc10 tx=0x7f434c009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 msgr2=0x7f435c1387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 0x7f435c1387b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43480090a0 tx=0x7f434801ad40 comp rx=0 tx=0).stop 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 msgr2=0x7f435c1387b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f4358ff9640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c13d6e0 0x7f435c1387b0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43480090a0 tx=0x7f434801ad40 comp rx=0 tx=0).stop 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f43623c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f43623c2640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 0x7f435c04ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f43623c2640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f435c138cf0 con 0x7f435c04ca80 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 0x7f435c04ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient: get_auth_request con 0x7f435c04ca80 auth_method 0 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 10 monclient(hunting): handle_auth_done global_id 74581 payload 824 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.382+0000 7f435bfff640 1 -- 10.20.193.7:0/211673637 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f435c077e50 con 0x7f435c04ca80 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f435bfff640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 0x7f435c04ce50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f434801abb0 tx=0x7f43480192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480b0040 con 0x7f435c04ca80 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 10 monclient: dump: 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.400 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7f43480c12b0 con 0x7f435c04ca80 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 msgr2=0x7f435c04ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 0x7f435c04ce50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f434801abb0 tx=0x7f43480192a0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 msgr2=0x7f435c04ce50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:35.401 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4358ff9640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f435c04ca80 0x7f435c04ce50 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f434801abb0 tx=0x7f43480192a0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 48, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 122777, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.402 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:35.403 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:35.404 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.405 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.406 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:35.407 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "num": 8 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:35.408 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 >> v2:10.20.193.61:6800/2336688312 conn(0x7f432c03acc0 msgr2=0x7f432c05b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 --2- 10.20.193.7:0/211673637 >> v2:10.20.193.61:6800/2336688312 conn(0x7f432c03acc0 0x7f432c05b170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f435c08bc10 tx=0x7f434c009290 comp rx=0 tx=0).stop 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 10 monclient: shutdown 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 msgr2=0x7f435c13d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 --2- 10.20.193.7:0/211673637 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f435c13fbf0 0x7f435c13d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f435000cc00 tx=0x7f435000a430 comp rx=0 tx=0).stop 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 reap_dead start 2026-02-22T20:57:35.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f4360938640 1 -- 10.20.193.7:0/211673637 reap_dead start 2026-02-22T20:57:35.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 shutdown_connections 2026-02-22T20:57:35.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 >> 10.20.193.7:0/211673637 conn(0x7f435c08e3f0 msgr2=0x7f435c087e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 shutdown_connections 2026-02-22T20:57:35.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.386+0000 7f43623c2640 1 -- 10.20.193.7:0/211673637 wait complete. 2026-02-22T20:57:35.410 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:57:35.410 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-22T20:57:35.410 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:57:35.410 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-22T20:57:35.410 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-22T20:57:35.410 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T20:57:35.410 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:57:35.423 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T20:57:35.424 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:57:35.424 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: get_monmap_and_config 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: monmap: 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:35.530913+0000 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:35.530913+0000 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:35.531 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:35.532 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:35.532 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 1 Processor -- start 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 1 -- start start 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: init 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.526+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5c0813be70 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5c0817d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-b con 0x7f5c0813c950 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5c0817d950 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c080875d0 con 0x7f5c0813be70 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c080872f0 con 0x7f5c0817d950 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5c080878b0 con 0x7f5c0813c950 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient(hunting): authenticate will time out at 868.004089s 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0cf60640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 msgr2=0x7f5c0817d410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0cf60640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5c0817d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f5c0813be70 0x7f5c0813c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34868/0 (socket says 10.20.193.7:34868) 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 -- 10.20.193.7:0/4254734407 learned_addr learned my addr 10.20.193.7:0/4254734407 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665844821 0 0) 0x7f5c080875d0 con 0x7f5c0813be70 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): _negotiate 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): my global_id is 94182 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bf0003620 con 0x7f5c0813be70 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 976534885 0 0) 0x7f5bf0003620 con 0x7f5c0813be70 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 msgr2=0x7f5c0817d410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5c0817d410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 >> v1:10.20.193.61:6789/0 conn(0x7f5c0817d950 legacy=0x7f5c0819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0808dbd0 con 0x7f5c0813be70 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f5bf8002e60 con 0x7f5c0813be70 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: dump: 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.535 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 >> v1:10.20.193.7:6789/0 conn(0x7f5c0813be70 legacy=0x7f5c0813c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5bf0003b70 0x7f5bf0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): picked mon.a con 0x7f5bf0003b70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5bf00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): picked mon.c con 0x7f5c0813c950 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0005030 0x7f5bf0065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): picked mon.b con 0x7f5bf0005030 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf0065fd0 con 0x7f5bf0003b70 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf0066150 con 0x7f5bf0005030 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf00662d0 con 0x7f5c0813c950 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0cf60640 1 -- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 msgr2=0x7f5bf00048d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0cf60640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5bf00048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5bf0003b70 0x7f5bf0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): get_auth_request con 0x7f5bf0003b70 auth_method 0 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:57:35.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0005030 0x7f5bf0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 10 monclient(hunting): get_auth_request con 0x7f5bf0005030 auth_method 0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient(hunting): handle_auth_done global_id 94182 payload 293 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 -- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 msgr2=0x7f5bf00048d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c0813c950 0x7f5bf00048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 -- 10.20.193.7:0/4254734407 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0005030 msgr2=0x7f5bf0065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0005030 0x7f5bf0065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 monclient: found mon.a 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 -- 10.20.193.7:0/4254734407 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf0003620 con 0x7f5bf0003b70 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 5 monclient: authenticate success, global_id 94182 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0d761640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5bf0003b70 0x7f5bf0003f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80036c0 tx=0x7f5bf801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982bc37661ae8b63 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8007d20 con 0x7f5bf0003b70 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: dump: 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.537 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf80a9020 con 0x7f5bf0003b70 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 1 -- 10.20.193.7:0/4254734407 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8005bf0 con 0x7f5bf0003b70 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5bf7fff640 10 monclient: dump: 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:35.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 4 set_mon_vals no callback set 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient: shutdown 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5bf0003b70 msgr2=0x7f5bf0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/4254734407 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5bf0003b70 0x7f5bf0003f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80036c0 tx=0x7f5bf801cc00 comp rx=0 tx=0).stop 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0df62640 1 -- 10.20.193.7:0/4254734407 reap_dead start 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/4254734407 shutdown_connections 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/4254734407 >> 10.20.193.7:0/4254734407 conn(0x7f5c0808f860 msgr2=0x7f5c0808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/4254734407 shutdown_connections 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/4254734407 wait complete. 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient: build_initial_monmap 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient: monmap: 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 Processor -- start 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 1 -- start start 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.530+0000 7f5c0f9ec640 10 monclient: init 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:57:35.541 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0003b70 0x7f5c08127910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-b con 0x7f5bf0003b70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-a con 0x7f5c08128260 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 0x7f5c08105ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): picked mon.noname-c con 0x7f5c08105a80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0808edc0 con 0x7f5c08128260 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0808ec40 con 0x7f5bf0003b70 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0808ef40 con 0x7f5c08105a80 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient(hunting): authenticate will time out at 868.008405s 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0df62640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 msgr2=0x7f5c08105ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0df62640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 0x7f5c08105ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:45996/0 (socket says 10.20.193.7:45996) 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 -- 10.20.193.7:0/930090956 learned_addr learned my addr 10.20.193.7:0/930090956 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): get_auth_request con 0x7f5c08128260 auth_method 0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0003b70 0x7f5c08127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): get_auth_request con 0x7f5bf0003b70 auth_method 0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient(hunting): handle_auth_done global_id 94185 payload 824 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 -- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 msgr2=0x7f5c08105ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 0x7f5c08105ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 -- 10.20.193.7:0/930090956 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0003b70 msgr2=0x7f5c08127910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0003b70 0x7f5c08127910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient: _finish_hunting 0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 monclient: found mon.noname-a 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 -- 10.20.193.7:0/930090956 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08088b30 con 0x7f5c08128260 2026-02-22T20:57:35.542 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0cf60640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009fd0 tx=0x7f5bfc00b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc016070 con 0x7f5c08128260 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: dump: 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: _finish_auth 0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc0060d0 con 0x7f5c08128260 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc0064c0 con 0x7f5c08128260 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 5 monclient: authenticate success, global_id 94185 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _renew_subs 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c08086620 con 0x7f5c08128260 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf77fe640 4 set_mon_vals no callback set 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 10 monclient: dump: 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _renew_subs 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c08108970 con 0x7f5c08128260 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.543 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0813c240 con 0x7f5c08128260 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5bfc006660 con 0x7f5c08128260 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 --2- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 0x7f5bd805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7f5bfc04de90 con 0x7f5c08128260 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 1 --2- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 0x7f5bd805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 10 monclient: get_auth_request con 0x7f5bd803aa90 auth_method 0 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.534+0000 7f5c0d761640 1 --2- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 0x7f5bd805af40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8002920 tx=0x7f5bf80b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.538+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5bfc004050 con 0x7f5c08128260 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.538+0000 7f5bf5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:35.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.538+0000 7f5bf5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:35.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:57:35.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:35.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:35.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5c0805fc00 con 0x7f5c08128260 2026-02-22T20:57:35.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5bf5ffb640 1 -- 10.20.193.7:0/930090956 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f5bfc04cc80 con 0x7f5c08128260 2026-02-22T20:57:35.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5bf5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:35.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5bf5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:35.658 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:57:35.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 msgr2=0x7f5bd805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 0x7f5bd805af40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8002920 tx=0x7f5bf80b1040 comp rx=0 tx=0).stop 2026-02-22T20:57:35.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 10 monclient: shutdown 2026-02-22T20:57:35.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:35.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 msgr2=0x7f5c0817d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009fd0 tx=0x7f5bfc00b9b0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 shutdown_connections 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5c08105a80 0x7f5c08105ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5c08128260 0x7f5c0817d410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5bd803aa90 0x7f5bd805af40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 --2- 10.20.193.7:0/930090956 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5bf0003b70 0x7f5c08127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 >> 10.20.193.7:0/930090956 conn(0x7f5c0808f860 msgr2=0x7f5c08089d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 shutdown_connections 2026-02-22T20:57:35.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:35.654+0000 7f5c0f9ec640 1 -- 10.20.193.7:0/930090956 wait complete. 2026-02-22T20:57:36.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:36.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:38.669 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: get_monmap_and_config 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: build_initial_monmap 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: monmap: 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:38.734918+0000 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:38.734918+0000 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:38.735 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 1 Processor -- start 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 1 -- start start 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: init 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.730+0000 7f52c4cf5640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f52c013be70 0x7f52c013c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f52c013be70 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52c013c780 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52c019e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-b con 0x7f52c01392d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c00875d0 con 0x7f52c013c780 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f52c00878b0 con 0x7f52c013be70 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f52c008b780 con 0x7f52c01392d0 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): authenticate will time out at 871.208100s 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bed76640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 msgr2=0x7f52c019e430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bed76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52c019e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f52c013c780 0x7f52c0138bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:44826/0 (socket says 10.20.193.7:44826) 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 -- 10.20.193.7:0/3615073858 learned_addr learned my addr 10.20.193.7:0/3615073858 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 1 --2- 10.20.193.7:0/3615073858 >> v2:10.20.193.61:3300/0 conn(0x7f52c013be70 0x7f52c013c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 10 monclient(hunting): get_auth_request con 0x7f52c013be70 auth_method 0 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:38.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210320799 0 0) 0x7f52c00875d0 con 0x7f52c013c780 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): _negotiate 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): my global_id is 94188 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ac003620 con 0x7f52c013c780 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4069806229 0 0) 0x7f52ac003620 con 0x7f52c013c780 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 msgr2=0x7f52c019e430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52c019e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 >> v2:10.20.193.61:3300/0 conn(0x7f52c013be70 msgr2=0x7f52c013c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 --2- 10.20.193.7:0/3615073858 >> v2:10.20.193.61:3300/0 conn(0x7f52c013be70 0x7f52c013c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _finish_hunting 0 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00872f0 con 0x7f52c013c780 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _finish_auth 0 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _check_auth_tickets 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f52a8002e60 con 0x7f52c013c780 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 5 monclient: authenticate success, global_id 94188 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 1 --2- 10.20.193.7:0/3615073858 >> v2:10.20.193.61:3300/0 conn(0x7f52c013be70 0x7f52c013c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: dump: 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:38.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 >> v1:10.20.193.7:6789/0 conn(0x7f52c013c780 legacy=0x7f52c0138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52ac003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): picked mon.c con 0x7f52c01392d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52ac004260 0x7f52ac0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): picked mon.a con 0x7f52ac004260 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52ac005010 0x7f52ac065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): picked mon.b con 0x7f52ac005010 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52c008b780 con 0x7f52ac004260 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac065fd0 con 0x7f52ac005010 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f52ac066150 con 0x7f52c01392d0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 1 -- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 msgr2=0x7f52ac003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52be575640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52ac003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52ac004260 0x7f52ac0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): get_auth_request con 0x7f52ac004260 auth_method 0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient(hunting): handle_auth_done global_id 94188 payload 293 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 -- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 msgr2=0x7f52ac003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01392d0 0x7f52ac003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 -- 10.20.193.7:0/3615073858 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52ac005010 msgr2=0x7f52ac065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52ac005010 0x7f52ac065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient: _finish_hunting 0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 monclient: found mon.a 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 -- 10.20.193.7:0/3615073858 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac003620 con 0x7f52ac004260 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient: _finish_auth 0 2026-02-22T20:57:38.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 10 monclient: _check_auth_tickets 2026-02-22T20:57:38.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bdd74640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52ac004260 0x7f52ac0048d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c190 tx=0x7f52a801eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0251b33e7b3837 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8007d00 con 0x7f52ac004260 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: dump: 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.741 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a80ab020 con 0x7f52ac004260 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 1 -- 10.20.193.7:0/3615073858 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80a7d80 con 0x7f52ac004260 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 4 set_mon_vals no callback set 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bd573640 10 monclient: dump: 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: shutdown 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52ac004260 msgr2=0x7f52ac0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3615073858 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52ac004260 0x7f52ac0048d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c190 tx=0x7f52a801eeb0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52bed76640 1 -- 10.20.193.7:0/3615073858 reap_dead start 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3615073858 shutdown_connections 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3615073858 >> 10.20.193.7:0/3615073858 conn(0x7f52c008f860 msgr2=0x7f52c008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3615073858 shutdown_connections 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3615073858 wait complete. 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: build_initial_monmap 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: monmap: 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:38.742 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 Processor -- start 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- start start 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: init 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52c0151790 0x7f52c0151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-b con 0x7f52c0151790 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 0x7f52c012afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-c con 0x7f52c01520a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): picked mon.noname-a con 0x7f52c012b510 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52c008ebb0 con 0x7f52c012b510 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f52c008ea30 con 0x7f52c0151790 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f52c008ed30 con 0x7f52c01520a0 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.734+0000 7f52c4cf5640 10 monclient(hunting): authenticate will time out at 871.211992s 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bdd74640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 msgr2=0x7f52c012afd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bdd74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 0x7f52c012afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:43782/0 (socket says 10.20.193.7:43782) 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 -- 10.20.193.7:0/3994909684 learned_addr learned my addr 10.20.193.7:0/3994909684 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): get_auth_request con 0x7f52c012b510 auth_method 0 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52c0151790 0x7f52c0151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:38.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 10 monclient(hunting): get_auth_request con 0x7f52c0151790 auth_method 0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient(hunting): handle_auth_done global_id 94191 payload 824 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 -- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 msgr2=0x7f52c012afd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 0x7f52c012afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 -- 10.20.193.7:0/3994909684 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52c0151790 msgr2=0x7f52c0151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52c0151790 0x7f52c0151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient: _finish_hunting 0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 monclient: found mon.noname-a 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 -- 10.20.193.7:0/3994909684 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c012c8e0 con 0x7f52c012b510 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bed76640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c013cf30 tx=0x7f52b000bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b000c830 con 0x7f52c012b510 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: dump: 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: _finish_auth 0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b0010070 con 0x7f52c012b510 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 5 monclient: authenticate success, global_id 94191 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _renew_subs 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c0086620 con 0x7f52c012b510 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:38.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b000cc10 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52bcd72640 4 set_mon_vals no callback set 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: dump: 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _renew_subs 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c012f620 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c00382a0 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f52b001d030 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 --2- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 0x7f528c05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(173..173 src has 64..173) ==== 3897+0+0 (secure 0 0 0) 0x7f52b004e100 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 1 --2- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 0x7f528c05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 10 monclient: get_auth_request con 0x7f528c03aa90 auth_method 0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52be575640 1 --2- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 0x7f528c05af40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f52b4004780 tx=0x7f52b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f52b004ceb0 con 0x7f52c012b510 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:38.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.738+0000 7f52a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52c005fc00 con 0x7f52c012b510 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52a6ffd640 1 -- 10.20.193.7:0/3994909684 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f52b001cd70 con 0x7f52c012b510 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52a6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:38.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:38.854 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 msgr2=0x7f528c05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 0x7f528c05af40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f52b4004780 tx=0x7f52b4008040 comp rx=0 tx=0).stop 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 10 monclient: shutdown 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 msgr2=0x7f52c012b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c013cf30 tx=0x7f52b000bb00 comp rx=0 tx=0).stop 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 shutdown_connections 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f52c012b510 0x7f52c012b990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f52c01520a0 0x7f52c012afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> v2:10.20.193.61:6800/2336688312 conn(0x7f528c03aa90 0x7f528c05af40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 --2- 10.20.193.7:0/3994909684 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f52c0151790 0x7f52c0151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:38.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 >> 10.20.193.7:0/3994909684 conn(0x7f52c008f860 msgr2=0x7f52c00573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:38.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 shutdown_connections 2026-02-22T20:57:38.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:38.850+0000 7f52c4cf5640 1 -- 10.20.193.7:0/3994909684 wait complete. 2026-02-22T20:57:41.864 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: get_monmap_and_config 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: build_initial_monmap 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: monmap: 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:41.937290+0000 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:41.937290+0000 2026-02-22T20:57:41.937 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:41.938 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 Processor -- start 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 -- start start 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: init 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient: _add_conns ranks=[0,1,2,3,4] 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f338413f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f338413fd70 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-b con 0x7f3384181ee0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338408fd70 con 0x7f338413f290 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3384092bc0 con 0x7f338413fd70 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f338408e1f0 con 0x7f3384181ee0 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f33889ac640 10 monclient(hunting): authenticate will time out at 874.410590s 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f3382d76640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 msgr2=0x7f33841a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f3382d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f3382575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f338413f290 0x7f338413f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:44832/0 (socket says 10.20.193.7:44832) 2026-02-22T20:57:41.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:41.934+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 learned_addr learned my addr 10.20.193.7:0/4090117381 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:41.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:41.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:42.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:42.138+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 msgr2=0x7f33841a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:42.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:42.138+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:42.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:42.542+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 msgr2=0x7f33841a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:42.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:42.542+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:43.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:43.346+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 msgr2=0x7f33841a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:43.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:43.346+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:44.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): tick 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 monclient(hunting): continuing hunt 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 msgr2=0x7f33841a22c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3384181ee0 0x7f33841a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 >> v1:10.20.193.61:6789/0 conn(0x7f338413fd70 legacy=0x7f33841807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 >> v1:10.20.193.7:6789/0 conn(0x7f338413f290 legacy=0x7f338413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:44.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient: _add_conns ranks=[3,4] 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f3360003810 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f3360024350 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f338408e1f0 con 0x7f3360003810 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f3360044ea0 con 0x7f3360024350 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f336bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:44.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3360003810 auth_method 0 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360024350 auth_method 0 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:44.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:44.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:44.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:44.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:44.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:44.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:45.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:45.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3360003810 auth_method 0 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:45.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360024350 auth_method 0 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:45.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:45.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:45.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360024350 auth_method 0 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3360003810 auth_method 0 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:45.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:45.542+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:46.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3360003810 auth_method 0 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:46.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:46.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:46.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360024350 auth_method 0 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:46.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:46.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:46.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:46.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:47.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): tick 2026-02-22T20:57:47.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 monclient(hunting): continuing hunt 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 msgr2=0x7f3360044800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360024350 0x7f3360044800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 msgr2=0x7f3360023c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:47.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360003810 0x7f3360023c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 reap_dead start 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient: _add_conns ranks=[1,3,4,2,0] 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f33600247d0 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f3360005300 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:47.944 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f3360005c90 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338408e6d0 con 0x7f33600247d0 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f338408e1f0 con 0x7f3360005300 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:47.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 1 -- 10.20.193.7:0/4090117381 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f3360044ea0 con 0x7f3360005c90 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f336bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360005300 auth_method 0 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:47.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 10 monclient(hunting): get_auth_request con 0x7f3360005c90 auth_method 0 2026-02-22T20:57:47.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:47.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:47.934+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:48.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360005300 auth_method 0 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:48.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 10 monclient(hunting): get_auth_request con 0x7f3360005c90 auth_method 0 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:48.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.138+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:57:48.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360005300 auth_method 0 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 10 monclient(hunting): get_auth_request con 0x7f3360005c90 auth_method 0 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:48.546 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:48.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:48.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:48.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:48.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:48.547 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:48.542+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:57:49.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 10 monclient(hunting): get_auth_request con 0x7f3360005300 auth_method 0 2026-02-22T20:57:49.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 10 monclient(hunting): get_auth_request con 0x7f3360005c90 auth_method 0 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:57:49.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:57:49.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:57:49.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.346+0000 7f3382d76640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:57:49.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481949330 0 0) 0x7f338408e6d0 con 0x7f33600247d0 2026-02-22T20:57:49.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): _negotiate 2026-02-22T20:57:49.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): my global_id is 74596 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3370003620 con 0x7f33600247d0 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219046023 0 0) 0x7f3370003620 con 0x7f33600247d0 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 msgr2=0x7f33600060e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.61:3300/0 conn(0x7f3360005c90 0x7f33600060e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 msgr2=0x7f3360005750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:49.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 --2- 10.20.193.7:0/4090117381 >> v2:10.20.193.7:3300/0 conn(0x7f3360005300 0x7f3360005750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _finish_hunting 0 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 monclient: found mon.noname-c-legacy 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.61:6789/0 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 --> v1:10.20.193.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600078b0 con 0x7f33600247d0 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _finish_auth 0 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _check_auth_tickets 2026-02-22T20:57:49.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f33889ac640 5 monclient: authenticate success, global_id 74596 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f33889ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v1:10.20.193.61:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f3378002d80 con 0x7f33600247d0 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: dump: 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:49.860 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:49.861 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] but i'm connected to v1:10.20.193.61:6789/0, reconnecting 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 >> v1:10.20.193.61:6789/0 conn(0x7f33600247d0 legacy=0x7f3360003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3370003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): picked mon.b con 0x7f3370003b20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:49.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f33700048d0 0x7f3370004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): picked mon.c con 0x7f33700048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3370005280 0x7f3370065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): picked mon.a con 0x7f3370005280 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f338408e1f0 con 0x7f3370005280 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3360044ea0 con 0x7f3370003b20 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f3370066210 con 0x7f33700048d0 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381573640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f33889ac640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381d74640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f33700048d0 msgr2=0x7f3370004d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3381d74640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f33700048d0 0x7f3370004d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3370003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3370003b20 auth_method 0 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient(hunting): handle_auth_done global_id 74596 payload 293 2026-02-22T20:57:49.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f33700048d0 msgr2=0x7f3370004d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f33700048d0 0x7f3370004d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3370005280 msgr2=0x7f3370065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3370005280 0x7f3370065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient: _finish_hunting 0 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 monclient: found mon.b 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 1 -- 10.20.193.7:0/4090117381 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3370003620 con 0x7f3370003b20 2026-02-22T20:57:49.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient: _finish_auth 0 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 10 monclient: _check_auth_tickets 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.842+0000 7f3382d76640 1 -- 10.20.193.7:0/4090117381 reap_dead start 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3370003f30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3378007c70 tx=0x7f337801d5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0903805765e1674 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33780b3070 con 0x7f3370003b20 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:49.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: dump: 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:49.868 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33780ae410 con 0x7f3370003b20 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 1 -- 10.20.193.7:0/4090117381 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378005dd0 con 0x7f3370003b20 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:49.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381573640 10 monclient: dump: 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:49.870 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 4 set_mon_vals no callback set 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: shutdown 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:49.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 msgr2=0x7f3370003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3370003f30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3378007c70 tx=0x7f337801d5f0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- 10.20.193.7:0/4090117381 shutdown_connections 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 --2- 10.20.193.7:0/4090117381 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3370003f30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- 10.20.193.7:0/4090117381 >> 10.20.193.7:0/4090117381 conn(0x7f3384093df0 msgr2=0x7f33840902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- 10.20.193.7:0/4090117381 shutdown_connections 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- 10.20.193.7:0/4090117381 wait complete. 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: build_initial_monmap 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: monmap: 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:49.872 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 Processor -- start 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- start start 2026-02-22T20:57:49.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: init 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3384152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-b con 0x7f3370003b20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 0x7f338413b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-c con 0x7f338413b040 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): picked mon.noname-a con 0x7f3384129e50 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f338413c900 con 0x7f3384129e50 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.874 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f338413c780 con 0x7f3370003b20 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f338413ca80 con 0x7f338413b040 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f33889ac640 10 monclient(hunting): authenticate will time out at 882.323391s 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381d74640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 msgr2=0x7f338413b4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3381d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 0x7f338413b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:47264/0 (socket says 10.20.193.7:47264) 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 -- 10.20.193.7:0/374417928 learned_addr learned my addr 10.20.193.7:0/374417928 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): get_auth_request con 0x7f3384129e50 auth_method 0 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:49.875 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3384152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): get_auth_request con 0x7f3370003b20 auth_method 0 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:49.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient(hunting): handle_auth_done global_id 94194 payload 824 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 -- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 msgr2=0x7f338413b4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 0x7f338413b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 -- 10.20.193.7:0/374417928 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 msgr2=0x7f3384152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3384152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient: _finish_hunting 0 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 monclient: found mon.noname-a 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 -- 10.20.193.7:0/374417928 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338412b6f0 con 0x7f3384129e50 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f3382d76640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3374002a30 tx=0x7f337400dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337400a810 con 0x7f3384129e50 2026-02-22T20:57:49.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f336affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f336affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.846+0000 7f336affd640 10 monclient: dump: 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:49.878 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: _finish_auth 0 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: _check_auth_tickets 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337400a9b0 con 0x7f3384129e50 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337400ada0 con 0x7f3384129e50 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f3380d72640 4 set_mon_vals no callback set 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 10 monclient: dump: 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:49.879 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 5 monclient: authenticate success, global_id 94194 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _renew_subs 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338413eed0 con 0x7f3384129e50 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _renew_subs 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:49.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338412da50 con 0x7f3384129e50 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33841427b0 con 0x7f3384129e50 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f3374009040 con 0x7f3384129e50 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 1 --2- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 0x7f335005af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(174..174 src has 64..174) ==== 3897+0+0 (secure 0 0 0) 0x7f337404f310 con 0x7f3384129e50 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f3382575640 1 --2- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 0x7f335005af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f3382575640 10 monclient: get_auth_request con 0x7f335003aa90 auth_method 0 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.850+0000 7f3382575640 1 --2- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 0x7f335005af40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3378002410 tx=0x7f33780029a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.854+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f3374026120 con 0x7f3384129e50 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.854+0000 7f336affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:49.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.854+0000 7f336affd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: starting. 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: creating pool ceph_test_rados_delete_pools_parallel.trial061-20914 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: created object 0... 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: created object 25... 2026-02-22T20:57:49.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: created object 49... 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: finishing. 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[20952]: shutting down. 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: starting. 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: listing objects. 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: listed object 0... 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: listed object 25... 2026-02-22T20:57:49.883 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: saw 50 objects 2026-02-22T20:57:49.884 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[20954]: shutting down. 2026-02-22T20:57:49.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:57:49.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f338412d210 con 0x7f3384129e50 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f336affd640 1 -- 10.20.193.7:0/374417928 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7f3374026370 con 0x7f3384129e50 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f336affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f336affd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:49.969 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":52,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:57:49.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 msgr2=0x7f335005af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:49.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 0x7f335005af40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3378002410 tx=0x7f33780029a0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 10 monclient: shutdown 2026-02-22T20:57:49.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:49.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 msgr2=0x7f338412a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3374002a30 tx=0x7f337400dad0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 shutdown_connections 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f3384129e50 0x7f338412a2d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f338413b040 0x7f338413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> v2:10.20.193.61:6800/2336688312 conn(0x7f335003aa90 0x7f335005af40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 --2- 10.20.193.7:0/374417928 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3370003b20 0x7f3384152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 >> 10.20.193.7:0/374417928 conn(0x7f3384093df0 msgr2=0x7f3384055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 shutdown_connections 2026-02-22T20:57:49.971 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:49.966+0000 7f33889ac640 1 -- 10.20.193.7:0/374417928 wait complete. 2026-02-22T20:57:49.980 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:57:49.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:57:49.980 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:57:50.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.038+0000 7f840fd7f640 10 monclient: get_monmap_and_config 2026-02-22T20:57:50.044 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.038+0000 7f840fd7f640 10 monclient: build_initial_monmap 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.038+0000 7f840fd7f640 10 monclient: monmap: 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:50.043705+0000 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:50.043705+0000 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:50.045 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:50.046 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 Processor -- start 2026-02-22T20:57:50.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 -- start start 2026-02-22T20:57:50.046 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient: init 2026-02-22T20:57:50.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:50.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient: _add_conns ranks=[1,2,4,0,3] 2026-02-22T20:57:50.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f840813f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-b con 0x7f840813fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f8408180d00 0x7f84081a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-c con 0x7f8408180d00 addr v2:10.20.193.61:3300/0 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840808fd70 con 0x7f840813f290 2026-02-22T20:57:50.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f840808e1f0 con 0x7f8408180d00 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f840808ec90 con 0x7f840813fd70 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient(hunting): authenticate will time out at 882.517007s 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840d2f3640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 msgr2=0x7f84081807c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840d2f3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:50.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f8408180d00 0x7f84081a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840daf4640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f840813f290 0x7f840813f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:39590/0 (socket says 10.20.193.7:39590) 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840daf4640 1 -- 10.20.193.7:0/4148977237 learned_addr learned my addr 10.20.193.7:0/4148977237 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): get_auth_request con 0x7f8408180d00 auth_method 0 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient(hunting): handle_auth_done global_id 74602 payload 274 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 -- 10.20.193.7:0/4148977237 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 msgr2=0x7f84081807c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:50.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 --2- 10.20.193.7:0/4148977237 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 -- 10.20.193.7:0/4148977237 >> v1:10.20.193.61:6789/0 conn(0x7f840813f290 legacy=0x7f840813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient: _finish_hunting 0 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 monclient: found mon.noname-c 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 -- 10.20.193.7:0/4148977237 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8408092bc0 con 0x7f8408180d00 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840e2f5640 1 --2- 10.20.193.7:0/4148977237 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8408180d00 0x7f84081a10e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f840808e370 tx=0x7f840401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb4d2eff2389b35 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 1 -- 10.20.193.7:0/4148977237 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040b2070 con 0x7f8408180d00 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: dump: 2026-02-22T20:57:50.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: _finish_auth 0 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: _check_auth_tickets 2026-02-22T20:57:50.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 1 -- 10.20.193.7:0/4148977237 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84040a58c0 con 0x7f8408180d00 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 5 monclient: authenticate success, global_id 74602 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 1 -- 10.20.193.7:0/4148977237 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040a5cb0 con 0x7f8408180d00 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840fd7f640 4 set_mon_vals no callback set 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.042+0000 7f840caf2640 10 monclient: dump: 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.063 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: shutdown 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:50.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/4148977237 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8408180d00 msgr2=0x7f84081a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- 10.20.193.7:0/4148977237 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8408180d00 0x7f84081a10e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f840808e370 tx=0x7f840401c800 comp rx=0 tx=0).stop 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/4148977237 shutdown_connections 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- 10.20.193.7:0/4148977237 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8408180d00 0x7f84081a10e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- 10.20.193.7:0/4148977237 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/4148977237 >> 10.20.193.7:0/4148977237 conn(0x7f8408093df0 msgr2=0x7f84080902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/4148977237 shutdown_connections 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/4148977237 wait complete. 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: build_initial_monmap 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: monmap: 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:50.065 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 Processor -- start 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- start start 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: init 2026-02-22T20:57:50.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813f290 0x7f84081893b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-c con 0x7f840813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-b con 0x7f840813fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 0x7f84081898f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): picked mon.noname-a con 0x7f8408180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84081a4050 con 0x7f8408180d00 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8408090dd0 con 0x7f840813fd70 2026-02-22T20:57:50.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f84081a41d0 con 0x7f840813f290 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): authenticate will time out at 882.521125s 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813f290 msgr2=0x7f84081893b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813f290 0x7f84081893b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 0x7f84081898f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 0x7f84081898f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:47274/0 (socket says 10.20.193.7:47274) 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 learned_addr learned my addr 10.20.193.7:0/3545401711 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): get_auth_request con 0x7f8408180d00 auth_method 0 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 10 monclient(hunting): get_auth_request con 0x7f840813fd70 auth_method 0 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient(hunting): handle_auth_done global_id 94197 payload 824 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813f290 msgr2=0x7f84081893b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f840813f290 0x7f84081893b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f840813fd70 msgr2=0x7f84081807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f840813fd70 0x7f84081807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient: _finish_hunting 0 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 monclient: found mon.noname-a 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840819dc90 con 0x7f8408180d00 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840e2f5640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 0x7f84081898f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f840401cd70 tx=0x7f84040195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040bb070 con 0x7f8408180d00 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: dump: 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.071 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: _finish_auth 0 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84040a6d00 con 0x7f8408180d00 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 5 monclient: authenticate success, global_id 94197 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _renew_subs 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840819df70 con 0x7f8408180d00 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040b2040 con 0x7f8408180d00 2026-02-22T20:57:50.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: dump: 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f7fff640 4 set_mon_vals no callback set 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _renew_subs 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84080575b0 con 0x7f8408180d00 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 0x7f8408088ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f840813d310 con 0x7f84080886e0 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 0x7f8408088ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient: get_auth_request con 0x7f84080886e0 auth_method 0 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f84040c7060 con 0x7f8408180d00 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 10 monclient(hunting): handle_auth_done global_id 94200 payload 824 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f840813f660 con 0x7f84080886e0 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840daf4640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 0x7f8408088ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83f8004970 tx=0x7f83f800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 --2- 10.20.193.7:0/3545401711 >> v2:10.20.193.61:6800/2336688312 conn(0x7f83d803aa90 0x7f83d805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(174..174 src has 64..174) ==== 3897+0+0 (secure 0 0 0) 0x7f84040e8f80 con 0x7f8408180d00 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8017070 con 0x7f84080886e0 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:50.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: dump: 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f83f800ce50 con 0x7f84080886e0 2026-02-22T20:57:50.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 msgr2=0x7f8408088ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 0x7f8408088ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83f8004970 tx=0x7f83f800cb10 comp rx=0 tx=0).stop 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 msgr2=0x7f8408088ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f83f67fc640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f84080886e0 0x7f8408088ab0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83f8004970 tx=0x7f83f800cb10 comp rx=0 tx=0).stop 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 1 --2- 10.20.193.7:0/3545401711 >> v2:10.20.193.61:6800/2336688312 conn(0x7f83d803aa90 0x7f83d805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 10 monclient: get_auth_request con 0x7f83d803aa90 auth_method 0 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.046+0000 7f840d2f3640 1 --2- 10.20.193.7:0/3545401711 >> v2:10.20.193.61:6800/2336688312 conn(0x7f83d803aa90 0x7f83d805af40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f840808dbd0 tx=0x7f83fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 0x7f840819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84081a0db0 con 0x7f8408088ff0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 0x7f840819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient: get_auth_request con 0x7f8408088ff0 auth_method 0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 10 monclient(hunting): handle_auth_done global_id 94203 payload 824 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 1 -- 10.20.193.7:0/3545401711 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f840805fb50 con 0x7f8408088ff0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840daf4640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 0x7f840819a470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a450 tx=0x7f83f80023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8017070 con 0x7f8408088ff0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 10 monclient: dump: 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f83f8018040 con 0x7f8408088ff0 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:50.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 msgr2=0x7f840819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 0x7f840819a470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a450 tx=0x7f83f80023d0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 msgr2=0x7f840819a470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f83f67fc640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408088ff0 0x7f840819a470 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a450 tx=0x7f83f80023d0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:50.080 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 52, 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 42735, 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.081 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:50.082 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.083 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:50.084 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.085 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.086 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.087 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.088 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.089 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.090 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:50.091 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:50.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 >> v2:10.20.193.61:6800/2336688312 conn(0x7f83d803aa90 msgr2=0x7f83d805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 --2- 10.20.193.7:0/3545401711 >> v2:10.20.193.61:6800/2336688312 conn(0x7f83d803aa90 0x7f83d805af40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f840808dbd0 tx=0x7f83fc008040 comp rx=0 tx=0).stop 2026-02-22T20:57:50.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 10 monclient: shutdown 2026-02-22T20:57:50.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 msgr2=0x7f84081898f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 --2- 10.20.193.7:0/3545401711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8408180d00 0x7f84081898f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f840401cd70 tx=0x7f84040195a0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 reap_dead start 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840e2f5640 1 -- 10.20.193.7:0/3545401711 reap_dead start 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 shutdown_connections 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 >> 10.20.193.7:0/3545401711 conn(0x7f8408093df0 msgr2=0x7f8408055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 shutdown_connections 2026-02-22T20:57:50.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.050+0000 7f840fd7f640 1 -- 10.20.193.7:0/3545401711 wait complete. 2026-02-22T20:57:50.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:57:50.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T20:57:50.094 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:57:50.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: get_monmap_and_config 2026-02-22T20:57:50.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: build_initial_monmap 2026-02-22T20:57:50.163 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: monmap: 2026-02-22T20:57:50.163 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:50.163 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:57:50.154162+0000 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:57:50.154162+0000 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 Processor -- start 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 -- start start 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: init 2026-02-22T20:57:50.164 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 0x7fbf7805d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-b con 0x7fbf7805d1c0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf7808e3b0 0x7fbf7808e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-a con 0x7fbf7808e3b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbf7808ed00 addr v1:10.20.193.61:6789/0 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7813fbd0 con 0x7fbf7808ed00 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7808a6d0 con 0x7fbf7808e3b0 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7808b770 con 0x7fbf7805d1c0 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7f9e3640 10 monclient(hunting): authenticate will time out at 882.627040s 2026-02-22T20:57:50.165 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7d758640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 msgr2=0x7fbf7805d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7d758640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 0x7fbf7805d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf7808e3b0 0x7fbf7808e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf7808e3b0 0x7fbf7808e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:47298/0 (socket says 10.20.193.7:47298) 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 -- 10.20.193.7:0/2894167093 learned_addr learned my addr 10.20.193.7:0/2894167093 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): get_auth_request con 0x7fbf7808e3b0 auth_method 0 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_done global_id 94206 payload 274 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 -- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 msgr2=0x7fbf7805d590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:57:50.166 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 0x7fbf7805d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 -- 10.20.193.7:0/2894167093 >> v1:10.20.193.61:6789/0 conn(0x7fbf7808ed00 legacy=0x7fbf781a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient: _finish_hunting 0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 monclient: found mon.noname-a 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.150+0000 7fbf7cf57640 1 -- 10.20.193.7:0/2894167093 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7808ba50 con 0x7fbf7808e3b0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7808e3b0 0x7fbf7808e7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0090a0 tx=0x7fbf6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31310895cf91f31e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 1 -- 10.20.193.7:0/2894167093 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0ab430 con 0x7fbf7808e3b0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: dump: 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.167 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: _finish_auth 0 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: _check_auth_tickets 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 1 -- 10.20.193.7:0/2894167093 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c0b0070 con 0x7fbf7808e3b0 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 1 -- 10.20.193.7:0/2894167093 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0ab7f0 con 0x7fbf7808e3b0 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:50.168 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf67fff640 10 monclient: dump: 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 5 monclient: authenticate success, global_id 94206 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: get_monmap_and_config success 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 4 set_mon_vals no callback set 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: shutdown 2026-02-22T20:57:50.169 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7808e3b0 msgr2=0x7fbf7808e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7808e3b0 0x7fbf7808e7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0090a0 tx=0x7fbf6c01c520 comp rx=0 tx=0).stop 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/2894167093 shutdown_connections 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7808e3b0 0x7fbf7808e7c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/2894167093 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7805d1c0 0x7fbf7805d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/2894167093 >> 10.20.193.7:0/2894167093 conn(0x7fbf7808faa0 msgr2=0x7fbf7808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/2894167093 shutdown_connections 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/2894167093 wait complete. 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: build_initial_monmap 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: monmap: 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:57:50.170 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 Processor -- start 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- start start 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: init 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _reopen_session rank -1 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 0x7fbf781506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-a con 0x7fbf7805d1c0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7808e3b0 0x7fbf78150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-c con 0x7fbf7808e3b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf7808ed00 0x7fbf781276c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): picked mon.noname-b con 0x7fbf7808ed00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7808a910 con 0x7fbf7805d1c0 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbf781a4560 con 0x7fbf7808ed00 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7813e760 con 0x7fbf7808e3b0 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): _renew_subs 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient(hunting): authenticate will time out at 882.631083s 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7cf57640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7808e3b0 msgr2=0x7fbf78150c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 0x7fbf781506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7cf57640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7808e3b0 0x7fbf78150c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 0x7fbf781506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:47306/0 (socket says 10.20.193.7:47306) 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 -- 10.20.193.7:0/1080808001 learned_addr learned my addr 10.20.193.7:0/1080808001 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): get_auth_request con 0x7fbf7805d1c0 auth_method 0 2026-02-22T20:57:50.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7df59640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf7808ed00 0x7fbf781276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient(hunting): handle_auth_done global_id 94209 payload 824 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7808e3b0 msgr2=0x7fbf78150c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf7808e3b0 0x7fbf78150c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf7808ed00 msgr2=0x7fbf781276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf7808ed00 0x7fbf781276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient: _finish_hunting 0 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 monclient: found mon.noname-a 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7812bec0 con 0x7fbf7805d1c0 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7d758640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 0x7fbf781506e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800b750 tx=0x7fbf6800bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68005070 con 0x7fbf7805d1c0 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: dump: 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: _finish_auth 0 2026-02-22T20:57:50.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68010070 con 0x7fbf7805d1c0 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 5 monclient: authenticate success, global_id 94209 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _renew_subs 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68005410 con 0x7fbf7805d1c0 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7812b200 con 0x7fbf7805d1c0 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf677fe640 4 set_mon_vals no callback set 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf65ffb640 10 monclient: dump: 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.175 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _renew_subs 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf78129180 con 0x7fbf7805d1c0 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.154+0000 7fbf7f9e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 0x7fbf78128000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7812ae80 con 0x7fbf78127c00 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 0x7fbf78128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient: get_auth_request con 0x7fbf78127c00 auth_method 0 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbf6801d030 con 0x7fbf7805d1c0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 --2- 10.20.193.7:0/1080808001 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf4803aa90 0x7fbf4805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(174..174 src has 64..174) ==== 3897+0+0 (secure 0 0 0) 0x7fbf6804de80 con 0x7fbf7805d1c0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_done global_id 74611 payload 824 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf780382a0 con 0x7fbf78127c00 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7df59640 1 --2- 10.20.193.7:0/1080808001 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf4803aa90 0x7fbf4805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7df59640 10 monclient: get_auth_request con 0x7fbf4803aa90 auth_method 0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 0x7fbf78128000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf78139d10 tx=0x7fbf6c0192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0abe20 con 0x7fbf78127c00 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:50.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 10 monclient: dump: 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fbf6c0b0040 con 0x7fbf78127c00 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 msgr2=0x7fbf78128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 0x7fbf78128000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf78139d10 tx=0x7fbf6c0192c0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 msgr2=0x7fbf78128000 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:50.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf65ffb640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78127c00 0x7fbf78128000 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf78139d10 tx=0x7fbf6c0192c0 comp rx=0 tx=0).stop 2026-02-22T20:57:50.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.158+0000 7fbf7df59640 1 --2- 10.20.193.7:0/1080808001 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf4803aa90 0x7fbf4805af40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf78139730 tx=0x7fbf74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:57:50.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 0x7fbf780868a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:57:50.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 10 monclient(hunting): start opening mon connection 2026-02-22T20:57:50.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7812b440 con 0x7fbf78128540 2026-02-22T20:57:50.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 0x7fbf780868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient: get_auth_request con 0x7fbf78128540 auth_method 0 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 10 monclient(hunting): handle_auth_done global_id 74614 payload 824 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 1 -- 10.20.193.7:0/1080808001 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf7805d590 con 0x7fbf78128540 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7cf57640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 0x7fbf780868a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0ad040 tx=0x7fbf6c009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0c1be0 con 0x7fbf78128540 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 10 monclient: dump: 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:57:50.181 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5037 (secure 0 0 0) 0x7fbf6c0c1be0 con 0x7fbf78128540 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 msgr2=0x7fbf780868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 0x7fbf780868a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0ad040 tx=0x7fbf6c009300 comp rx=0 tx=0).stop 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 msgr2=0x7fbf780868a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf65ffb640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf78128540 0x7fbf780868a0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0ad040 tx=0x7fbf6c009300 comp rx=0 tx=0).stop 2026-02-22T20:57:50.182 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 52, 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 137553, 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.183 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.184 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:57:50.185 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:57:50.186 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.187 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.188 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:57:50.189 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.190 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:57:50.191 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf4803aa90 msgr2=0x7fbf4805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/1080808001 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbf4803aa90 0x7fbf4805af40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf78139730 tx=0x7fbf74009040 comp rx=0 tx=0).stop 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 10 monclient: shutdown 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 msgr2=0x7fbf781506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 --2- 10.20.193.7:0/1080808001 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf7805d1c0 0x7fbf781506e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800b750 tx=0x7fbf6800bc10 comp rx=0 tx=0).stop 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7df59640 1 -- 10.20.193.7:0/1080808001 reap_dead start 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7df59640 1 -- 10.20.193.7:0/1080808001 reap_dead start 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 shutdown_connections 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 >> 10.20.193.7:0/1080808001 conn(0x7fbf7808faa0 msgr2=0x7fbf7813eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:57:50.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 shutdown_connections 2026-02-22T20:57:50.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:57:50.162+0000 7fbf7f9e3640 1 -- 10.20.193.7:0/1080808001 wait complete. 2026-02-22T20:57:50.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:57:50.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:57:50.829 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:50.829 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20953]: starting. 2026-02-22T20:57:50.829 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20953]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-20914 2026-02-22T20:57:50.829 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[20953]: shutting down. 2026-02-22T20:57:50.831 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:50.831 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:50.831 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:57:50.833 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:57:51.959 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:51.960 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:52.886 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: starting. 2026-02-22T20:57:52.886 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21004 2026-02-22T20:57:52.887 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: created object 0... 2026-02-22T20:57:52.887 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: created object 25... 2026-02-22T20:57:52.887 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: created object 49... 2026-02-22T20:57:52.887 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: finishing. 2026-02-22T20:57:52.887 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21005]: shutting down. 2026-02-22T20:57:53.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21006]: starting. 2026-02-22T20:57:53.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21006]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21004 2026-02-22T20:57:53.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21006]: shutting down. 2026-02-22T20:57:55.895 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:55.895 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: starting. 2026-02-22T20:57:55.895 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21004 2026-02-22T20:57:55.896 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: created object 0... 2026-02-22T20:57:55.896 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: created object 25... 2026-02-22T20:57:55.896 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: created object 49... 2026-02-22T20:57:55.896 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: finishing. 2026-02-22T20:57:55.896 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21039]: shutting down. 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: starting. 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: listing objects. 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: listed object 0... 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: listed object 25... 2026-02-22T20:57:55.906 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: saw 50 objects 2026-02-22T20:57:55.907 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21041]: shutting down. 2026-02-22T20:57:56.851 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:56.851 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21040]: starting. 2026-02-22T20:57:56.851 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21040]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21004 2026-02-22T20:57:56.851 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21040]: shutting down. 2026-02-22T20:57:56.852 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:56.852 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:57:56.852 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:57:56.855 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:57:56.960 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:57:56.960 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:57:58.402 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: starting. 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21091 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: created object 0... 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: created object 25... 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: created object 49... 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: finishing. 2026-02-22T20:57:58.403 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21092]: shutting down. 2026-02-22T20:57:59.353 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21093]: starting. 2026-02-22T20:57:59.353 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21093]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21091 2026-02-22T20:57:59.353 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21093]: shutting down. 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: starting. 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21091 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: created object 0... 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: created object 25... 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: created object 49... 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: finishing. 2026-02-22T20:58:01.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21126]: shutting down. 2026-02-22T20:58:01.418 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:01.418 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: starting. 2026-02-22T20:58:01.418 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: listing objects. 2026-02-22T20:58:01.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: listed object 0... 2026-02-22T20:58:01.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: listed object 25... 2026-02-22T20:58:01.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: saw 50 objects 2026-02-22T20:58:01.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21128]: shutting down. 2026-02-22T20:58:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:58:01] 2026-02-22T20:58:01.941 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:58:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:58:01 2026-02-22T20:58:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:58:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.780488 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:58:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Some PGs (0.780488) are unknown; try again later 2026-02-22T20:58:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:58:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:58:01.956 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:58:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:58:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:58:01.957 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:58:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:58:01.959 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:58:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:58:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:58:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:58:01.960 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:58:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:58:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:58:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:58:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:58:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "ceph_test_rados_delete_pools_parallel.trial061-21091": { 2026-02-22T20:58:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": {}, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:57:59.371417+0000", 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:58:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 32769, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,creating", 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "185", 2026-02-22T20:58:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 32, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 32, 2026-02-22T20:58:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 32, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 32, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 32, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 58, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "ceph_test_rados_delete_pools_parallel.trial061-21091", 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:58:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 1.690000057220459, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 1.690000057220459, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 1.690000057220459, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 1.690000057220459, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:58:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:58:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:58:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:58:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:58:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:58:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:58:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:58:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:58:01.982 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1, -1] pools [1, 2, 58] with 6 osds, pg_target 600 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:58:01.983 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'ceph_test_rados_delete_pools_parallel.trial061-21091' root_id -1 using 0.0 of space, bias 1.0, pg target 0.0 quantized to 32 (current 32) 2026-02-22T20:58:02.361 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:02.362 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.362 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:02.362 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21127]: starting. 2026-02-22T20:58:02.362 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21127]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21091 2026-02-22T20:58:02.363 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21127]: shutting down. 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.363 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:02.364 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:02.365 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:02.365 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:02.365 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:02.365 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:58:02.366 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:02.367 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:02.367 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:04.419 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: starting. 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21178 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: created object 0... 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: created object 25... 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: created object 49... 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: finishing. 2026-02-22T20:58:04.420 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21179]: shutting down. 2026-02-22T20:58:05.373 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21180]: starting. 2026-02-22T20:58:05.373 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21180]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21178 2026-02-22T20:58:05.373 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21180]: shutting down. 2026-02-22T20:58:06.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:06.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:07.402 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:07.402 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: starting. 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21178 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: created object 0... 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: created object 25... 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: created object 49... 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: finishing. 2026-02-22T20:58:07.403 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21213]: shutting down. 2026-02-22T20:58:07.413 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: starting. 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: listing objects. 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: listed object 0... 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: listed object 25... 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: saw 50 objects 2026-02-22T20:58:07.414 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21215]: shutting down. 2026-02-22T20:58:08.358 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:08.358 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21214]: starting. 2026-02-22T20:58:08.358 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21214]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21178 2026-02-22T20:58:08.358 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21214]: shutting down. 2026-02-22T20:58:08.361 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:08.361 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:08.361 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:08.363 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:10.194 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-22T20:58:10.194 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T20:58:10.194 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T20:58:10.195 INFO:tasks.ceph.mon.c:Started 2026-02-22T20:58:10.195 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:58:10.195 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: get_monmap_and_config 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: build_initial_monmap 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: monmap: 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:10.254074+0000 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:10.254074+0000 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:10.254 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:10.255 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:10.255 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:10.255 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 Processor -- start 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 -- start start 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: init 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f17fc13f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f17fc13fd70 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f17fc181ee0 0x7f17fc1a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): picked mon.noname-c con 0x7f17fc181ee0 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc0915f0 con 0x7f17fc13fd70 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc08e6a0 con 0x7f17fc13f290 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc08e980 con 0x7f17fc181ee0 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 10 monclient(hunting): authenticate will time out at 902.727185s 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f17fc13fd70 0x7f17fc1807c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39928/0 (socket says 10.20.193.7:39928) 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 1 -- 10.20.193.7:0/3769440113 learned_addr learned my addr 10.20.193.7:0/3769440113 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:10.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 1 --2- 10.20.193.7:0/3769440113 >> v2:10.20.193.61:3300/0 conn(0x7f17fc181ee0 0x7f17fc1a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): get_auth_request con 0x7f17fc181ee0 auth_method 0 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313953696 0 0) 0x7f17fc0915f0 con 0x7f17fc13fd70 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): _negotiate 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): my global_id is 94305 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e4003620 con 0x7f17fc13fd70 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3667483467 0 0) 0x7f17e4003620 con 0x7f17fc13fd70 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 >> v2:10.20.193.61:3300/0 conn(0x7f17fc181ee0 msgr2=0x7f17fc1a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 --2- 10.20.193.7:0/3769440113 >> v2:10.20.193.61:3300/0 conn(0x7f17fc181ee0 0x7f17fc1a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 >> v1:10.20.193.61:6789/0 conn(0x7f17fc13f290 legacy=0x7f17fc13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _finish_hunting 0 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc08ec60 con 0x7f17fc13fd70 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _finish_auth 0 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _check_auth_tickets 2026-02-22T20:58:10.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f17f0002e50 con 0x7f17fc13fd70 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 5 monclient: authenticate success, global_id 94305 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: dump: 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 >> v1:10.20.193.7:6789/0 conn(0x7f17fc13fd70 legacy=0x7f17fc1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 0x7f17e4003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): picked mon.a con 0x7f17e4003b50 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17e40048d0 0x7f17e4004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): picked mon.c con 0x7f17e40048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e40053a0 0x7f17e4065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): picked mon.b con 0x7f17e40053a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc08e980 con 0x7f17e4003b50 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f17e40662d0 con 0x7f17e40053a0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f17e40664d0 con 0x7f17e40048d0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1800df1640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f180407e640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 0x7f17e4003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17e40048d0 0x7f17e4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): get_auth_request con 0x7f17e4003b50 auth_method 0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): get_auth_request con 0x7f17e40048d0 auth_method 0 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:10.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e40053a0 0x7f17e4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient(hunting): handle_auth_done global_id 94305 payload 293 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 -- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17e40048d0 msgr2=0x7f17e4004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17e40048d0 0x7f17e4004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 -- 10.20.193.7:0/3769440113 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e40053a0 msgr2=0x7f17e4065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e40053a0 0x7f17e4065a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient: _finish_hunting 0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 monclient: found mon.a 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 1 -- 10.20.193.7:0/3769440113 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e4003620 con 0x7f17e4003b50 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18025f4640 1 -- 10.20.193.7:0/3769440113 reap_dead start 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient: _finish_auth 0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 10 monclient: _check_auth_tickets 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f1801df3640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.250+0000 7f18015f2640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17e40048d0 0x7f17e4004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 0x7f17e4003f60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17ec003010 tx=0x7f17ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c42d53cbe70edcf server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0b0070 con 0x7f17e4003b50 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: dump: 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec006af0 con 0x7f17e4003b50 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 1 -- 10.20.193.7:0/3769440113 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec002c60 con 0x7f17e4003b50 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 4 set_mon_vals no callback set 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:10.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1800df1640 10 monclient: dump: 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: shutdown 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 msgr2=0x7f17e4003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 0x7f17e4003f60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17ec003010 tx=0x7f17ec01c490 comp rx=0 tx=0).stop 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/3769440113 shutdown_connections 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 --2- 10.20.193.7:0/3769440113 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17e4003b50 0x7f17e4003f60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/3769440113 >> 10.20.193.7:0/3769440113 conn(0x7f17fc0908f0 msgr2=0x7f17fc051980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/3769440113 shutdown_connections 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/3769440113 wait complete. 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: build_initial_monmap 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: monmap: 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:10.263 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 Processor -- start 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- start start 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: init 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e4003b50 0x7f17fc152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): picked mon.noname-b con 0x7f17e4003b50 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): picked mon.noname-a con 0x7f17fc12c0b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): picked mon.noname-c con 0x7f17fc129e50 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc13c900 con 0x7f17fc12c0b0 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc13c780 con 0x7f17e4003b50 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc13ca80 con 0x7f17fc129e50 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient(hunting): authenticate will time out at 902.730772s 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:58934/0 (socket says 10.20.193.7:58934) 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:55772/0 (socket says 10.20.193.7:55772) 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 -- 10.20.193.7:0/993331506 learned_addr learned my addr 10.20.193.7:0/993331506 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:10.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): get_auth_request con 0x7f17fc12c0b0 auth_method 0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 10 monclient(hunting): get_auth_request con 0x7f17fc129e50 auth_method 0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e4003b50 0x7f17fc152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 10 monclient(hunting): get_auth_request con 0x7f17e4003b50 auth_method 0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f1801df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 -- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 msgr2=0x7f17fc12a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 -- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 msgr2=0x7f17fc12a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18025f4640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient(hunting): handle_auth_done global_id 94308 payload 824 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 -- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 msgr2=0x7f17fc12a270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 -- 10.20.193.7:0/993331506 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e4003b50 msgr2=0x7f17fc152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e4003b50 0x7f17fc152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient: _finish_hunting 0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 monclient: found mon.noname-a 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 -- 10.20.193.7:0/993331506 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc12b570 con 0x7f17fc12c0b0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f18015f2640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f17f00026e0 tx=0x7f17f00073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0007d90 con 0x7f17fc12c0b0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: dump: 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:10.266 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: _finish_auth 0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0018070 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0011880 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 5 monclient: authenticate success, global_id 94308 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 10 monclient: dump: 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ebfff640 4 set_mon_vals no callback set 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _renew_subs 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc13eb30 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _renew_subs 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc12d010 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc1427b0 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.254+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f17f0011a20 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f17ea7fc640 1 --2- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 0x7f17cc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(194..194 src has 64..194) ==== 3897+0+0 (secure 0 0 0) 0x7f17f004e5d0 con 0x7f17fc12c0b0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f1801df3640 1 --2- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 0x7f17cc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:10.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f1801df3640 10 monclient: get_auth_request con 0x7f17cc03ab20 auth_method 0 2026-02-22T20:58:10.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f1801df3640 1 --2- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 0x7f17cc05afd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0a5010 tx=0x7f17ec0029a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:10.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f17f0012dd0 con 0x7f17fc12c0b0 2026-02-22T20:58:10.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f17ea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:10.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.258+0000 7f17ea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f17fc0008e0 con 0x7f17fc12c0b0 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f17ea7fc640 1 -- 10.20.193.7:0/993331506 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f17f00090e0 con 0x7f17fc12c0b0 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f17ea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:10.371 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f17ea7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:10.372 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":52,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:10.372 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 msgr2=0x7f17cc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 0x7f17cc05afd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0a5010 tx=0x7f17ec0029a0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 10 monclient: shutdown 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 msgr2=0x7f17fc153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f17f00026e0 tx=0x7f17f00073c0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 shutdown_connections 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f17fc129e50 0x7f17fc12a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f17fc12c0b0 0x7f17fc153260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> v2:10.20.193.61:6800/2336688312 conn(0x7f17cc03ab20 0x7f17cc05afd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 --2- 10.20.193.7:0/993331506 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f17e4003b50 0x7f17fc152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 >> 10.20.193.7:0/993331506 conn(0x7f17fc0908f0 msgr2=0x7f17fc055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 shutdown_connections 2026-02-22T20:58:10.373 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:10.366+0000 7f180407e640 1 -- 10.20.193.7:0/993331506 wait complete. 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: starting. 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21265 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: created object 0... 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: created object 25... 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: created object 49... 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: finishing. 2026-02-22T20:58:10.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21266]: shutting down. 2026-02-22T20:58:11.390 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21267]: starting. 2026-02-22T20:58:11.390 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21267]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21265 2026-02-22T20:58:11.390 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21267]: shutting down. 2026-02-22T20:58:11.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:11.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:13.382 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: get_monmap_and_config 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: build_initial_monmap 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: monmap: 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:13.442934+0000 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:13.442934+0000 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:13.443 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 1 Processor -- start 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 1 -- start start 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: init 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f5db808c060 0x7f5db808c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-c con 0x7f5db808c060 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.438+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-b con 0x7f5db808c970 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5db81803a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db80910e0 con 0x7f5db81803a0 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f5db8091360 con 0x7f5db808c060 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5db8056cb0 con 0x7f5db808c970 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): authenticate will time out at 905.916025s 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:55786/0 (socket says 10.20.193.7:55786) 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/2157126910 learned_addr learned my addr 10.20.193.7:0/2157126910 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): get_auth_request con 0x7f5db808c970 auth_method 0 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/2157126910 >> v2:10.20.193.61:3300/0 conn(0x7f5db808c060 0x7f5db808c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): get_auth_request con 0x7f5db808c060 auth_method 0 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 msgr2=0x7f5db817fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 msgr2=0x7f5db817fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_done global_id 74761 payload 274 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 -- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 msgr2=0x7f5db817fe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 -- 10.20.193.7:0/2157126910 >> v1:10.20.193.61:6789/0 conn(0x7f5db81803a0 legacy=0x7f5db81a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient: _finish_hunting 0 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 monclient: found mon.noname-c 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 -- 10.20.193.7:0/2157126910 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db8056f40 con 0x7f5db808c060 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: starting. 2026-02-22T20:58:13.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21265 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: created object 0... 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: created object 25... 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: created object 49... 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: finishing. 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21300]: shutting down. 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db808c430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009840 tx=0x7f5da801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e2c4679c111af7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 1 -- 10.20.193.7:0/2157126910 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da80b2070 con 0x7f5db808c060 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: dump: 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:13.446 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: _finish_auth 0 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: _check_auth_tickets 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 5 monclient: authenticate success, global_id 74761 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 1 -- 10.20.193.7:0/2157126910 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da80a9070 con 0x7f5db808c060 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 1 -- 10.20.193.7:0/2157126910 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da80ad880 con 0x7f5db808c060 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 4 set_mon_vals no callback set 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbcb4a640 10 monclient: dump: 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: shutdown 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/2157126910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 msgr2=0x7f5db808c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db808c430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009840 tx=0x7f5da801c400 comp rx=0 tx=0).stop 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/2157126910 shutdown_connections 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db808c970 0x7f5db817fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/2157126910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db808c430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/2157126910 >> 10.20.193.7:0/2157126910 conn(0x7f5db8092050 msgr2=0x7f5db808e160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/2157126910 shutdown_connections 2026-02-22T20:58:13.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/2157126910 wait complete. 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: build_initial_monmap 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: monmap: 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:13.449 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 Processor -- start 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- start start 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: init 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db8182f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-b con 0x7f5db808c060 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-a con 0x7f5db808c970 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): picked mon.noname-c con 0x7f5db81803a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80907d0 con 0x7f5db808c970 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8090950 con 0x7f5db808c060 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5db8057c20 con 0x7f5db81803a0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbfdd7640 10 monclient(hunting): authenticate will time out at 905.919585s 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:58982/0 (socket says 10.20.193.7:58982) 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/3391543428 learned_addr learned my addr 10.20.193.7:0/3391543428 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): get_auth_request con 0x7f5db808c970 auth_method 0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db8182f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): get_auth_request con 0x7f5db808c060 auth_method 0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 10 monclient(hunting): get_auth_request con 0x7f5db81803a0 auth_method 0 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbdb4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 1 -- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 msgr2=0x7f5db8180bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 1 -- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 msgr2=0x7f5db8180bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient(hunting): handle_auth_done global_id 94326 payload 824 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbe34d640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 msgr2=0x7f5db8180bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/3391543428 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 msgr2=0x7f5db8182f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db8182f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient: _finish_hunting 0 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 monclient: found mon.noname-a 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.442+0000 7f5dbd34b640 1 -- 10.20.193.7:0/3391543428 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db81838d0 con 0x7f5db808c970 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbd34b640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e7a0 tx=0x7f5dac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac017070 con 0x7f5db808c970 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: dump: 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:13.451 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: _finish_auth 0 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac00c870 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00f040 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 10 monclient: dump: 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 5 monclient: authenticate success, global_id 94326 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _renew_subs 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da7fff640 4 set_mon_vals no callback set 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db8088850 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _renew_subs 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db8184460 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db808c430 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5dac012050 con 0x7f5db808c970 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 --2- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 0x7f5d8805afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:13.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(198..198 src has 64..198) ==== 3897+0+0 (secure 0 0 0) 0x7f5dac04e5e0 con 0x7f5db808c970 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 0x7f5d8805afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbdb4c640 10 monclient: get_auth_request con 0x7f5d8803ab10 auth_method 0 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.446+0000 7f5dbdb4c640 1 --2- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 0x7f5d8805afc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5da801c440 tx=0x7f5da80af040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.450+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5dac016170 con 0x7f5db808c970 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.450+0000 7f5da67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:13.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.450+0000 7f5da67fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: starting. 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: listing objects. 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: listed object 0... 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: listed object 25... 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: saw 50 objects 2026-02-22T20:58:13.455 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21302]: shutting down. 2026-02-22T20:58:13.560 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5db81847a0 con 0x7f5db808c970 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5da67fc640 1 -- 10.20.193.7:0/3391543428 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f5dac00a0d0 con 0x7f5db808c970 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5da67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5da67fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:13.561 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":52,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 msgr2=0x7f5d8805afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 0x7f5d8805afc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5da801c440 tx=0x7f5da80af040 comp rx=0 tx=0).stop 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 10 monclient: shutdown 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 msgr2=0x7f5db819adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e7a0 tx=0x7f5dac00ec60 comp rx=0 tx=0).stop 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 shutdown_connections 2026-02-22T20:58:13.562 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5db81803a0 0x7f5db8180bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5db808c970 0x7f5db819adc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5d8803ab10 0x7f5d8805afc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 --2- 10.20.193.7:0/3391543428 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5db808c060 0x7f5db8182f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 >> 10.20.193.7:0/3391543428 conn(0x7f5db8092050 msgr2=0x7f5db8086d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 shutdown_connections 2026-02-22T20:58:13.563 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:13.558+0000 7f5dbfdd7640 1 -- 10.20.193.7:0/3391543428 wait complete. 2026-02-22T20:58:14.399 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:58:14.399 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:58:14.399 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:14.400 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:58:14.400 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:14.400 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21301]: starting. 2026-02-22T20:58:14.401 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21301]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21265 2026-02-22T20:58:14.401 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21301]: shutting down. 2026-02-22T20:58:14.401 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:58:14.401 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.402 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:58:14.403 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:58:14.403 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:14.403 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:14.403 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:14.404 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:58:14.405 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:16.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: starting. 2026-02-22T20:58:16.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21352 2026-02-22T20:58:16.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: created object 0... 2026-02-22T20:58:16.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: created object 25... 2026-02-22T20:58:16.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: created object 49... 2026-02-22T20:58:16.457 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: finishing. 2026-02-22T20:58:16.457 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21353]: shutting down. 2026-02-22T20:58:16.571 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: get_monmap_and_config 2026-02-22T20:58:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: monmap: 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:16.630179+0000 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:16.630179+0000 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:16.631 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 Processor -- start 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 -- start start 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: init 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient: _add_conns ranks=[3,2,1,4,0] 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f178413cef0 0x7f178413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-a con 0x7f178413cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-b con 0x7f178413d800 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f178413a110 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:16.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178405d510 con 0x7f178413a110 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f178408b800 con 0x7f178413cef0 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f178408a720 con 0x7f178413d800 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f178ac68640 10 monclient(hunting): authenticate will time out at 909.103451s 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f178413cef0 0x7f178413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:55810/0 (socket says 10.20.193.7:55810) 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 -- 10.20.193.7:0/2275997377 learned_addr learned my addr 10.20.193.7:0/2275997377 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 10 monclient(hunting): get_auth_request con 0x7f178413d800 auth_method 0 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): get_auth_request con 0x7f178413cef0 auth_method 0 2026-02-22T20:58:16.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 -- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 msgr2=0x7f1784139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 -- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 msgr2=0x7f1784139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f177bfff640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient(hunting): handle_auth_done global_id 94335 payload 274 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 -- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 msgr2=0x7f1784139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 -- 10.20.193.7:0/2275997377 >> v1:10.20.193.61:6789/0 conn(0x7f178413a110 legacy=0x7f178419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 monclient: found mon.noname-a 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.626+0000 7f17889dd640 1 -- 10.20.193.7:0/2275997377 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178408aa00 con 0x7f178413cef0 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413cef0 0x7f178413d2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1774004780 tx=0x7f177401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d97871517ee7351 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 1 -- 10.20.193.7:0/2275997377 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17740b0070 con 0x7f178413cef0 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: dump: 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 1 -- 10.20.193.7:0/2275997377 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17740ab600 con 0x7f178413cef0 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 5 monclient: authenticate success, global_id 94335 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 1 -- 10.20.193.7:0/2275997377 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17740ab9d0 con 0x7f178413cef0 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177b7fe640 10 monclient: dump: 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.642 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 4 set_mon_vals no callback set 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: shutdown 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413cef0 msgr2=0x7f178413d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413cef0 0x7f178413d2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1774004780 tx=0x7f177401c440 comp rx=0 tx=0).stop 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/2275997377 shutdown_connections 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413d800 0x7f1784139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- 10.20.193.7:0/2275997377 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413cef0 0x7f178413d2c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/2275997377 >> 10.20.193.7:0/2275997377 conn(0x7f178408f860 msgr2=0x7f178408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/2275997377 shutdown_connections 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/2275997377 wait complete. 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: monmap: 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 Processor -- start 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- start start 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: init 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:58:16.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-a con 0x7f178413a110 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-c con 0x7f178413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f178413d800 0x7f1784122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): picked mon.noname-b con 0x7f178413d800 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1784088fa0 con 0x7f178413a110 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1784088e20 con 0x7f178413d800 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f17841a23b0 con 0x7f178413cef0 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient(hunting): authenticate will time out at 909.107188s 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:58990/0 (socket says 10.20.193.7:58990) 2026-02-22T20:58:16.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 -- 10.20.193.7:0/3832530308 learned_addr learned my addr 10.20.193.7:0/3832530308 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): get_auth_request con 0x7f178413a110 auth_method 0 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 10 monclient(hunting): get_auth_request con 0x7f178413cef0 auth_method 0 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 1 -- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 msgr2=0x7f1784122210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 1 -- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 msgr2=0x7f1784122210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177bfff640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17891de640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f178413d800 0x7f1784122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient(hunting): handle_auth_done global_id 94338 payload 824 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 -- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 msgr2=0x7f1784122210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 -- 10.20.193.7:0/3832530308 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f178413d800 msgr2=0x7f1784122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f178413d800 0x7f1784122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 monclient: found mon.noname-a 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 -- 10.20.193.7:0/3832530308 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178408ca10 con 0x7f178413a110 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17889dd640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f177401c480 tx=0x7f17740191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17740b0040 con 0x7f178413a110 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: dump: 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.647 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17740b9070 con 0x7f178413a110 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17740ab9b0 con 0x7f178413a110 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f17797fa640 10 monclient: dump: 2026-02-22T20:58:16.648 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f177affd640 4 set_mon_vals no callback set 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 5 monclient: authenticate success, global_id 94338 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _renew_subs 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178412aa50 con 0x7f178413a110 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _renew_subs 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.630+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1784129530 con 0x7f178413a110 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f178ac68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f178ac68640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f178ac68640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178412a5e0 con 0x7f178413a110 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f17740b3070 con 0x7f178413a110 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f17797fa640 1 --2- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 0x7f175405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(201..201 src has 64..201) ==== 3897+0+0 (secure 0 0 0) 0x7f17740e82f0 con 0x7f178413a110 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f177bfff640 1 --2- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 0x7f175405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f177bfff640 10 monclient: get_auth_request con 0x7f175403ab20 auth_method 0 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.634+0000 7f177bfff640 1 --2- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 0x7f175405afd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f176c006d80 tx=0x7f176c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.638+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1774016150 con 0x7f178413a110 2026-02-22T20:58:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.638+0000 7f17797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.638+0000 7f17797fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f178413d2c0 con 0x7f178413a110 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f17797fa640 1 -- 10.20.193.7:0/3832530308 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f17740bc360 con 0x7f178413a110 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f17797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:16.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f17797fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:16.751 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 msgr2=0x7f175405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 0x7f175405afd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f176c006d80 tx=0x7f176c008040 comp rx=0 tx=0).stop 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 10 monclient: shutdown 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 msgr2=0x7f1784115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f177401c480 tx=0x7f17740191e0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 shutdown_connections 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> v2:10.20.193.61:6800/2336688312 conn(0x7f175403ab20 0x7f175405afd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f178413d800 0x7f1784122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f178413cef0 0x7f1784122210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 --2- 10.20.193.7:0/3832530308 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f178413a110 0x7f1784115070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 >> 10.20.193.7:0/3832530308 conn(0x7f178408f860 msgr2=0x7f178405b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 shutdown_connections 2026-02-22T20:58:16.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.746+0000 7f178ac68640 1 -- 10.20.193.7:0/3832530308 wait complete. 2026-02-22T20:58:16.760 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:58:16.760 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:58:16.761 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: get_monmap_and_config 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: monmap: 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:16.822262+0000 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:16.822262+0000 2026-02-22T20:58:16.823 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 Processor -- start 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 -- start start 2026-02-22T20:58:16.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: init 2026-02-22T20:58:16.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2026-02-22T20:58:16.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2efc090940 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:16.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f2efc088340 0x7f2efc17e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-a con 0x7f2efc088340 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2efc17e610 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc08d840 con 0x7f2efc17e610 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2efc08c2f0 con 0x7f2efc090940 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f2efc0912f0 con 0x7f2efc088340 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2f01098640 10 monclient(hunting): authenticate will time out at 909.295337s 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f2efc088340 0x7f2efc17e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f2efc088340 0x7f2efc17e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59000/0 (socket says 10.20.193.7:59000) 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efb577640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f2efc17e610 0x7f2efc19e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39932/0 (socket says 10.20.193.7:39932) 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 -- 10.20.193.7:0/1210605232 learned_addr learned my addr 10.20.193.7:0/1210605232 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:16.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): get_auth_request con 0x7f2efc088340 auth_method 0 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient(hunting): handle_auth_done global_id 94341 payload 274 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 -- 10.20.193.7:0/1210605232 >> v1:10.20.193.61:6789/0 conn(0x7f2efc090940 legacy=0x7f2efc087c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 -- 10.20.193.7:0/1210605232 >> v1:10.20.193.7:6789/0 conn(0x7f2efc17e610 legacy=0x7f2efc19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 monclient: found mon.noname-a 2026-02-22T20:58:16.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.818+0000 7f2efa575640 1 -- 10.20.193.7:0/1210605232 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc08edf0 con 0x7f2efc088340 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 --2- 10.20.193.7:0/1210605232 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc088340 0x7f2efc17e0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40090a0 tx=0x7f2ee401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39ff4a8a671a73c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 1 -- 10.20.193.7:0/1210605232 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b0070 con 0x7f2efc088340 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: dump: 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.838 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 1 -- 10.20.193.7:0/1210605232 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee40ab640 con 0x7f2efc088340 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 1 -- 10.20.193.7:0/1210605232 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40aba10 con 0x7f2efc088340 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9d74640 10 monclient: dump: 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 5 monclient: authenticate success, global_id 94341 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 4 set_mon_vals no callback set 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: shutdown 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/1210605232 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc088340 msgr2=0x7f2efc17e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 --2- 10.20.193.7:0/1210605232 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc088340 0x7f2efc17e0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40090a0 tx=0x7f2ee401c500 comp rx=0 tx=0).stop 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/1210605232 shutdown_connections 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 --2- 10.20.193.7:0/1210605232 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc088340 0x7f2efc17e0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/1210605232 >> 10.20.193.7:0/1210605232 conn(0x7f2efc08e050 msgr2=0x7f2efc08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/1210605232 shutdown_connections 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/1210605232 wait complete. 2026-02-22T20:58:16.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: monmap: 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 Processor -- start 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- start start 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: init 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2efc088340 0x7f2efc08a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-b con 0x7f2efc088340 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc090940 0x7f2efc055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-a con 0x7f2efc090940 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): picked mon.noname-c con 0x7f2efc17e610 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1a2b40 con 0x7f2efc090940 2026-02-22T20:58:16.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1a2cc0 con 0x7f2efc088340 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc1a2e40 con 0x7f2efc17e610 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient(hunting): authenticate will time out at 909.299303s 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc090940 0x7f2efc055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:55814/0 (socket says 10.20.193.7:55814) 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 -- 10.20.193.7:0/3432379681 learned_addr learned my addr 10.20.193.7:0/3432379681 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 10 monclient(hunting): get_auth_request con 0x7f2efc17e610 auth_method 0 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): get_auth_request con 0x7f2efc090940 auth_method 0 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 msgr2=0x7f2efc055fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 msgr2=0x7f2efc055fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efb577640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efad76640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2efc088340 0x7f2efc08a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efad76640 10 monclient(hunting): get_auth_request con 0x7f2efc088340 auth_method 0 2026-02-22T20:58:16.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient(hunting): handle_auth_done global_id 94347 payload 824 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 msgr2=0x7f2efc055fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f2efc17e610 0x7f2efc055fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2efc088340 msgr2=0x7f2efc08a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2efc088340 0x7f2efc08a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 monclient: found mon.noname-a 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc11ad90 con 0x7f2efc090940 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2efa575640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc090940 0x7f2efc055a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4006fd0 tx=0x7f2ee40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b9070 con 0x7f2efc090940 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: dump: 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.848 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4004230 con 0x7f2efc090940 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b0040 con 0x7f2efc090940 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2ef9573640 4 set_mon_vals no callback set 2026-02-22T20:58:16.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2edb7fe640 10 monclient: dump: 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 5 monclient: authenticate success, global_id 94347 2026-02-22T20:58:16.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _renew_subs 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc11b070 con 0x7f2efc090940 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _renew_subs 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.822+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc138750 con 0x7f2efc090940 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2f01098640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2f01098640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 0x7f2efc19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc08c7a0 con 0x7f2efc0564f0 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 0x7f2efc19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient: get_auth_request con 0x7f2efc0564f0 auth_method 0 2026-02-22T20:58:16.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 10 monclient(hunting): handle_auth_done global_id 94350 payload 824 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2efc0887a0 con 0x7f2efc0564f0 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2ee40b3070 con 0x7f2efc090940 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efad76640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 0x7f2efc19e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 --2- 10.20.193.7:0/3432379681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2ec803ab20 0x7f2ec805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(201..201 src has 64..201) ==== 3897+0+0 (secure 0 0 0) 0x7f2ee40e7ec0 con 0x7f2efc090940 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0002ba0 con 0x7f2efc0564f0 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 10 monclient: dump: 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.853 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efb577640 1 --2- 10.20.193.7:0/3432379681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2ec803ab20 0x7f2ec805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f2ef0002ba0 con 0x7f2efc0564f0 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 msgr2=0x7f2efc19e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 0x7f2efc19e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef000e960 comp rx=0 tx=0).stop 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 msgr2=0x7f2efc19e9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2edb7fe640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0564f0 0x7f2efc19e9f0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef000e960 comp rx=0 tx=0).stop 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efb577640 10 monclient: get_auth_request con 0x7f2ec803ab20 auth_method 0 2026-02-22T20:58:16.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.826+0000 7f2efb577640 1 --2- 10.20.193.7:0/3432379681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2ec803ab20 0x7f2ec805afd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2eec002af0 tx=0x7f2eec003230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 0x7f2efc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc087c30 con 0x7f2efc0568f0 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 0x7f2efc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient: get_auth_request con 0x7f2efc0568f0 auth_method 0 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 10 monclient(hunting): handle_auth_done global_id 94353 payload 824 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 1 -- 10.20.193.7:0/3432379681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2efc11ba70 con 0x7f2efc0568f0 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efad76640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 0x7f2efc19ef30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00068d0 con 0x7f2efc0568f0 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 10 monclient: dump: 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.856 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f2ef00040d0 con 0x7f2efc0568f0 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 msgr2=0x7f2efc19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 0x7f2efc19ef30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef00026e0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 msgr2=0x7f2efc19ef30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:16.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2edb7fe640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc0568f0 0x7f2efc19ef30 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0002770 tx=0x7f2ef00026e0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 69514, 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:16.858 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:16.859 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:16.860 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:16.861 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:16.862 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:16.863 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:16.864 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:16.865 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:16.866 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.867 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:16.868 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:58:16.869 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:16.869 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:16.869 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:16.869 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:16.869 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2ec803ab20 msgr2=0x7f2ec805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 --2- 10.20.193.7:0/3432379681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f2ec803ab20 0x7f2ec805afd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2eec002af0 tx=0x7f2eec003230 comp rx=0 tx=0).stop 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 10 monclient: shutdown 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc090940 msgr2=0x7f2efc055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 --2- 10.20.193.7:0/3432379681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2efc090940 0x7f2efc055a70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4006fd0 tx=0x7f2ee40192a0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efb577640 1 -- 10.20.193.7:0/3432379681 reap_dead start 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2efb577640 1 -- 10.20.193.7:0/3432379681 reap_dead start 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 shutdown_connections 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 >> 10.20.193.7:0/3432379681 conn(0x7f2efc08e050 msgr2=0x7f2efc086b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:16.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 shutdown_connections 2026-02-22T20:58:16.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.830+0000 7f2f01098640 1 -- 10.20.193.7:0/3432379681 wait complete. 2026-02-22T20:58:16.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:16.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:58:16.871 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: get_monmap_and_config 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: monmap: 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:16.932113+0000 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:16.932113+0000 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:16.932 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 Processor -- start 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- start start 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: init 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd37c08b590 0x7fd37c139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): picked mon.noname-c con 0x7fd37c08b590 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd37c13cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): picked mon.noname-b con 0x7fd37c13a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd37c13d530 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37c089920 con 0x7fd37c13d530 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd37c08ab40 con 0x7fd37c08b590 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c08a860 con 0x7fd37c13a4d0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient(hunting): authenticate will time out at 909.404994s 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd37c13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd37c13d530 0x7fd37c19e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:39940/0 (socket says 10.20.193.7:39940) 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 1 -- 10.20.193.7:0/3191129821 learned_addr learned my addr 10.20.193.7:0/3191129821 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request con 0x7fd37c13a4d0 auth_method 0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 --2- 10.20.193.7:0/3191129821 >> v2:10.20.193.61:3300/0 conn(0x7fd37c08b590 0x7fd37c139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 msgr2=0x7fd37c13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 msgr2=0x7fd37c13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd37c13cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): get_auth_request con 0x7fd37c08b590 auth_method 0 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd37c13cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437305461 0 0) 0x7fd37c089920 con 0x7fd37c13d530 2026-02-22T20:58:16.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): my global_id is 94356 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368003620 con 0x7fd37c13d530 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271941976 0 0) 0x7fd368003620 con 0x7fd37c13d530 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 msgr2=0x7fd37c13cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd37c13cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 >> v2:10.20.193.61:3300/0 conn(0x7fd37c08b590 msgr2=0x7fd37c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 --2- 10.20.193.7:0/3191129821 >> v2:10.20.193.61:3300/0 conn(0x7fd37c08b590 0x7fd37c139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c089170 con 0x7fd37c13d530 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fd36c0031e0 con 0x7fd37c13d530 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: dump: 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 >> v1:10.20.193.7:6789/0 conn(0x7fd37c13d530 legacy=0x7fd37c19e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd368003bc0 0x7fd368003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): picked mon.a con 0x7fd368003bc0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3680048d0 0x7fd368004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): picked mon.b con 0x7fd3680048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:16.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd368065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): picked mon.c con 0x7fd37c13a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c08a860 con 0x7fd368003bc0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680055e0 con 0x7fd3680048d0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd368065fd0 con 0x7fd37c13a4d0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd368003bc0 0x7fd368003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): get_auth_request con 0x7fd368003bc0 auth_method 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd368065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): get_auth_request con 0x7fd37c13a4d0 auth_method 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3680048d0 0x7fd368004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request con 0x7fd3680048d0 auth_method 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient(hunting): handle_auth_done global_id 94356 payload 293 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 msgr2=0x7fd368065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c13a4d0 0x7fd368065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3680048d0 msgr2=0x7fd368004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3680048d0 0x7fd368004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 monclient: found mon.a 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 -- 10.20.193.7:0/3191129821 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368003620 con 0x7fd368003bc0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 5 monclient: authenticate success, global_id 94356 2026-02-22T20:58:16.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37affd640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd368003bc0 0x7fd368003fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd370009af0 tx=0x7fd37001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c452db4d27b2e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700b2070 con 0x7fd368003bc0 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: dump: 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.938 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3700a55c0 con 0x7fd368003bc0 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 1 -- 10.20.193.7:0/3191129821 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700096f0 con 0x7fd368003bc0 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 4 set_mon_vals no callback set 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd379ffb640 10 monclient: dump: 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 10 monclient: shutdown 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd368003bc0 msgr2=0x7fd368003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 --2- 10.20.193.7:0/3191129821 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd368003bc0 0x7fd368003fd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd370009af0 tx=0x7fd37001cbe0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd37b7fe640 1 -- 10.20.193.7:0/3191129821 reap_dead start 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- 10.20.193.7:0/3191129821 shutdown_connections 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- 10.20.193.7:0/3191129821 >> 10.20.193.7:0/3191129821 conn(0x7fd37c08faa0 msgr2=0x7fd37c08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- 10.20.193.7:0/3191129821 shutdown_connections 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.930+0000 7fd381572640 1 -- 10.20.193.7:0/3191129821 wait complete. 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: build_initial_monmap 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: monmap: 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 Processor -- start 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- start start 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: init 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:16.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): picked mon.noname-a con 0x7fd37c15d530 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37c086f10 0x7fd37c087320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): picked mon.noname-b con 0x7fd37c086f10 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 0x7fd37c14c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): picked mon.noname-c con 0x7fd37c14c030 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c160b80 con 0x7fd37c15d530 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c13aab0 con 0x7fd37c086f10 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c160d00 con 0x7fd37c14c030 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): authenticate will time out at 909.408966s 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59032/0 (socket says 10.20.193.7:59032) 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 -- 10.20.193.7:0/3308117864 learned_addr learned my addr 10.20.193.7:0/3308117864 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): get_auth_request con 0x7fd37c15d530 auth_method 0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 0x7fd37c14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 10 monclient(hunting): get_auth_request con 0x7fd37c14c030 auth_method 0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 msgr2=0x7fd37c14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 msgr2=0x7fd37c14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 0x7fd37c14c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37c086f10 0x7fd37c087320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 0x7fd37c14c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request con 0x7fd37c086f10 auth_method 0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient(hunting): handle_auth_done global_id 94359 payload 824 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 msgr2=0x7fd37c14c450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c14c030 0x7fd37c14c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37c086f10 msgr2=0x7fd37c087320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37c086f10 0x7fd37c087320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:16.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 monclient: found mon.noname-a 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c15cb00 con 0x7fd37c15d530 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37affd640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd37001d0c0 tx=0x7fd368005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700bb070 con 0x7fd37c15d530 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: dump: 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3700a5770 con 0x7fd37c15d530 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700b2040 con 0x7fd37c15d530 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 10 monclient: dump: 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd3797fa640 4 set_mon_vals no callback set 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 5 monclient: authenticate success, global_id 94359 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _renew_subs 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c0888a0 con 0x7fd37c15d530 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _renew_subs 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:16.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c05d1b0 con 0x7fd37c15d530 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c08ec10 con 0x7fd37c05a3f0 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd3700a5b20 con 0x7fd37c15d530 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a3f0 auth_method 0 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 --2- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(201..201 src has 64..201) ==== 3897+0+0 (secure 0 0 0) 0x7fd3700e8140 con 0x7fd37c15d530 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 --2- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 10 monclient: get_auth_request con 0x7fd34803ab20 auth_method 0 2026-02-22T20:58:16.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:16.934+0000 7fd37b7fe640 1 --2- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3680057e0 tx=0x7fd36c0039a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:16.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:16.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:17.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:17.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a3f0 auth_method 0 2026-02-22T20:58:17.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:17.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.138+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:58:17.356 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21354]: starting. 2026-02-22T20:58:17.356 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21354]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21352 2026-02-22T20:58:17.356 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21354]: shutting down. 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a3f0 auth_method 0 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:17.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:17.542+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:58:18.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:18.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a3f0 auth_method 0 2026-02-22T20:58:18.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:18.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:18.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:18.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:18.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:18.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:18.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:18.346+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: starting. 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21352 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: created object 0... 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: created object 25... 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: created object 49... 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: finishing. 2026-02-22T20:58:19.408 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21387]: shutting down. 2026-02-22T20:58:19.419 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:19.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: starting. 2026-02-22T20:58:19.419 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: listing objects. 2026-02-22T20:58:19.420 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: listed object 0... 2026-02-22T20:58:19.420 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: listed object 25... 2026-02-22T20:58:19.420 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: saw 50 objects 2026-02-22T20:58:19.420 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21389]: shutting down. 2026-02-22T20:58:19.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.933+0000 7fd35a7fc640 10 monclient: tick 2026-02-22T20:58:19.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.933+0000 7fd35a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:19.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.933+0000 7fd35a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:19.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.933+0000 7fd35a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:19.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a3f0 auth_method 0 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:19.951 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:19.949+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-22T20:58:20.358 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:20.359 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21388]: starting. 2026-02-22T20:58:20.359 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21388]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21352 2026-02-22T20:58:20.359 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21388]: shutting down. 2026-02-22T20:58:20.361 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:20.361 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:20.361 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:20.363 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 10 monclient: tick 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 0x7fd340023af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 msgr2=0x7fd37c04ca80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a3f0 0x7fd37c04ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35a7fc640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c08ec10 con 0x7fd340003640 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 0x7fd340023af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd340003640 auth_method 0 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_done global_id 104108 payload 824 2026-02-22T20:58:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3400241d0 con 0x7fd340003640 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 0x7fd340023af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd364018eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364003e30 con 0x7fd340003640 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 10 monclient: dump: 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:20.941 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fd364003e30 con 0x7fd340003640 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 msgr2=0x7fd340023af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 0x7fd340023af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd364018eb0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 msgr2=0x7fd340023af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:20.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.933+0000 7fd35b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd340003640 0x7fd340023af0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd364018eb0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 0x7fd37c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd37c139f90 con 0x7fd37c05a7c0 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 0x7fd37c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:20.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient: get_auth_request con 0x7fd37c05a7c0 auth_method 0 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:20.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 10 monclient(hunting): handle_auth_done global_id 104111 payload 824 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 1 -- 10.20.193.7:0/3308117864 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd37c05fc70 con 0x7fd37c05a7c0 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37a7fc640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 0x7fd37c14c990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd3640047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3640217c0 con 0x7fd37c05a7c0 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:20.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 10 monclient: dump: 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:20.948 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7fd3640217c0 con 0x7fd37c05a7c0 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:20.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:20.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 msgr2=0x7fd37c14c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:20.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 0x7fd37c14c990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd3640047b0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 msgr2=0x7fd37c14c990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:20.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd35b7fe640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37c05a7c0 0x7fd37c14c990 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3640189f0 tx=0x7fd3640047b0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.950 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd37b7fe640 1 -- 10.20.193.7:0/3308117864 reap_dead start 2026-02-22T20:58:20.951 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:20.951 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:20.951 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 10703, 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:20.952 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:20.953 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:20.953 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:58:20.953 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:20.953 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:20.953 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:20.954 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:20.955 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:20.956 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:20.957 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.958 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:20.959 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:20.960 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:20.961 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:20.962 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:20.963 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:20.964 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:20.965 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:20.965 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.965 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:20.965 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:20.965 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.966 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:20.967 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:20.968 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.969 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.970 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.971 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.972 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.973 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:20.974 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:20.975 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:20.976 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 msgr2=0x7fd34805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3680057e0 tx=0x7fd36c0039a0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 10 monclient: shutdown 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 msgr2=0x7fd37c0869d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd37001d0c0 tx=0x7fd368005900 comp rx=0 tx=0).stop 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 shutdown_connections 2026-02-22T20:58:20.978 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 --2- 10.20.193.7:0/3308117864 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37c15d530 0x7fd37c0869d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:20.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 >> 10.20.193.7:0/3308117864 conn(0x7fd37c08faa0 msgr2=0x7fd37c08dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:20.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 shutdown_connections 2026-02-22T20:58:20.979 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:20.937+0000 7fd381572640 1 -- 10.20.193.7:0/3308117864 wait complete. 2026-02-22T20:58:20.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:20.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:58:20.979 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:58:21.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: get_monmap_and_config 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: build_initial_monmap 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: monmap: 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:21.040497+0000 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:21.040497+0000 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.041 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:21.042 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:21.042 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:21.042 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:21.042 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:21.042 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 Processor -- start 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 -- start start 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: init 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fdce0055a70 0x7fdce0055e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-a con 0x7fdce0055a70 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdce0056380 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce019f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-b con 0x7fdce013a270 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce008ec80 con 0x7fdce0056380 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.051 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fdce0089f00 con 0x7fdce0055a70 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdce008e370 con 0x7fdce013a270 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdce543c640 10 monclient(hunting): authenticate will time out at 913.513924s 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fdce0055a70 0x7fdce0055e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcde7fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fdce0056380 0x7fdce0139b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33120/0 (socket says 10.20.193.7:33120) 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcde7fc640 1 -- 10.20.193.7:0/1188340669 learned_addr learned my addr 10.20.193.7:0/1188340669 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): get_auth_request con 0x7fdce013a270 auth_method 0 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): get_auth_request con 0x7fdce0055a70 auth_method 0 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_done global_id 104114 payload 274 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 -- 10.20.193.7:0/1188340669 >> v2:10.20.193.7:3300/0 conn(0x7fdce0055a70 msgr2=0x7fdce0055e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 --2- 10.20.193.7:0/1188340669 >> v2:10.20.193.7:3300/0 conn(0x7fdce0055a70 0x7fdce0055e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 -- 10.20.193.7:0/1188340669 >> v1:10.20.193.7:6789/0 conn(0x7fdce0056380 legacy=0x7fdce0139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 monclient: found mon.noname-b 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.037+0000 7fdcdf7fe640 1 -- 10.20.193.7:0/1188340669 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0086ff0 con 0x7fdce013a270 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 1 --2- 10.20.193.7:0/1188340669 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce019f360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0004b00 tx=0x7fdcd001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c4af908eb47bfc server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 1 -- 10.20.193.7:0/1188340669 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00b2070 con 0x7fdce013a270 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: dump: 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.054 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 1 -- 10.20.193.7:0/1188340669 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd00a5800 con 0x7fdce013a270 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 5 monclient: authenticate success, global_id 104114 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:21.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 1 -- 10.20.193.7:0/1188340669 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a5bf0 con 0x7fdce013a270 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcddffb640 10 monclient: dump: 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 4 set_mon_vals no callback set 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: shutdown 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1188340669 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 msgr2=0x7fdce019f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- 10.20.193.7:0/1188340669 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce019f360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0004b00 tx=0x7fdcd001c830 comp rx=0 tx=0).stop 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1188340669 shutdown_connections 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- 10.20.193.7:0/1188340669 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce019f360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- 10.20.193.7:0/1188340669 >> v2:10.20.193.7:3300/0 conn(0x7fdce0055a70 0x7fdce0055e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1188340669 >> 10.20.193.7:0/1188340669 conn(0x7fdce008ced0 msgr2=0x7fdce008d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1188340669 shutdown_connections 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1188340669 wait complete. 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: build_initial_monmap 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: monmap: 2026-02-22T20:58:21.057 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 Processor -- start 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- start start 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: init 2026-02-22T20:58:21.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-a con 0x7fdce0055a70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce0056380 0x7fdce0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-b con 0x7fdce0056380 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce0129bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): picked mon.noname-c con 0x7fdce013a270 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdce01a2240 con 0x7fdce0055a70 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdce01a20c0 con 0x7fdce0056380 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fdce01a23c0 con 0x7fdce013a270 2026-02-22T20:58:21.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): authenticate will time out at 913.518066s 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36776/0 (socket says 10.20.193.7:36776) 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 -- 10.20.193.7:0/1167317146 learned_addr learned my addr 10.20.193.7:0/1167317146 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): get_auth_request con 0x7fdce0055a70 auth_method 0 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce0129bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): get_auth_request con 0x7fdce013a270 auth_method 0 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce0056380 0x7fdce0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient(hunting): handle_auth_done global_id 94386 payload 824 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 msgr2=0x7fdce0129bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fdce013a270 0x7fdce0129bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce0056380 msgr2=0x7fdce0150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce0056380 0x7fdce0150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 monclient: found mon.noname-a 2026-02-22T20:58:21.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0139ed0 con 0x7fdce0055a70 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient: get_auth_request con 0x7fdce0056380 auth_method 0 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce0056380 0x7fdce0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdeffd640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009430 tx=0x7fdcd400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4017070 con 0x7fdce0055a70 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: dump: 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd400c940 con 0x7fdce0055a70 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400cd30 con 0x7fdce0055a70 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:21.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdd7fa640 4 set_mon_vals no callback set 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 10 monclient: dump: 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 5 monclient: authenticate success, global_id 94386 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _renew_subs 2026-02-22T20:58:21.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce012d940 con 0x7fdce0055a70 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _renew_subs 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce012b5e0 con 0x7fdce0055a70 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 0x7fdce012a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0055e40 con 0x7fdce012a0f0 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 0x7fdce012a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient: get_auth_request con 0x7fdce012a0f0 auth_method 0 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fdcd4013470 con 0x7fdce0055a70 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 --2- 10.20.193.7:0/1167317146 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdcac03ab20 0x7fdcac05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(205..205 src has 64..205) ==== 3503+0+0 (secure 0 0 0) 0x7fdcd404ede0 con 0x7fdce0055a70 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_done global_id 74827 payload 824 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 1 --2- 10.20.193.7:0/1167317146 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdcac03ab20 0x7fdcac05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcde7fc640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdce012c140 con 0x7fdce012a0f0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.041+0000 7fdcdf7fe640 10 monclient: get_auth_request con 0x7fdcac03ab20 auth_method 0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 0x7fdce012a4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdce012c760 tx=0x7fdcc800db80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8005b70 con 0x7fdce012a0f0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:58:21.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 10 monclient: dump: 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcdf7fe640 1 --2- 10.20.193.7:0/1167317146 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdcac03ab20 0x7fdcac05afd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009b40 tx=0x7fdcd00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fdcc8017070 con 0x7fdce012a0f0 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:21.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:21.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 msgr2=0x7fdce012a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 0x7fdce012a4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdce012c760 tx=0x7fdcc800db80 comp rx=0 tx=0).stop 2026-02-22T20:58:21.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 msgr2=0x7fdce012a4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:21.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.045+0000 7fdcbf7fe640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012a0f0 0x7fdce012a4c0 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdce012c760 tx=0x7fdcc800db80 comp rx=0 tx=0).stop 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 0x7fdce0126a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0151120 con 0x7fdce012aa00 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 0x7fdce0126a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient: get_auth_request con 0x7fdce012aa00 auth_method 0 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 10 monclient(hunting): handle_auth_done global_id 74830 payload 824 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 1 -- 10.20.193.7:0/1167317146 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdce012ae00 con 0x7fdce012aa00 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcde7fc640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 0x7fdce0126a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80036e0 tx=0x7fdcc80026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8007280 con 0x7fdce012aa00 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 10 monclient: dump: 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.071 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7fdcc8007280 con 0x7fdce012aa00 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 msgr2=0x7fdce0126a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 0x7fdce0126a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80036e0 tx=0x7fdcc80026e0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 msgr2=0x7fdce0126a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcbf7fe640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fdce012aa00 0x7fdce0126a30 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80036e0 tx=0x7fdcc80026e0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:21.072 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 168440, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:21.073 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:21.074 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.075 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:21.076 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:21.077 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.078 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:21.079 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.080 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.081 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:21.082 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:21.083 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:21.084 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdcac03ab20 msgr2=0x7fdcac05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 --2- 10.20.193.7:0/1167317146 >> v2:10.20.193.61:6800/2336688312 conn(0x7fdcac03ab20 0x7fdcac05afd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009b40 tx=0x7fdcd00a7070 comp rx=0 tx=0).stop 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 10 monclient: shutdown 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 msgr2=0x7fdce01506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdcdf7fe640 1 -- 10.20.193.7:0/1167317146 reap_dead start 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009430 tx=0x7fdcd400ee10 comp rx=0 tx=0).stop 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 shutdown_connections 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 --2- 10.20.193.7:0/1167317146 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fdce0055a70 0x7fdce01506a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 >> 10.20.193.7:0/1167317146 conn(0x7fdce008ced0 msgr2=0x7fdce008bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 shutdown_connections 2026-02-22T20:58:21.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.049+0000 7fdce543c640 1 -- 10.20.193.7:0/1167317146 wait complete. 2026-02-22T20:58:21.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:21.086 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:58:21.086 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: get_monmap_and_config 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: build_initial_monmap 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: monmap: 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:21.146074+0000 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:21.146074+0000 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:21.146 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 Processor -- start 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 -- start start 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: init 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc00008eb20 0x7fc00008eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-a con 0x7fc00008eb20 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc00008f430 0x7fc00013f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-c con 0x7fc00008f430 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc00013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-b con 0x7fc00013f940 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc00008a8f0 con 0x7fc00008eb20 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc00008ae20 con 0x7fc00008f430 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc00008c210 con 0x7fc00013f940 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc00645d640 10 monclient(hunting): authenticate will time out at 913.618955s 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc00008eb20 0x7fc00008eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc00013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc00008eb20 0x7fc00008eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36784/0 (socket says 10.20.193.7:36784) 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 -- 10.20.193.7:0/3171464841 learned_addr learned my addr 10.20.193.7:0/3171464841 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): get_auth_request con 0x7fc00008eb20 auth_method 0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): get_auth_request con 0x7fc00013f940 auth_method 0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbfff7fe640 1 --2- 10.20.193.7:0/3171464841 >> v2:10.20.193.61:3300/0 conn(0x7fc00008f430 0x7fc00013f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbfff7fe640 10 monclient(hunting): get_auth_request con 0x7fc00008f430 auth_method 0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbfff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbfff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbfff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient(hunting): handle_auth_done global_id 94389 payload 274 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 -- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 msgr2=0x7fc00013fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc00013fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 -- 10.20.193.7:0/3171464841 >> v2:10.20.193.61:3300/0 conn(0x7fc00008f430 msgr2=0x7fc00013f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 --2- 10.20.193.7:0/3171464841 >> v2:10.20.193.61:3300/0 conn(0x7fc00008f430 0x7fc00013f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient: _finish_hunting 0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 monclient: found mon.noname-a 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fbffffff640 1 -- 10.20.193.7:0/3171464841 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00005ff80 con 0x7fc00008eb20 2026-02-22T20:58:21.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.141+0000 7fc0049d3640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc00013fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008eb20 0x7fc00008eef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc000039cb0 tx=0x7fbfec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906a391d19f0b90f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 1 -- 10.20.193.7:0/3171464841 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b1070 con 0x7fc00008eb20 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: dump: 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: _finish_auth 0 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 1 -- 10.20.193.7:0/3171464841 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0ac450 con 0x7fc00008eb20 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 5 monclient: authenticate success, global_id 94389 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 1 -- 10.20.193.7:0/3171464841 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ac820 con 0x7fc00008eb20 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 4 set_mon_vals no callback set 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffeffd640 10 monclient: dump: 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.149 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: shutdown 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008eb20 msgr2=0x7fc00008eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008eb20 0x7fc00008eef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc000039cb0 tx=0x7fbfec01c4e0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/3171464841 shutdown_connections 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc00013fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- 10.20.193.7:0/3171464841 >> v2:10.20.193.61:3300/0 conn(0x7fc00008f430 0x7fc00013f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- 10.20.193.7:0/3171464841 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008eb20 0x7fc00008eef0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/3171464841 >> 10.20.193.7:0/3171464841 conn(0x7fc000038f20 msgr2=0x7fc0000392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/3171464841 shutdown_connections 2026-02-22T20:58:21.150 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/3171464841 wait complete. 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: build_initial_monmap 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: monmap: 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:21.151 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 Processor -- start 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- start start 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: init 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc00008eb20 0x7fc0001273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-b con 0x7fc00008eb20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-a con 0x7fc00008f430 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc000127e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): picked mon.noname-c con 0x7fc00013f940 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc00003a0c0 con 0x7fc00008f430 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc000039f40 con 0x7fc00008eb20 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc0001a2e70 con 0x7fc00013f940 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient(hunting): authenticate will time out at 913.622047s 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc000127e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36794/0 (socket says 10.20.193.7:36794) 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 -- 10.20.193.7:0/1079785244 learned_addr learned my addr 10.20.193.7:0/1079785244 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): get_auth_request con 0x7fc00008f430 auth_method 0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): get_auth_request con 0x7fc00013f940 auth_method 0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc00008eb20 0x7fc0001273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc0049d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 10 monclient(hunting): get_auth_request con 0x7fc00008eb20 auth_method 0 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient(hunting): handle_auth_done global_id 94392 payload 824 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 -- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 msgr2=0x7fc000127e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc000127e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.152 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 -- 10.20.193.7:0/1079785244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc00008eb20 msgr2=0x7fc0001273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc00008eb20 0x7fc0001273a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 monclient: found mon.noname-a 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 -- 10.20.193.7:0/1079785244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000087770 con 0x7fc00008f430 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbfff7fe640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006b80 tx=0x7fbff000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0017070 con 0x7fc00008f430 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: dump: 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: _finish_auth 0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: _check_auth_tickets 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff000ee50 con 0x7fc00008f430 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000f040 con 0x7fc00008f430 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 10 monclient: dump: 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffe7fc640 4 set_mon_vals no callback set 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 5 monclient: authenticate success, global_id 94392 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _renew_subs 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.153 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00013eb00 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _renew_subs 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00012b180 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00008eef0 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbff0012050 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 --2- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 0x7fbfd005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(205..205 src has 64..205) ==== 3503+0+0 (secure 0 0 0) 0x7fbff004e410 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 1 --2- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 0x7fbfd005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.145+0000 7fbffffff640 10 monclient: get_auth_request con 0x7fbfd003ab20 auth_method 0 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.149+0000 7fbffffff640 1 --2- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 0x7fbfd005afd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbfec01cd80 tx=0x7fbfec0ae040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.149+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fbff000a0d0 con 0x7fc00008f430 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.149+0000 7fbffcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:21.154 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.149+0000 7fbffcff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:21.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:58:21.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:58:21.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:21.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc00012a8e0 con 0x7fc00008f430 2026-02-22T20:58:21.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fbffcff9640 1 -- 10.20.193.7:0/1079785244 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fbff000a320 con 0x7fc00008f430 2026-02-22T20:58:21.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fbffcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:58:21.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fbffcff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:21.266 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.267 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=1586236162,config=3140514009,health=386265739,kv=2132859567,logm=1596680261}) 2026-02-22T20:58:21.267 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=13,kv=9,logm=59} crc {auth=3283035118,config=3140514009,health=2297920628,kv=3619945143,logm=2423868742}) 2026-02-22T20:58:21.267 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.267 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=1586236162,config=3140514009,health=386265739,kv=2132859567,logm=1596680261}) 2026-02-22T20:58:21.267 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=1586236162,config=3140514009,health=3906602911,kv=3802980238,logm=711671972}) 2026-02-22T20:58:21.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 msgr2=0x7fbfd005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 0x7fbfd005afd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbfec01cd80 tx=0x7fbfec0ae040 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 10 monclient: shutdown 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 msgr2=0x7fc0001278e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006b80 tx=0x7fbff000ec00 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 shutdown_connections 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc00013f940 0x7fc000127e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc00008f430 0x7fc0001278e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbfd003ab20 0x7fbfd005afd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 --2- 10.20.193.7:0/1079785244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc00008eb20 0x7fc0001273a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 >> 10.20.193.7:0/1079785244 conn(0x7fc000038f20 msgr2=0x7fc000087060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 shutdown_connections 2026-02-22T20:58:21.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:21.261+0000 7fc00645d640 1 -- 10.20.193.7:0/1079785244 wait complete. 2026-02-22T20:58:21.270 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.270 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701062994}) 2026-02-22T20:58:21.270 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=813396860}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701062994}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3363741297}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794157276}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=426784881}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794157276}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.261+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=933163215}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981238628}) 2026-02-22T20:58:21.271 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2806162304}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981238628}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1515278412}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=464975915}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2349418236}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=464975915}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2259206443}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3560454522}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3603189325}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3560454522}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3637150683}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2772379914}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2239076703}) 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.272 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2772379914}) 2026-02-22T20:58:21.273 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4009298449}) 2026-02-22T20:58:21.274 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.274 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=724787580}) 2026-02-22T20:58:21.274 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3162337358}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=724787580}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2160011422}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2296024297}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1466511818}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2296024297}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.265+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1005425236}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2542656857}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3181518397}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2542656857}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4147617039}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526712117}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=827703352}) 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.275 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526712117}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3601927814}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3772468730}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4176014770}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3772468730}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1965209708}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2234450759}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3280191961}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2234450759}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3756482717}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2004747880}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1578097705}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2004747880}) 2026-02-22T20:58:21.276 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=806892270}) 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392100143}) 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3145853032}) 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392100143}) 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3173941848}) 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.277 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=79,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8} crc {logm=2501137185,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3818970196}) 2026-02-22T20:58:21.278 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=80,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7} crc {logm=970556742,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2331941402}) 2026-02-22T20:58:21.278 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.278 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=79,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8} crc {logm=2501137185,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3818970196}) 2026-02-22T20:58:21.278 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.269+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=80,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7} crc {logm=3187325562,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2824836065}) 2026-02-22T20:58:21.278 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=6,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=73} crc {mgrstat=2912284739,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2506443525,osd_pg_creating=88275525,osd_snap=4133920409,osdmap=395299736}) 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=6,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=74} crc {mgrstat=2912284739,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=3646745830,osd_pg_creating=88275525,osd_snap=4133920409,osdmap=3259113278}) 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=6,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=73} crc {mgrstat=2912284739,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2506443525,osd_pg_creating=88275525,osd_snap=4133920409,osdmap=395299736}) 2026-02-22T20:58:21.279 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=6,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=73} crc {mgrstat=2912284739,mon_config_key=4115592523,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=88275525,osd_snap=4133920409,osdmap=961606163}) 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2272611293}) 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2828946058}) 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2272611293}) 2026-02-22T20:58:21.280 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.273+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1144661909}) 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2227182135}) 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=41} crc {osdmap=1381466785}) 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2227182135}) 2026-02-22T20:58:21.281 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:58:21.277+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=39} crc {osdmap=1343825392}) 2026-02-22T20:58:21.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:21.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:22.279 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:58:22.279 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:22.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: get_monmap_and_config 2026-02-22T20:58:22.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: monmap: 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:22.338444+0000 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:22.338444+0000 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:22.347 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 Processor -- start 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 -- start start 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: init 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f999c08c7a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-b con 0x7f999c090b70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f999c090f40 0x7f999c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-c con 0x7f999c090f40 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999c08d840 con 0x7f999c08c7a0 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f999c08db20 con 0x7f999c090f40 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f999c0851e0 con 0x7f999c090b70 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f99a0a1d640 10 monclient(hunting): authenticate will time out at 914.811326s 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999a575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f999c08c7a0 0x7f999c090460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33126/0 (socket says 10.20.193.7:33126) 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999a575640 1 -- 10.20.193.7:0/3222648461 learned_addr learned my addr 10.20.193.7:0/3222648461 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:22.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): get_auth_request con 0x7f999c090b70 auth_method 0 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999ad76640 1 --2- 10.20.193.7:0/3222648461 >> v2:10.20.193.61:3300/0 conn(0x7f999c090f40 0x7f999c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999ad76640 10 monclient(hunting): get_auth_request con 0x7f999c090f40 auth_method 0 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f999ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.350 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 1 -- 10.20.193.7:0/3222648461 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588339948 0 0) 0x7f999c08d840 con 0x7f999c08c7a0 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 10 monclient(hunting): _negotiate 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 10 monclient(hunting): my global_id is 94395 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999573640 1 -- 10.20.193.7:0/3222648461 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9988003620 con 0x7f999c08c7a0 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient(hunting): handle_auth_done global_id 104126 payload 274 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 -- 10.20.193.7:0/3222648461 >> v2:10.20.193.61:3300/0 conn(0x7f999c090f40 msgr2=0x7f999c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 --2- 10.20.193.7:0/3222648461 >> v2:10.20.193.61:3300/0 conn(0x7f999c090f40 0x7f999c1a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 -- 10.20.193.7:0/3222648461 >> v1:10.20.193.7:6789/0 conn(0x7f999c08c7a0 legacy=0x7f999c090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 monclient: found mon.noname-b 2026-02-22T20:58:22.351 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.333+0000 7f9999d74640 1 -- 10.20.193.7:0/3222648461 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c08ed90 con 0x7f999c090b70 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- 10.20.193.7:0/3222648461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1806e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9984004780 tx=0x7f998401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa0b21dad9ca9e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 1 -- 10.20.193.7:0/3222648461 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99840b0070 con 0x7f999c090b70 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: dump: 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.352 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 1 -- 10.20.193.7:0/3222648461 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99840ab600 con 0x7f999c090b70 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 1 -- 10.20.193.7:0/3222648461 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99840ab9b0 con 0x7f999c090b70 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 5 monclient: authenticate success, global_id 104126 2026-02-22T20:58:22.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 4 set_mon_vals no callback set 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999573640 10 monclient: dump: 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.354 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: shutdown 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/3222648461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 msgr2=0x7f999c1806e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/3222648461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1806e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9984004780 tx=0x7f998401c440 comp rx=0 tx=0).stop 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/3222648461 shutdown_connections 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/3222648461 >> v2:10.20.193.61:3300/0 conn(0x7f999c090f40 0x7f999c1a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/3222648461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1806e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/3222648461 >> 10.20.193.7:0/3222648461 conn(0x7f999c08e050 msgr2=0x7f999c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/3222648461 shutdown_connections 2026-02-22T20:58:22.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/3222648461 wait complete. 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: monmap: 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.356 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 Processor -- start 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- start start 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: init 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f999c08c7a0 0x7f999c1d9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-a con 0x7f999c08c7a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-c con 0x7f999c090b70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f999c090f40 0x7f999c059eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): picked mon.noname-b con 0x7f999c090f40 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f999c1a3d20 con 0x7f999c08c7a0 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f999c1a3ba0 con 0x7f999c090f40 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f999c1a3ea0 con 0x7f999c090b70 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient(hunting): authenticate will time out at 914.815329s 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f999c08c7a0 0x7f999c1d9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:43524/0 (socket says 10.20.193.7:43524) 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 -- 10.20.193.7:0/1118721599 learned_addr learned my addr 10.20.193.7:0/1118721599 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): get_auth_request con 0x7f999c090b70 auth_method 0 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): get_auth_request con 0x7f999c08c7a0 auth_method 0 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient(hunting): handle_auth_done global_id 104129 payload 824 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f999ad76640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f999c090f40 0x7f999c059eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 -- 10.20.193.7:0/1118721599 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f999c090f40 msgr2=0x7f999c059eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f999c090f40 0x7f999c059eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 -- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f999c08c7a0 msgr2=0x7f999c1d9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f999c08c7a0 0x7f999c1d9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 monclient: found mon.noname-c 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 -- 10.20.193.7:0/1118721599 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c05b690 con 0x7f999c090b70 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9999d74640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99840ac9f0 tx=0x7f99840191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99840b9020 con 0x7f999c090b70 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: dump: 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.361 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99840acce0 con 0x7f999c090b70 2026-02-22T20:58:22.362 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99840b0040 con 0x7f999c090b70 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9982ffd640 10 monclient: dump: 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.363 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f9998d72640 4 set_mon_vals no callback set 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 5 monclient: authenticate success, global_id 104129 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _renew_subs 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999c05d410 con 0x7f999c090b70 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _renew_subs 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.337+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f999c05d9d0 con 0x7f999c090b70 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f99a0a1d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f99a0a1d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f99a0a1d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999c08d840 con 0x7f999c090b70 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9984003910 con 0x7f999c090b70 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 1 --2- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 0x7f996805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(206..206 src has 64..206) ==== 3897+0+0 (secure 0 0 0) 0x7f99840e8c10 con 0x7f999c090b70 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f999a575640 1 --2- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 0x7f996805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f999a575640 10 monclient: get_auth_request con 0x7f996803ab20 auth_method 0 2026-02-22T20:58:22.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f999a575640 1 --2- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 0x7f996805afd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9990007fd0 tx=0x7f9990009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f99840c3070 con 0x7f999c090b70 2026-02-22T20:58:22.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.341+0000 7f9982ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: starting. 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21442 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: created object 0... 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: created object 25... 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: created object 49... 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: finishing. 2026-02-22T20:58:22.412 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21443]: shutting down. 2026-02-22T20:58:22.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:22.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:22.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.461 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f999c05fc70 con 0x7f999c090b70 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f9982ffd640 1 -- 10.20.193.7:0/1118721599 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f9984016150 con 0x7f999c090b70 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f9982ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f9982ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 msgr2=0x7f996805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 0x7f996805afd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9990007fd0 tx=0x7f9990009040 comp rx=0 tx=0).stop 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 10 monclient: shutdown 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.462 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 msgr2=0x7f999c1d9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99840ac9f0 tx=0x7f99840191e0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 shutdown_connections 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> v2:10.20.193.61:6800/2336688312 conn(0x7f996803ab20 0x7f996805afd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f999c090f40 0x7f999c059eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f999c090b70 0x7f999c1d9a90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 --2- 10.20.193.7:0/1118721599 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f999c08c7a0 0x7f999c1d9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 >> 10.20.193.7:0/1118721599 conn(0x7f999c08e050 msgr2=0x7f999c088b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 shutdown_connections 2026-02-22T20:58:22.463 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.457+0000 7f99a0a1d640 1 -- 10.20.193.7:0/1118721599 wait complete. 2026-02-22T20:58:22.474 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:58:22.474 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:58:22.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:58:22.474 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: get_monmap_and_config 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: monmap: 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:22.542745+0000 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:22.542745+0000 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 Processor -- start 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 -- start start 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: init 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f577013f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f577013fd70 0x7f57701807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-c con 0x7f577013fd70 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:22.549 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5770180d00 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577008fd70 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5770092bc0 con 0x7f577013f290 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f577008e1f0 con 0x7f577013fd70 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f57758bc640 10 monclient(hunting): authenticate will time out at 915.015660s 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f5770180d00 0x7f57701a10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33138/0 (socket says 10.20.193.7:33138) 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576f7fe640 1 -- 10.20.193.7:0/1301964834 learned_addr learned my addr 10.20.193.7:0/1301964834 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576e7fc640 1 --2- 10.20.193.7:0/1301964834 >> v2:10.20.193.61:3300/0 conn(0x7f577013fd70 0x7f57701807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576e7fc640 10 monclient(hunting): get_auth_request con 0x7f577013fd70 auth_method 0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.537+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136970621 0 0) 0x7f5760002ca0 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): _negotiate 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): my global_id is 94401 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f575c003620 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3965449355 0 0) 0x7f575c003620 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 >> v2:10.20.193.61:3300/0 conn(0x7f577013fd70 msgr2=0x7f57701807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 --2- 10.20.193.7:0/1301964834 >> v2:10.20.193.61:3300/0 conn(0x7f577013fd70 0x7f57701807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 >> v1:10.20.193.61:6789/0 conn(0x7f577013f290 legacy=0x7f577013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577008e6d0 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f57600033b0 con 0x7f5770180d00 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: dump: 2026-02-22T20:58:22.550 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 >> v1:10.20.193.7:6789/0 conn(0x7f5770180d00 legacy=0x7f57701a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 0x7f575c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): picked mon.c con 0x7f575c003b70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f575c0048d0 0x7f575c004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): picked mon.a con 0x7f575c0048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c0052f0 0x7f575c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): picked mon.b con 0x7f575c0052f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f577008e1f0 con 0x7f575c0048d0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f575c066230 con 0x7f575c0052f0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f575c066430 con 0x7f575c003b70 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f575c0048d0 0x7f575c004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): get_auth_request con 0x7f575c0048d0 auth_method 0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 0x7f575c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.551 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): get_auth_request con 0x7f575c003b70 auth_method 0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c0052f0 0x7f575c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): get_auth_request con 0x7f575c0052f0 auth_method 0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): handle_auth_done global_id 94401 payload 293 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 -- 10.20.193.7:0/1301964834 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c0052f0 msgr2=0x7f575c065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c0052f0 0x7f575c065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 -- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f575c0048d0 msgr2=0x7f575c004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f575c0048d0 0x7f575c004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 monclient: found mon.c 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 -- 10.20.193.7:0/1301964834 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c003620 con 0x7f575c003b70 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 1 -- 10.20.193.7:0/1301964834 reap_dead start 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 5 monclient: authenticate success, global_id 94401 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f575c0048d0 0x7f575c004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 0x7f575c003f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5764007fd0 tx=0x7f576401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2129e7e007c54c11 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764002d90 con 0x7f575c003b70 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: dump: 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.552 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5764006af0 con 0x7f575c003b70 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 1 -- 10.20.193.7:0/1301964834 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640a86d0 con 0x7f575c003b70 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576dffb640 10 monclient: dump: 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 4 set_mon_vals no callback set 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: shutdown 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 msgr2=0x7f575c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 0x7f575c003f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5764007fd0 tx=0x7f576401ecb0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/1301964834 shutdown_connections 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 --2- 10.20.193.7:0/1301964834 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f575c003b70 0x7f575c003f40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/1301964834 >> 10.20.193.7:0/1301964834 conn(0x7f5770093df0 msgr2=0x7f57700902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/1301964834 shutdown_connections 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/1301964834 wait complete. 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: monmap: 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:22.553 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 Processor -- start 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- start start 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: init 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c003b70 0x7f57701807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-b con 0x7f575c003b70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-c con 0x7f577010c520 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577012ce40 0x7f577012d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): picked mon.noname-a con 0x7f577012ce40 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5770090de0 con 0x7f577012ce40 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5770090c60 con 0x7f575c003b70 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f577013f660 con 0x7f577010c520 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient(hunting): authenticate will time out at 915.019269s 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577012ce40 0x7f577012d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:43540/0 (socket says 10.20.193.7:43540) 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 -- 10.20.193.7:0/3466805235 learned_addr learned my addr 10.20.193.7:0/3466805235 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): get_auth_request con 0x7f577010c520 auth_method 0 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): get_auth_request con 0x7f577012ce40 auth_method 0 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.554 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c003b70 0x7f57701807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): get_auth_request con 0x7f575c003b70 auth_method 0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient(hunting): handle_auth_done global_id 104132 payload 824 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c003b70 msgr2=0x7f57701807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f575c003b70 0x7f57701807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577012ce40 msgr2=0x7f577012d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577012ce40 0x7f577012d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 monclient: found mon.noname-c 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577010b9c0 con 0x7f577010c520 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576f7fe640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577012ce40 0x7f577012d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576e7fc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5758011bd0 tx=0x7f5758011cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758019070 con 0x7f577010c520 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: dump: 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758004240 con 0x7f577010c520 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.555 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57580096f0 con 0x7f577010c520 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f5747fff640 10 monclient: dump: 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 5 monclient: authenticate success, global_id 104132 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f576d7fa640 4 set_mon_vals no callback set 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _renew_subs 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577008a9e0 con 0x7f577010c520 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _renew_subs 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.541+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f577010d480 con 0x7f577010c520 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f57758bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f57758bc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 0x7f577010a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f577013ef20 con 0x7f577010a070 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f575800f820 con 0x7f577010c520 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 0x7f577010a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient: get_auth_request con 0x7f577010a070 auth_method 0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 --2- 10.20.193.7:0/3466805235 >> v2:10.20.193.61:6800/2336688312 conn(0x7f574003ab20 0x7f574005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7f575804ec60 con 0x7f577010c520 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 10 monclient(hunting): handle_auth_done global_id 94407 payload 824 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f577013f9f0 con 0x7f577010a070 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576effd640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 0x7f577010a440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5764002810 tx=0x7f576401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.556 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576f7fe640 1 --2- 10.20.193.7:0/3466805235 >> v2:10.20.193.61:6800/2336688312 conn(0x7f574003ab20 0x7f574005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576f7fe640 10 monclient: get_auth_request con 0x7f574003ab20 auth_method 0 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640bf020 con 0x7f577010a070 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 10 monclient: dump: 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f5764007b70 con 0x7f577010a070 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 msgr2=0x7f577010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 0x7f577010a440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5764002810 tx=0x7f576401ba50 comp rx=0 tx=0).stop 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 msgr2=0x7f577010a440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f5747fff640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a070 0x7f577010a440 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5764002810 tx=0x7f576401ba50 comp rx=0 tx=0).stop 2026-02-22T20:58:22.557 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.545+0000 7f576f7fe640 1 --2- 10.20.193.7:0/3466805235 >> v2:10.20.193.61:6800/2336688312 conn(0x7f574003ab20 0x7f574005afd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5770140270 tx=0x7f5760002cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 0x7f57700888b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f577010d7e0 con 0x7f577010a980 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 0x7f57700888b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient: get_auth_request con 0x7f577010a980 auth_method 0 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 10 monclient(hunting): handle_auth_done global_id 94410 payload 824 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 1 -- 10.20.193.7:0/3466805235 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f577005fb50 con 0x7f577010a980 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576effd640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 0x7f57700888b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5764002410 tx=0x7f575c005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640bf040 con 0x7f577010a980 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 10 monclient: dump: 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.558 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f5764007740 con 0x7f577010a980 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 msgr2=0x7f57700888b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 0x7f57700888b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5764002410 tx=0x7f575c005900 comp rx=0 tx=0).stop 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 msgr2=0x7f57700888b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f5747fff640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f577010a980 0x7f57700888b0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5764002410 tx=0x7f575c005900 comp rx=0 tx=0).stop 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 75234, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 6, 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.559 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:22.560 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.561 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:22.562 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.563 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 >> v2:10.20.193.61:6800/2336688312 conn(0x7f574003ab20 msgr2=0x7f574005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 --2- 10.20.193.7:0/3466805235 >> v2:10.20.193.61:6800/2336688312 conn(0x7f574003ab20 0x7f574005afd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5770140270 tx=0x7f5760002cc0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 10 monclient: shutdown 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 msgr2=0x7f577012c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f576f7fe640 1 -- 10.20.193.7:0/3466805235 reap_dead start 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5758011bd0 tx=0x7f5758011cc0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.564 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 shutdown_connections 2026-02-22T20:58:22.565 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 --2- 10.20.193.7:0/3466805235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f577010c520 0x7f577012c900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.565 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 >> 10.20.193.7:0/3466805235 conn(0x7f5770093df0 msgr2=0x7f5770055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.565 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 shutdown_connections 2026-02-22T20:58:22.565 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.549+0000 7f57758bc640 1 -- 10.20.193.7:0/3466805235 wait complete. 2026-02-22T20:58:22.565 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:22.565 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:58:22.565 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:58:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: get_monmap_and_config 2026-02-22T20:58:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: monmap: 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:22.634103+0000 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:22.634103+0000 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 Processor -- start 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 -- start start 2026-02-22T20:58:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: init 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f734413f780 0x7f734413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-c con 0x7f734413f780 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7344055a70 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f73440565b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7344091820 con 0x7f73440565b0 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7344091b00 con 0x7f7344055a70 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f734413f110 con 0x7f734413f780 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7343fff640 10 monclient(hunting): authenticate will time out at 915.107095s 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f73440565b0 0x7f73441a1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33154/0 (socket says 10.20.193.7:33154) 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 -- 10.20.193.7:0/2358833577 learned_addr learned my addr 10.20.193.7:0/2358833577 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 1 --2- 10.20.193.7:0/2358833577 >> v2:10.20.193.61:3300/0 conn(0x7f734413f780 0x7f734413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): get_auth_request con 0x7f734413f780 auth_method 0 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998703562 0 0) 0x7f7344091820 con 0x7f73440565b0 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:58:22.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): my global_id is 94413 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7330003620 con 0x7f73440565b0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498385517 0 0) 0x7f7330003620 con 0x7f73440565b0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 >> v2:10.20.193.61:3300/0 conn(0x7f734413f780 msgr2=0x7f734413fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 --2- 10.20.193.7:0/2358833577 >> v2:10.20.193.61:3300/0 conn(0x7f734413f780 0x7f734413fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 >> v1:10.20.193.61:6789/0 conn(0x7f7344055a70 legacy=0x7f7344055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440931e0 con 0x7f73440565b0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f73340031e0 con 0x7f73440565b0 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: dump: 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 >> v1:10.20.193.7:6789/0 conn(0x7f73440565b0 legacy=0x7f73441a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:58:22.647 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7330003b50 0x7f7330003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): picked mon.b con 0x7f7330003b50 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f73300048d0 0x7f7330004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): picked mon.c con 0x7f73300048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f7330065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): picked mon.a con 0x7f73300053a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7330066260 con 0x7f73300053a0 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f7330066410 con 0x7f7330003b50 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7330066610 con 0x7f73300048d0 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7341ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f7330065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): get_auth_request con 0x7f73300053a0 auth_method 0 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73427fc640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f73300048d0 0x7f7330004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7330003b50 0x7f7330003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73427fc640 10 monclient(hunting): get_auth_request con 0x7f73300048d0 auth_method 0 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73427fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): get_auth_request con 0x7f7330003b50 auth_method 0 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f7342ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient(hunting): handle_auth_done global_id 94413 payload 293 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 -- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f73300048d0 msgr2=0x7f7330004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f73300048d0 0x7f7330004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 -- 10.20.193.7:0/2358833577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7330003b50 msgr2=0x7f7330003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7330003b50 0x7f7330003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 monclient: found mon.a 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 1 -- 10.20.193.7:0/2358833577 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7330003620 con 0x7f73300053a0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.629+0000 7f73437fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 5 monclient: authenticate success, global_id 94413 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 1 -- 10.20.193.7:0/2358833577 reap_dead start 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f7330065a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7334003a40 tx=0x7f733401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8eccf34a2bad0f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733400a390 con 0x7f73300053a0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: dump: 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.650 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73340ac640 con 0x7f73300053a0 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 1 -- 10.20.193.7:0/2358833577 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73340aca30 con 0x7f73300053a0 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 4 set_mon_vals no callback set 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7341ffb640 10 monclient: dump: 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.651 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: shutdown 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 msgr2=0x7f7330065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f7330065a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7334003a40 tx=0x7f733401d220 comp rx=0 tx=0).stop 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/2358833577 shutdown_connections 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- 10.20.193.7:0/2358833577 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f7330065a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/2358833577 >> 10.20.193.7:0/2358833577 conn(0x7f73440906f0 msgr2=0x7f7344090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/2358833577 shutdown_connections 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/2358833577 wait complete. 2026-02-22T20:58:22.652 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: monmap: 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 Processor -- start 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- start start 2026-02-22T20:58:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: init 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f734408c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-a con 0x7f73300053a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f734412b9a0 0x7f734412ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-b con 0x7f734412b9a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412be10 0x7f734412ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): picked mon.noname-c con 0x7f734412be10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f734413fb50 con 0x7f73300053a0 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f7344087300 con 0x7f734412b9a0 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f734413fcd0 con 0x7f734412be10 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): authenticate will time out at 915.110311s 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f734408c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f734408c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36866/0 (socket says 10.20.193.7:36866) 2026-02-22T20:58:22.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 -- 10.20.193.7:0/3001096586 learned_addr learned my addr 10.20.193.7:0/3001096586 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): get_auth_request con 0x7f73300053a0 auth_method 0 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412be10 0x7f734412ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient(hunting): get_auth_request con 0x7f734412be10 auth_method 0 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient(hunting): handle_auth_done global_id 94416 payload 824 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f734412b9a0 0x7f734412ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412be10 msgr2=0x7f734412ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412be10 0x7f734412ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f734412b9a0 msgr2=0x7f734412ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f734412b9a0 0x7f734412ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.655 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 monclient: found mon.noname-a 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734408cc30 con 0x7f73300053a0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412be10 0x7f734412ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7342ffd640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f734408c240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73380116d0 tx=0x7f7338011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733800f9c0 con 0x7f73300053a0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: dump: 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.656 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 5 monclient: authenticate success, global_id 94416 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733800fb60 con 0x7f73300053a0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _renew_subs 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734410a7a0 con 0x7f73300053a0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338015460 con 0x7f73300053a0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: dump: 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.657 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73417fa640 4 set_mon_vals no callback set 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _renew_subs 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734408d9f0 con 0x7f73300053a0 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 0x7f7344088ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f734408c780 con 0x7f734412f4c0 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 0x7f7344088ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.658 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient: get_auth_request con 0x7f734412f4c0 auth_method 0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 10 monclient(hunting): handle_auth_done global_id 104138 payload 824 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f734412f890 con 0x7f734412f4c0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73427fc640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 0x7f7344088ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73440877a0 tx=0x7f732c011910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7338015600 con 0x7f73300053a0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 --2- 10.20.193.7:0/3001096586 >> v2:10.20.193.61:6800/2336688312 conn(0x7f731003aa80 0x7f731005af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c002d80 con 0x7f734412f4c0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: dump: 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.659 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7f733804f2e0 con 0x7f73300053a0 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f732c0068d0 con 0x7f734412f4c0 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 msgr2=0x7f7344088ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 0x7f7344088ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73440877a0 tx=0x7f732c011910 comp rx=0 tx=0).stop 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 msgr2=0x7f7344088ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73237fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f734412f4c0 0x7f7344088ef0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73440877a0 tx=0x7f732c011910 comp rx=0 tx=0).stop 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 1 --2- 10.20.193.7:0/3001096586 >> v2:10.20.193.61:6800/2336688312 conn(0x7f731003aa80 0x7f731005af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.660 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.633+0000 7f73437fe640 10 monclient: get_auth_request con 0x7f731003aa80 auth_method 0 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73437fe640 1 --2- 10.20.193.7:0/3001096586 >> v2:10.20.193.61:6800/2336688312 conn(0x7f731003aa80 0x7f731005af30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7334002790 tx=0x7f7334007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 0x7f7344089830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7344055e40 con 0x7f7344089430 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 0x7f7344089830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient: get_auth_request con 0x7f7344089430 auth_method 0 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 10 monclient(hunting): handle_auth_done global_id 104141 payload 824 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 1 -- 10.20.193.7:0/3001096586 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7344056b30 con 0x7f7344089430 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73427fc640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 0x7f7344089830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f732c007000 tx=0x7f732c002a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c01eb10 con 0x7f7344089430 2026-02-22T20:58:22.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 10 monclient: dump: 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7f732c01eb10 con 0x7f7344089430 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 msgr2=0x7f7344089830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 0x7f7344089830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f732c007000 tx=0x7f732c002a30 comp rx=0 tx=0).stop 2026-02-22T20:58:22.662 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 msgr2=0x7f7344089830 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73237fe640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7344089430 0x7f7344089830 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f732c007000 tx=0x7f732c002a30 comp rx=0 tx=0).stop 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:22.663 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 12403, 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 6, 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.664 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.665 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:22.666 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.667 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:22.668 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:22.669 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:22.670 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:22.671 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 >> v2:10.20.193.61:6800/2336688312 conn(0x7f731003aa80 msgr2=0x7f731005af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 --2- 10.20.193.7:0/3001096586 >> v2:10.20.193.61:6800/2336688312 conn(0x7f731003aa80 0x7f731005af30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7334002790 tx=0x7f7334007040 comp rx=0 tx=0).stop 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 10 monclient: shutdown 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 msgr2=0x7f734408c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 --2- 10.20.193.7:0/3001096586 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f73300053a0 0x7f734408c240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73380116d0 tx=0x7f7338011b90 comp rx=0 tx=0).stop 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73437fe640 1 -- 10.20.193.7:0/3001096586 reap_dead start 2026-02-22T20:58:22.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f73437fe640 1 -- 10.20.193.7:0/3001096586 reap_dead start 2026-02-22T20:58:22.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 shutdown_connections 2026-02-22T20:58:22.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 >> 10.20.193.7:0/3001096586 conn(0x7f73440906f0 msgr2=0x7f734411f090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.637+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 shutdown_connections 2026-02-22T20:58:22.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.641+0000 7f7343fff640 1 -- 10.20.193.7:0/3001096586 wait complete. 2026-02-22T20:58:22.673 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:22.673 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:58:22.673 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: get_monmap_and_config 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: monmap: 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:22.742158+0000 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:22.742158+0000 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:22.742 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:22.743 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:22.743 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:22.743 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 Processor -- start 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 -- start start 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: init 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff02c091c70 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 0x7ff02c1808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-b con 0x7ff02c1604e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 0x7ff02c1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-c con 0x7ff02c180e00 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff02c08e6a0 con 0x7ff02c091c70 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff02c08e910 con 0x7ff02c180e00 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff02c08ebf0 con 0x7ff02c1604e0 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff03193e640 10 monclient(hunting): authenticate will time out at 915.215038s 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02affd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff02c091c70 0x7ff02c092040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33156/0 (socket says 10.20.193.7:33156) 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02affd640 1 -- 10.20.193.7:0/4250383904 learned_addr learned my addr 10.20.193.7:0/4250383904 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/4250383904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 0x7ff02c1808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request con 0x7ff02c1604e0 auth_method 0 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 1 --2- 10.20.193.7:0/4250383904 >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 0x7ff02c1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 10 monclient(hunting): get_auth_request con 0x7ff02c180e00 auth_method 0 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 1 -- 10.20.193.7:0/4250383904 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147233857 0 0) 0x7ff02c08e6a0 con 0x7ff02c091c70 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 10 monclient(hunting): my global_id is 94419 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff029ffb640 1 -- 10.20.193.7:0/4250383904 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff018003620 con 0x7ff02c091c70 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_done global_id 104144 payload 274 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 -- 10.20.193.7:0/4250383904 >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 msgr2=0x7ff02c1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/4250383904 >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 0x7ff02c1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 -- 10.20.193.7:0/4250383904 >> v1:10.20.193.7:6789/0 conn(0x7ff02c091c70 legacy=0x7ff02c092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 monclient: found mon.noname-b 2026-02-22T20:58:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02a7fc640 1 -- 10.20.193.7:0/4250383904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c08eed0 con 0x7ff02c1604e0 2026-02-22T20:58:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.737+0000 7ff02b7fe640 1 --2- 10.20.193.7:0/4250383904 >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 0x7ff02c1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/4250383904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 0x7ff02c1808c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff014004780 tx=0x7ff01401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140eb2af51afcb75 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 1 -- 10.20.193.7:0/4250383904 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b0070 con 0x7ff02c1604e0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: dump: 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 1 -- 10.20.193.7:0/4250383904 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0140ab600 con 0x7ff02c1604e0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 5 monclient: authenticate success, global_id 104144 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 1 -- 10.20.193.7:0/4250383904 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140ab9b0 con 0x7ff02c1604e0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 4 set_mon_vals no callback set 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff029ffb640 10 monclient: dump: 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.748 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: shutdown 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/4250383904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 msgr2=0x7ff02c1808c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- 10.20.193.7:0/4250383904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 0x7ff02c1808c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff014004780 tx=0x7ff01401c440 comp rx=0 tx=0).stop 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/4250383904 shutdown_connections 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- 10.20.193.7:0/4250383904 >> v2:10.20.193.61:3300/0 conn(0x7ff02c180e00 0x7ff02c1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- 10.20.193.7:0/4250383904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c1604e0 0x7ff02c1808c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/4250383904 >> 10.20.193.7:0/4250383904 conn(0x7ff02c093d80 msgr2=0x7ff02c090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/4250383904 shutdown_connections 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/4250383904 wait complete. 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: monmap: 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 Processor -- start 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- start start 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: init 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-a con 0x7ff02c091c70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c1604e0 0x7ff02c17fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-b con 0x7ff02c1604e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c180e00 0x7ff02c1801c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): picked mon.noname-c con 0x7ff02c180e00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c1a42d0 con 0x7ff02c091c70 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c1a4150 con 0x7ff02c1604e0 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff02c1a4450 con 0x7ff02c180e00 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): authenticate will time out at 915.218590s 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36882/0 (socket says 10.20.193.7:36882) 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 -- 10.20.193.7:0/2506627335 learned_addr learned my addr 10.20.193.7:0/2506627335 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): get_auth_request con 0x7ff02c091c70 auth_method 0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c180e00 0x7ff02c1801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): get_auth_request con 0x7ff02c180e00 auth_method 0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c1604e0 0x7ff02c17fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request con 0x7ff02c1604e0 auth_method 0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient(hunting): handle_auth_done global_id 94422 payload 824 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c180e00 msgr2=0x7ff02c1801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff02c180e00 0x7ff02c1801c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c1604e0 msgr2=0x7ff02c17fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c1604e0 0x7ff02c17fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 monclient: found mon.noname-a 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c163010 con 0x7ff02c091c70 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02affd640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c700 tx=0x7ff02000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020017070 con 0x7ff02c091c70 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: dump: 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff020005bb0 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020007070 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 10 monclient: dump: 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff0297fa640 4 set_mon_vals no callback set 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 5 monclient: authenticate success, global_id 94422 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _renew_subs 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02c08d930 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _renew_subs 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02c1621a0 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 0x7ff02c087760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c08b460 con 0x7ff02c10f5e0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff020007210 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 0x7ff02c087760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 --2- 10.20.193.7:0/2506627335 >> v2:10.20.193.61:6800/2336688312 conn(0x7feffc03ab20 0x7feffc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient: get_auth_request con 0x7ff02c10f5e0 auth_method 0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7ff02004df80 con 0x7ff02c091c70 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.741+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02b7fe640 1 --2- 10.20.193.7:0/2506627335 >> v2:10.20.193.61:6800/2336688312 conn(0x7feffc03ab20 0x7feffc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02b7fe640 10 monclient: get_auth_request con 0x7feffc03ab20 auth_method 0 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_done global_id 74863 payload 824 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02a7fc640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff02c092040 con 0x7ff02c10f5e0 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 0x7ff02c087760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff01401ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b0040 con 0x7ff02c10f5e0 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 10 monclient: dump: 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.752 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff02b7fe640 1 --2- 10.20.193.7:0/2506627335 >> v2:10.20.193.61:6800/2336688312 conn(0x7feffc03ab20 0x7feffc05afd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff02c08a0c0 tx=0x7ff01c009820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7ff014009440 con 0x7ff02c10f5e0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 msgr2=0x7ff02c087760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 0x7ff02c087760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff01401ac80 comp rx=0 tx=0).stop 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 msgr2=0x7ff02c087760 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.745+0000 7ff003fff640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f5e0 0x7ff02c087760 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff01401ac80 comp rx=0 tx=0).stop 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 0x7ff02c087ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c162df0 con 0x7ff02c10f9b0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 0x7ff02c087ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient: get_auth_request con 0x7ff02c10f9b0 auth_method 0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 10 monclient(hunting): handle_auth_done global_id 74866 payload 824 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 1 -- 10.20.193.7:0/2506627335 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff02c092890 con 0x7ff02c10f9b0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02a7fc640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 0x7ff02c087ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff0140191e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b0040 con 0x7ff02c10f9b0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 10 monclient: dump: 2026-02-22T20:58:22.753 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7ff0140bf650 con 0x7ff02c10f9b0 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 msgr2=0x7ff02c087ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 0x7ff02c087ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff0140191e0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 msgr2=0x7ff02c087ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff003fff640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff02c10f9b0 0x7ff02c087ca0 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aaf0 tx=0x7ff0140191e0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 54, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 170140, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 6, 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.754 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:22.755 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.756 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 >> v2:10.20.193.61:6800/2336688312 conn(0x7feffc03ab20 msgr2=0x7feffc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 --2- 10.20.193.7:0/2506627335 >> v2:10.20.193.61:6800/2336688312 conn(0x7feffc03ab20 0x7feffc05afd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff02c08a0c0 tx=0x7ff01c009820 comp rx=0 tx=0).stop 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 10 monclient: shutdown 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 msgr2=0x7ff02c17f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c700 tx=0x7ff02000cbc0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff02b7fe640 1 -- 10.20.193.7:0/2506627335 reap_dead start 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 shutdown_connections 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 --2- 10.20.193.7:0/2506627335 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff02c091c70 0x7ff02c17f740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 >> 10.20.193.7:0/2506627335 conn(0x7ff02c093d80 msgr2=0x7ff02c08b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 shutdown_connections 2026-02-22T20:58:22.759 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.749+0000 7ff03193e640 1 -- 10.20.193.7:0/2506627335 wait complete. 2026-02-22T20:58:22.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:58:22.762 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-22T20:58:22.762 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:58:22.762 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-22T20:58:22.762 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-22T20:58:22.762 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T20:58:22.762 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:58:22.775 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:58:22.775 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:58:22.775 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:22.775 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:22.775 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:22.776 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:22.776 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:22.776 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:22.778 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:58:22.779 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:58:22.780 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:58:22.780 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T20:58:22.780 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:58:22.781 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:22.782 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.782 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:58:22.782 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:58:22.783 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:58:22.784 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:58:22.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: get_monmap_and_config 2026-02-22T20:58:22.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: monmap: 2026-02-22T20:58:22.853 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:22.849295+0000 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:22.849295+0000 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 Processor -- start 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 -- start start 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: init 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6be413cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6be413d9d0 0x7f6be417e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-c con 0x7f6be413d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6be417e9a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be405d510 con 0x7f6be417e9a0 2026-02-22T20:58:22.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be408b800 con 0x7f6be413cef0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f6be408a720 con 0x7f6be413d9d0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 10 monclient(hunting): authenticate will time out at 915.322187s 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be2ffd640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f6be413cef0 legacy=0x7f6be413d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f6be413d9d0 msgr2=0x7f6be417e460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6be413d9d0 0x7f6be417e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f6be417e9a0 0x7f6be419ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33170/0 (socket says 10.20.193.7:33170) 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 1 -- 10.20.193.7:0/3404467194 learned_addr learned my addr 10.20.193.7:0/3404467194 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860565908 0 0) 0x7f6be405d510 con 0x7f6be417e9a0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): my global_id is 94425 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd0003620 con 0x7f6be417e9a0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1661021362 0 0) 0x7f6bd0003620 con 0x7f6be417e9a0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 >> v2:10.20.193.61:3300/0 conn(0x7f6be413d9d0 msgr2=0x7f6be417e460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 --2- 10.20.193.7:0/3404467194 >> v2:10.20.193.61:3300/0 conn(0x7f6be413d9d0 0x7f6be417e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 >> v1:10.20.193.61:6789/0 conn(0x7f6be413cef0 legacy=0x7f6be413d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:58:22.855 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be408aa00 con 0x7f6be417e9a0 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f6bd40031d0 con 0x7f6be417e9a0 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: dump: 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 >> v1:10.20.193.7:6789/0 conn(0x7f6be417e9a0 legacy=0x7f6be419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:22.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd0003b20 0x7f6bd0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): picked mon.b con 0x7f6bd0003b20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 0x7f6bd0004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): picked mon.a con 0x7f6bd00048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6bd0045a80 0x7f6bd0065e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): picked mon.c con 0x7f6bd0045a80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6be408a720 con 0x7f6bd00048d0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd0066420 con 0x7f6bd0003b20 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd0066620 con 0x7f6bd0045a80 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 0x7f6bd0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be2ffd640 1 -- 10.20.193.7:0/3404467194 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd0003b20 msgr2=0x7f6bd0003f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6bd0045a80 0x7f6bd0065e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): get_auth_request con 0x7f6bd00048d0 auth_method 0 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be2ffd640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd0003b20 0x7f6bd0003f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:22.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): get_auth_request con 0x7f6bd0045a80 auth_method 0 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient(hunting): handle_auth_done global_id 94425 payload 293 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 -- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6bd0045a80 msgr2=0x7f6bd0065e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6bd0045a80 0x7f6bd0065e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 -- 10.20.193.7:0/3404467194 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd0003b20 msgr2=0x7f6bd0003f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd0003b20 0x7f6bd0003f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 monclient: found mon.a 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 1 -- 10.20.193.7:0/3404467194 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd0003620 con 0x7f6bd00048d0 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be37fe640 1 -- 10.20.193.7:0/3404467194 reap_dead start 2026-02-22T20:58:22.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 5 monclient: authenticate success, global_id 94425 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.845+0000 7f6be986d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 0x7f6bd0004d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009da0 tx=0x7f6bcc01cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323fa5f418528b5f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0099a0 con 0x7f6bd00048d0 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: dump: 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0a9070 con 0x7f6bd00048d0 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 1 -- 10.20.193.7:0/3404467194 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0a5830 con 0x7f6bd00048d0 2026-02-22T20:58:22.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be1ffb640 10 monclient: dump: 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 4 set_mon_vals no callback set 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: shutdown 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 msgr2=0x7f6bd0004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 0x7f6bd0004d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009da0 tx=0x7f6bcc01cb10 comp rx=0 tx=0).stop 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/3404467194 shutdown_connections 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 --2- 10.20.193.7:0/3404467194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6bd00048d0 0x7f6bd0004d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/3404467194 >> 10.20.193.7:0/3404467194 conn(0x7f6be408f860 msgr2=0x7f6be408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/3404467194 shutdown_connections 2026-02-22T20:58:22.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/3404467194 wait complete. 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: build_initial_monmap 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: monmap: 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.863 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 Processor -- start 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- start start 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: init 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 0x7f6be4150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-b con 0x7f6bd00048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-a con 0x7f6be4138d90 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 0x7f6be4127e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): picked mon.noname-c con 0x7f6be41279d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6be413a560 con 0x7f6be4138d90 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6be413a3e0 con 0x7f6bd00048d0 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6be413a6e0 con 0x7f6be41279d0 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient(hunting): authenticate will time out at 915.326726s 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be2ffd640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 msgr2=0x7f6be4150bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be2ffd640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 0x7f6be4150bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:22.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 0x7f6be4127e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36902/0 (socket says 10.20.193.7:36902) 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 0x7f6be4127e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:43608/0 (socket says 10.20.193.7:43608) 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 -- 10.20.193.7:0/2597248032 learned_addr learned my addr 10.20.193.7:0/2597248032 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): get_auth_request con 0x7f6be4138d90 auth_method 0 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): get_auth_request con 0x7f6be41279d0 auth_method 0 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient(hunting): handle_auth_done global_id 94428 payload 824 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 -- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 msgr2=0x7f6be4127e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 0x7f6be4127e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 -- 10.20.193.7:0/2597248032 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 msgr2=0x7f6be4150bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 0x7f6be4150bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:22.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 monclient: found mon.noname-a 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 -- 10.20.193.7:0/2597248032 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be4129440 con 0x7f6be4138d90 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be27fc640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc01cff0 tx=0x7f6bd0005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003ab0 con 0x7f6be4138d90 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: dump: 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: _finish_auth 0 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: _check_auth_tickets 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:22.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0050d0 con 0x7f6be4138d90 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0054c0 con 0x7f6be4138d90 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6bbbfff640 10 monclient: dump: 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be17fa640 4 set_mon_vals no callback set 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 5 monclient: authenticate success, global_id 94428 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _renew_subs 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be405c860 con 0x7f6be4138d90 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _renew_subs 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be412af00 con 0x7f6be4138d90 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.849+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be4140450 con 0x7f6be4138d90 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f6bcc005660 con 0x7f6be4138d90 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6bbbfff640 1 --2- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 0x7f6bb405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7f6bcc0e90c0 con 0x7f6be4138d90 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6be2ffd640 1 --2- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 0x7f6bb405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6be2ffd640 10 monclient: get_auth_request con 0x7f6bb403aa90 auth_method 0 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.853+0000 7f6be2ffd640 1 --2- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 0x7f6bb405af40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8003a30 tx=0x7f6bd80092b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.857+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f6bcc016ae0 con 0x7f6be4138d90 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.857+0000 7f6bbbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:22.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.857+0000 7f6bbbfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:22.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:22.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:22.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:22.972 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6be405fc00 con 0x7f6be4138d90 2026-02-22T20:58:22.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6bbbfff640 1 -- 10.20.193.7:0/2597248032 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f6bcc0b93e0 con 0x7f6be4138d90 2026-02-22T20:58:22.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6bbbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:22.973 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6bbbfff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:22.973 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 msgr2=0x7f6bb405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 0x7f6bb405af40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8003a30 tx=0x7f6bd80092b0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 10 monclient: shutdown 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 msgr2=0x7f6be4139200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc01cff0 tx=0x7f6bd0005900 comp rx=0 tx=0).stop 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 shutdown_connections 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6be41279d0 0x7f6be4127e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6be4138d90 0x7f6be4139200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.974 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6bb403aa90 0x7f6bb405af40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 --2- 10.20.193.7:0/2597248032 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6bd00048d0 0x7f6be4150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:22.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 >> 10.20.193.7:0/2597248032 conn(0x7f6be408f860 msgr2=0x7f6be413b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:22.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 shutdown_connections 2026-02-22T20:58:22.975 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:22.969+0000 7f6be986d640 1 -- 10.20.193.7:0/2597248032 wait complete. 2026-02-22T20:58:25.984 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 10 monclient: get_monmap_and_config 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 10 monclient: build_initial_monmap 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 10 monclient: monmap: 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:26.055 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:26.054926+0000 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:26.054926+0000 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 1 Processor -- start 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 1 -- start start 2026-02-22T20:58:26.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 10 monclient: init 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.049+0000 7f08b2f47640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f08ac13cef0 0x7f08ac13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-a con 0x7f08ac13cef0 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f08ac13d800 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f08ac13a2e0 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ac05d510 con 0x7f08ac13a2e0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ac08b800 con 0x7f08ac13d800 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f08ac08a720 con 0x7f08ac13cef0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): authenticate will time out at 918.528108s 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f08ac13d800 legacy=0x7f08ac139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:26.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f08ac13cef0 0x7f08ac13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f08ac13a2e0 0x7f08ac19f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:33176/0 (socket says 10.20.193.7:33176) 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 -- 10.20.193.7:0/3194509312 learned_addr learned my addr 10.20.193.7:0/3194509312 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): get_auth_request con 0x7f08ac13cef0 auth_method 0 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 -- 10.20.193.7:0/3194509312 >> v1:10.20.193.7:6789/0 conn(0x7f08ac13a2e0 legacy=0x7f08ac19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 -- 10.20.193.7:0/3194509312 >> v1:10.20.193.7:6789/0 conn(0x7f08ac13a2e0 legacy=0x7f08ac19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 --1- 10.20.193.7:0/3194509312 >> v1:10.20.193.7:6789/0 conn(0x7f08ac13a2e0 0x7f08ac19f480 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_done global_id 94431 payload 274 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/3194509312 >> v1:10.20.193.61:6789/0 conn(0x7f08ac13d800 legacy=0x7f08ac139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/3194509312 >> v1:10.20.193.7:6789/0 conn(0x7f08ac13a2e0 legacy=0x7f08ac19f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 monclient: found mon.noname-a 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:26.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/3194509312 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac08aa00 con 0x7f08ac13cef0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- 10.20.193.7:0/3194509312 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13cef0 0x7f08ac13d2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f089c004780 tx=0x7f089c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12386bbe2371b343 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 1 -- 10.20.193.7:0/3194509312 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c0b0070 con 0x7f08ac13cef0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: dump: 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:26.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 1 -- 10.20.193.7:0/3194509312 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0ab600 con 0x7f08ac13cef0 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 1 -- 10.20.193.7:0/3194509312 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c0ab9d0 con 0x7f08ac13cef0 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 5 monclient: authenticate success, global_id 94431 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 4 set_mon_vals no callback set 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a37fe640 10 monclient: dump: 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: shutdown 2026-02-22T20:58:26.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/3194509312 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13cef0 msgr2=0x7f08ac13d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- 10.20.193.7:0/3194509312 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13cef0 0x7f08ac13d2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f089c004780 tx=0x7f089c01c400 comp rx=0 tx=0).stop 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/3194509312 shutdown_connections 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- 10.20.193.7:0/3194509312 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13cef0 0x7f08ac13d2c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/3194509312 >> 10.20.193.7:0/3194509312 conn(0x7f08ac08f860 msgr2=0x7f08ac08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/3194509312 shutdown_connections 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/3194509312 wait complete. 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: build_initial_monmap 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: monmap: 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:26.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:26.064 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 Processor -- start 2026-02-22T20:58:26.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- start start 2026-02-22T20:58:26.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: init 2026-02-22T20:58:26.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:26.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:58:26.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-a con 0x7f08ac13a2e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08ac13cef0 0x7f08ac113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-c con 0x7f08ac13cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 0x7f08ac086960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): picked mon.noname-b con 0x7f08ac13d800 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac1a3950 con 0x7f08ac13a2e0 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac1a37d0 con 0x7f08ac13d800 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f08ac1a3ad0 con 0x7f08ac13cef0 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient(hunting): authenticate will time out at 918.531417s 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:36926/0 (socket says 10.20.193.7:36926) 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 msgr2=0x7f08ac086960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/795254895 learned_addr learned my addr 10.20.193.7:0/795254895 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:26.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): get_auth_request con 0x7f08ac13a2e0 auth_method 0 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b14bd640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 0x7f08ac086960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08ac13cef0 0x7f08ac113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): get_auth_request con 0x7f08ac13cef0 auth_method 0 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient(hunting): handle_auth_done global_id 94434 payload 824 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08ac13cef0 msgr2=0x7f08ac113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08ac13cef0 0x7f08ac113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/795254895 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 msgr2=0x7f08ac086960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 0x7f08ac086960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 monclient: found mon.noname-a 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 -- 10.20.193.7:0/795254895 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac13be40 con 0x7f08ac13a2e0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b0cbc640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f089c01c440 tx=0x7f089c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c0b0040 con 0x7f08ac13a2e0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: dump: 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:26.069 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: _finish_auth 0 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: _check_auth_tickets 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0b9070 con 0x7f08ac13a2e0 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c0abbb0 con 0x7f08ac13a2e0 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a17fa640 10 monclient: dump: 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:26.070 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08a2ffd640 4 set_mon_vals no callback set 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 5 monclient: authenticate success, global_id 94434 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: _renew_subs 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.053+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac05d0d0 con 0x7f08ac13a2e0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 10 monclient: _renew_subs 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac13c550 con 0x7f08ac13a2e0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ac128a40 con 0x7f08ac13a2e0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f089c003710 con 0x7f08ac13a2e0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a17fa640 1 --2- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 0x7f087c05af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7f089c0e8750 con 0x7f08ac13a2e0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a3fff640 1 --2- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 0x7f087c05af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:26.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a3fff640 10 monclient: get_auth_request con 0x7f087c03aa80 auth_method 0 2026-02-22T20:58:26.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.057+0000 7f08a3fff640 1 --2- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 0x7f087c05af30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08ac129390 tx=0x7f0894006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:26.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.061+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f08ac05d0d0 con 0x7f08ac13a2e0 2026-02-22T20:58:26.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.061+0000 7f08a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:26.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.061+0000 7f08a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:26.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f08ac13d2c0 con 0x7f08ac13a2e0 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08a17fa640 1 -- 10.20.193.7:0/795254895 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f089c016110 con 0x7f08ac13a2e0 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:26.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:26.178 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 msgr2=0x7f087c05af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 0x7f087c05af30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f08ac129390 tx=0x7f0894006f90 comp rx=0 tx=0).stop 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 10 monclient: shutdown 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 msgr2=0x7f08ac1132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f089c01c440 tx=0x7f089c0191a0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 shutdown_connections 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> v2:10.20.193.61:6800/2336688312 conn(0x7f087c03aa80 0x7f087c05af30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f08ac13d800 0x7f08ac086960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f08ac13cef0 0x7f08ac113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 --2- 10.20.193.7:0/795254895 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f08ac13a2e0 0x7f08ac1132e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:26.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 >> 10.20.193.7:0/795254895 conn(0x7f08ac08f860 msgr2=0x7f08ac058060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:26.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 shutdown_connections 2026-02-22T20:58:26.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:26.173+0000 7f08b2f47640 1 -- 10.20.193.7:0/795254895 wait complete. 2026-02-22T20:58:26.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:26.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:29.188 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: get_monmap_and_config 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: build_initial_monmap 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: monmap: 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:29.257837+0000 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:29.257837+0000 2026-02-22T20:58:29.269 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 Processor -- start 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 -- start start 2026-02-22T20:58:29.270 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: init 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb42c13c6e0 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-b con 0x7fb42c1604f0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb42c180e10 0x7fb42c1a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-a con 0x7fb42c180e10 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb42c08a850 con 0x7fb42c13c6e0 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:29.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c08a610 con 0x7fb42c180e10 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c08bc70 con 0x7fb42c1604f0 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb4318df640 10 monclient(hunting): authenticate will time out at 921.730981s 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fb42c180e10 0x7fb42c1a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 0x7fb42c05d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34434/0 (socket says 10.20.193.7:34434) 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:45946/0 (socket says 10.20.193.7:45946) 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 -- 10.20.193.7:0/1676643613 learned_addr learned my addr 10.20.193.7:0/1676643613 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:29.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): get_auth_request con 0x7fb42c1604f0 auth_method 0 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): get_auth_request con 0x7fb42c180e10 auth_method 0 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:29.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 -- 10.20.193.7:0/1676643613 >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 legacy=0x7fb42c05d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 -- 10.20.193.7:0/1676643613 >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 legacy=0x7fb42c05d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 --1- 10.20.193.7:0/1676643613 >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 0x7fb42c05d2b0 :-1 s=OPENED pgs=135 cs=1 l=1).handle_message read tag failed 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42affd640 1 --1- 10.20.193.7:0/1676643613 >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 0x7fb42c05d2b0 :-1 s=OPENED pgs=135 cs=1 l=1).fault on lossy channel, failing 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb429ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.7:6789/0 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_done global_id 104156 payload 274 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1676643613 >> v2:10.20.193.7:3300/0 conn(0x7fb42c180e10 msgr2=0x7fb42c1a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:29.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1676643613 >> v2:10.20.193.7:3300/0 conn(0x7fb42c180e10 0x7fb42c1a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1676643613 >> v1:10.20.193.7:6789/0 conn(0x7fb42c13c6e0 legacy=0x7fb42c05d2b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 monclient: found mon.noname-b 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.253+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1676643613 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c08a390 con 0x7fb42c1604f0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1676643613 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb42c089ea0 tx=0x7fb41401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1946957c6d13ec8 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 1 -- 10.20.193.7:0/1676643613 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140b0070 con 0x7fb42c1604f0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:29.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: dump: 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:29.276 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: _finish_auth 0 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 1 -- 10.20.193.7:0/1676643613 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4140ab600 con 0x7fb42c1604f0 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 1 -- 10.20.193.7:0/1676643613 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140ab9d0 con 0x7fb42c1604f0 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 5 monclient: authenticate success, global_id 104156 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 4 set_mon_vals no callback set 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:29.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb429ffb640 10 monclient: dump: 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:29.278 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: shutdown 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1676643613 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 msgr2=0x7fb42c1808d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- 10.20.193.7:0/1676643613 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb42c089ea0 tx=0x7fb41401c410 comp rx=0 tx=0).stop 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1676643613 shutdown_connections 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- 10.20.193.7:0/1676643613 >> v2:10.20.193.7:3300/0 conn(0x7fb42c180e10 0x7fb42c1a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- 10.20.193.7:0/1676643613 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c1604f0 0x7fb42c1808d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1676643613 >> 10.20.193.7:0/1676643613 conn(0x7fb42c08f860 msgr2=0x7fb42c08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1676643613 shutdown_connections 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1676643613 wait complete. 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: build_initial_monmap 2026-02-22T20:58:29.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: monmap: 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 Processor -- start 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- start start 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: init 2026-02-22T20:58:29.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-c con 0x7fb42c13c6e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 0x7fb42c17c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-a con 0x7fb42c1604f0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 0x7fb42c1636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): picked mon.noname-b con 0x7fb42c180e10 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1a42e0 con 0x7fb42c1604f0 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1a4160 con 0x7fb42c180e10 2026-02-22T20:58:29.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c1a4460 con 0x7fb42c13c6e0 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient(hunting): authenticate will time out at 921.735028s 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:45952/0 (socket says 10.20.193.7:45952) 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 1 -- 10.20.193.7:0/1827629658 learned_addr learned my addr 10.20.193.7:0/1827629658 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): get_auth_request con 0x7fb42c13c6e0 auth_method 0 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 0x7fb42c17c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): get_auth_request con 0x7fb42c1604f0 auth_method 0 2026-02-22T20:58:29.282 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42b7fe640 1 -- 10.20.193.7:0/1827629658 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 msgr2=0x7fb42c1636b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42b7fe640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 0x7fb42c1636b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient(hunting): handle_auth_done global_id 94440 payload 824 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 msgr2=0x7fb42c17c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.283 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1827629658 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 msgr2=0x7fb42c1636b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 0x7fb42c1636b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 monclient: found mon.noname-a 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 -- 10.20.193.7:0/1827629658 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c166d80 con 0x7fb42c1604f0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42affd640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb42a7fc640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 0x7fb42c17c870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb42c08d300 tx=0x7fb4140191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140b9070 con 0x7fb42c1604f0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: dump: 2026-02-22T20:58:29.284 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: _finish_auth 0 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: _check_auth_tickets 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 5 monclient: authenticate success, global_id 94440 2026-02-22T20:58:29.285 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4140ab9b0 con 0x7fb42c1604f0 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _renew_subs 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c087740 con 0x7fb42c1604f0 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140b0040 con 0x7fb42c1604f0 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb403fff640 10 monclient: dump: 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:29.286 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4297fa640 4 set_mon_vals no callback set 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _renew_subs 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c167340 con 0x7fb42c1604f0 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.257+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0382a0 con 0x7fb42c1604f0 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fb4140b3070 con 0x7fb42c1604f0 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 1 --2- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 0x7fb3fc05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:29.287 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(207..207 src has 64..207) ==== 3897+0+0 (secure 0 0 0) 0x7fb4140e7780 con 0x7fb42c1604f0 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb42affd640 1 --2- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 0x7fb3fc05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb42affd640 10 monclient: get_auth_request con 0x7fb3fc03aa90 auth_method 0 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb42affd640 1 --2- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 0x7fb3fc05af40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb420002770 tx=0x7fb420009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fb414016090 con 0x7fb42c1604f0 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:29.288 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.261+0000 7fb403fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb42c165890 con 0x7fb42c1604f0 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb403fff640 1 -- 10.20.193.7:0/1827629658 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7fb414003e20 con 0x7fb42c1604f0 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb403fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb403fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:29.377 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 msgr2=0x7fb3fc05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 0x7fb3fc05af40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb420002770 tx=0x7fb420009040 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 10 monclient: shutdown 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 msgr2=0x7fb42c17c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 0x7fb42c17c870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb42c08d300 tx=0x7fb4140191b0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 shutdown_connections 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb3fc03aa90 0x7fb3fc05af40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb42c180e10 0x7fb42c1636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb42c1604f0 0x7fb42c17c870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 --2- 10.20.193.7:0/1827629658 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb42c13c6e0 0x7fb42c17c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 >> 10.20.193.7:0/1827629658 conn(0x7fb42c08f860 msgr2=0x7fb42c17dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 shutdown_connections 2026-02-22T20:58:29.378 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:29.373+0000 7fb4318df640 1 -- 10.20.193.7:0/1827629658 wait complete. 2026-02-22T20:58:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:31.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:58:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:58:31.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:31.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:32.389 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: get_monmap_and_config 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: build_initial_monmap 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: monmap: 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:32.457181+0000 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:32.457181+0000 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:32.457 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 Processor -- start 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 -- start start 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: init 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient: _add_conns ranks=[1,0,3,4,2] 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff40c08c7a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff40c090b70 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-a con 0x7ff40c090f70 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c08d840 con 0x7ff40c090b70 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40c08db20 con 0x7ff40c08c7a0 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c0851e0 con 0x7ff40c090f70 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff411b8d640 10 monclient(hunting): authenticate will time out at 924.930407s 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40b7fe640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7ff40c08c7a0 legacy=0x7ff40c090460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40affd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff40c090b70 0x7ff40c1806e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:34444/0 (socket says 10.20.193.7:34444) 2026-02-22T20:58:32.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 learned_addr learned my addr 10.20.193.7:0/2231088145 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 10 monclient(hunting): get_auth_request con 0x7ff40c090f70 auth_method 0 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:32.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.453+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v1:10.20.193.61:6789/0 conn(0x7ff40c08c7a0 legacy=0x7ff40c090460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 10 monclient(hunting): get_auth_request con 0x7ff40c090f70 auth_method 0 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:32.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:32.657+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:58:33.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v1:10.20.193.61:6789/0 conn(0x7ff40c08c7a0 legacy=0x7ff40c090460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:33.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:33.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 10 monclient(hunting): get_auth_request con 0x7ff40c090f70 auth_method 0 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:33.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.061+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:58:33.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v1:10.20.193.61:6789/0 conn(0x7ff40c08c7a0 legacy=0x7ff40c090460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 10 monclient(hunting): get_auth_request con 0x7ff40c090f70 auth_method 0 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:33.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:33.865+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): tick 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 monclient(hunting): continuing hunt 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 msgr2=0x7ff40c1a1e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff40c090f70 0x7ff40c1a1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 >> v1:10.20.193.61:6789/0 conn(0x7ff40c08c7a0 legacy=0x7ff40c090460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 >> v1:10.20.193.7:6789/0 conn(0x7ff40c090b70 legacy=0x7ff40c1806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient: _add_conns ranks=[4,2] 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): picked mon.noname-c con 0x7ff3e80037a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): picked mon.noname-b con 0x7ff3e80242a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:35.459 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c0851e0 con 0x7ff3e80037a0 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e8044e10 con 0x7ff3e80242a0 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff4097fa640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 msgr2=0x7ff3e8023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e80242a0 auth_method 0 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:35.460 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.453+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 msgr2=0x7ff3e8023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e80242a0 auth_method 0 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:35.661 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:35.657+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:58:36.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 msgr2=0x7ff3e8023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e80242a0 auth_method 0 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:36.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:36.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.061+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 msgr2=0x7ff3e8023c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e80242a0 auth_method 0 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:58:36.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:36.865+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:58:36.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:36.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:37.395 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21444]: starting. 2026-02-22T20:58:37.395 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21444]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21442 2026-02-22T20:58:37.396 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21444]: shutting down. 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): tick 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): _check_auth_tickets 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 monclient(hunting): continuing hunt 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 msgr2=0x7ff3e8044730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e80242a0 0x7ff3e8044730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 msgr2=0x7ff3e8023c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e80037a0 0x7ff3e8023c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 reap_dead start 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff3e8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): picked mon.noname-b con 0x7ff3e8024700 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff3e80040b0 0x7ff3e8004520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): picked mon.noname-a con 0x7ff3e80040b0 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 0x7ff3e8005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): picked mon.noname-c con 0x7ff3e8004b80 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff40c0851e0 con 0x7ff3e80040b0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e8044e10 con 0x7ff3e8004b80 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 1 -- 10.20.193.7:0/2231088145 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e8005770 con 0x7ff3e8024700 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff4097fa640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff3e8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40bfff640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 msgr2=0x7ff3e8005020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): get_auth_request con 0x7ff3e8024700 auth_method 0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff3e80040b0 0x7ff3e8004520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40bfff640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 0x7ff3e8005020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e80040b0 auth_method 0 2026-02-22T20:58:38.475 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient(hunting): handle_auth_done global_id 104177 payload 274 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 msgr2=0x7ff3e8005020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 0x7ff3e8005020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff3e80040b0 msgr2=0x7ff3e8004520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff3e80040b0 0x7ff3e8004520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 monclient: found mon.noname-b 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.453+0000 7ff40b7fe640 1 -- 10.20.193.7:0/2231088145 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c08ed90 con 0x7ff3e8024700 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff3e8003b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8004b50 tx=0x7ff3f801cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ebc9d6f4731d53 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 1 -- 10.20.193.7:0/2231088145 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8009030 con 0x7ff3e8024700 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: dump: 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 1 -- 10.20.193.7:0/2231088145 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f80a9070 con 0x7ff3e8024700 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 1 -- 10.20.193.7:0/2231088145 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80a5e50 con 0x7ff3e8024700 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40a7fc640 10 monclient: dump: 2026-02-22T20:58:38.476 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 5 monclient: authenticate success, global_id 104177 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 4 set_mon_vals no callback set 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: shutdown 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 msgr2=0x7ff3e8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff3e8003b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8004b50 tx=0x7ff3f801cd80 comp rx=0 tx=0).stop 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/2231088145 shutdown_connections 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.61:3300/0 conn(0x7ff3e8004b80 0x7ff3e8005020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- 10.20.193.7:0/2231088145 >> v2:10.20.193.7:3300/0 conn(0x7ff3e80040b0 0x7ff3e8004520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- 10.20.193.7:0/2231088145 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff3e8003b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/2231088145 >> 10.20.193.7:0/2231088145 conn(0x7ff40c08e050 msgr2=0x7ff40c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/2231088145 shutdown_connections 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/2231088145 wait complete. 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: build_initial_monmap 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: monmap: 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 Processor -- start 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- start start 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: init 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 0x7ff40c1d9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-b con 0x7ff3e80040b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:38.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-a con 0x7ff3e8004b80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff40c13f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): picked mon.noname-c con 0x7ff3e8024700 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c142260 con 0x7ff3e8004b80 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c1420e0 con 0x7ff3e80040b0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff40c1423e0 con 0x7ff3e8024700 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient(hunting): authenticate will time out at 930.935188s 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40b7fe640 1 -- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 msgr2=0x7ff40c1d9630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 0x7ff40c1d9630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:35414/0 (socket says 10.20.193.7:35414) 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff40c13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 -- 10.20.193.7:0/246127566 learned_addr learned my addr 10.20.193.7:0/246127566 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): get_auth_request con 0x7ff3e8004b80 auth_method 0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): get_auth_request con 0x7ff3e8024700 auth_method 0 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient(hunting): handle_auth_done global_id 94467 payload 824 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 -- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 msgr2=0x7ff40c13f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff40c13f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 -- 10.20.193.7:0/246127566 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 msgr2=0x7ff40c1d9630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:38.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 0x7ff40c1d9630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 monclient: found mon.noname-a 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 -- 10.20.193.7:0/246127566 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c13a2e0 con 0x7ff3e8004b80 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40bfff640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff40c13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff40affd640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0166e0 tx=0x7ff3fc016ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc01c020 con 0x7ff3e8004b80 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: dump: 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc003050 con 0x7ff3e8004b80 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003400 con 0x7ff3e8004b80 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff3e7fff640 10 monclient: dump: 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 5 monclient: authenticate success, global_id 94467 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff409ffb640 4 set_mon_vals no callback set 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _renew_subs 2026-02-22T20:58:38.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c1d9b70 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _renew_subs 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.457+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c08b9b0 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff3fc018440 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff411b8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff411b8d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff411b8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c08db20 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff3e7fff640 1 --2- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 0x7ff3dc05af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(209..209 src has 64..209) ==== 3897+0+0 (secure 0 0 0) 0x7ff3fc04faa0 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 0x7ff3dc05af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff40b7fe640 10 monclient: get_auth_request con 0x7ff3dc03aa90 auth_method 0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.461+0000 7ff40b7fe640 1 --2- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 0x7ff3dc05af40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff3f801d620 tx=0x7ff3f80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.465+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7ff3fc026020 con 0x7ff3e8004b80 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.465+0000 7ff3e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.480 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.465+0000 7ff3e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:38.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:38.581 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff40c05fc70 con 0x7ff3e8004b80 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff3e7fff640 1 -- 10.20.193.7:0/246127566 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7ff3fc00e1c0 con 0x7ff3e8004b80 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff3e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff3e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 msgr2=0x7ff3dc05af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 0x7ff3dc05af40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff3f801d620 tx=0x7ff3f80a7000 comp rx=0 tx=0).stop 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 10 monclient: shutdown 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.582 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 msgr2=0x7ff40c13eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0166e0 tx=0x7ff3fc016ba0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 shutdown_connections 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff3e8024700 0x7ff40c13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff3e8004b80 0x7ff40c13eb00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff3dc03aa90 0x7ff3dc05af40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 --2- 10.20.193.7:0/246127566 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff3e80040b0 0x7ff40c1d9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 >> 10.20.193.7:0/246127566 conn(0x7ff40c08e050 msgr2=0x7ff40c0854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 shutdown_connections 2026-02-22T20:58:38.583 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.577+0000 7ff411b8d640 1 -- 10.20.193.7:0/246127566 wait complete. 2026-02-22T20:58:38.593 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:58:38.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:58:38.594 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: get_monmap_and_config 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: build_initial_monmap 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: monmap: 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:38.666892+0000 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:38.666892+0000 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:38.667 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 Processor -- start 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 -- start start 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: init 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 0x7f6f9013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-c con 0x7f6f9013f290 addr v2:10.20.193.61:3300/0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6f9013fba0 0x7f6f9013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-a con 0x7f6f9013fba0 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6f9013c4b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9008fd70 con 0x7f6f9013c4b0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9008e1f0 con 0x7f6f9013fba0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9008ec90 con 0x7f6f9013f290 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f96c60640 10 monclient(hunting): authenticate will time out at 931.139865s 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f949d5640 1 -- >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 msgr2=0x7f6f9013f660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f949d5640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 0x7f6f9013f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f951d6640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7f6f9013c4b0 legacy=0x7f6f901a07d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.661+0000 7f6f87fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6f9013fba0 0x7f6f9013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.668 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f6f9013fba0 0x7f6f9013bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59796/0 (socket says 10.20.193.7:59796) 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 -- 10.20.193.7:0/81153721 learned_addr learned my addr 10.20.193.7:0/81153721 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): get_auth_request con 0x7f6f9013fba0 auth_method 0 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient(hunting): handle_auth_done global_id 94470 payload 274 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 -- 10.20.193.7:0/81153721 >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 msgr2=0x7f6f9013f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 --2- 10.20.193.7:0/81153721 >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 0x7f6f9013f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 -- 10.20.193.7:0/81153721 >> v1:10.20.193.61:6789/0 conn(0x7f6f9013c4b0 legacy=0x7f6f901a07d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 monclient: found mon.noname-a 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 -- 10.20.193.7:0/81153721 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f90092bc0 con 0x7f6f9013fba0 2026-02-22T20:58:38.669 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f87fff640 1 --2- 10.20.193.7:0/81153721 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013fba0 0x7f6f9013bf70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f900947c0 tx=0x7f6f7801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67c6be82b329735 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 1 -- 10.20.193.7:0/81153721 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780b0070 con 0x7f6f9013fba0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: dump: 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 1 -- 10.20.193.7:0/81153721 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f780ab600 con 0x7f6f9013fba0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 1 -- 10.20.193.7:0/81153721 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ab9d0 con 0x7f6f9013fba0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f877fe640 10 monclient: dump: 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 5 monclient: authenticate success, global_id 94470 2026-02-22T20:58:38.670 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 4 set_mon_vals no callback set 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 10 monclient: shutdown 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- 10.20.193.7:0/81153721 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013fba0 msgr2=0x7f6f9013bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 --2- 10.20.193.7:0/81153721 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013fba0 0x7f6f9013bf70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f900947c0 tx=0x7f6f7801c2f0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- 10.20.193.7:0/81153721 shutdown_connections 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 --2- 10.20.193.7:0/81153721 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013fba0 0x7f6f9013bf70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 --2- 10.20.193.7:0/81153721 >> v2:10.20.193.61:3300/0 conn(0x7f6f9013f290 0x7f6f9013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- 10.20.193.7:0/81153721 >> 10.20.193.7:0/81153721 conn(0x7f6f90093df0 msgr2=0x7f6f900902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- 10.20.193.7:0/81153721 shutdown_connections 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- 10.20.193.7:0/81153721 wait complete. 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 10 monclient: build_initial_monmap 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 10 monclient: monmap: 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.671 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 Processor -- start 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 1 -- start start 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.665+0000 7f6f96c60640 10 monclient: init 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-a con 0x7f6f9013c4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f9013f290 0x7f6f9010a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-c con 0x7f6f9013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6f9013fba0 0x7f6f9010ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): picked mon.noname-b con 0x7f6f9013fba0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90090de0 con 0x7f6f9013c4b0 2026-02-22T20:58:38.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90090c60 con 0x7f6f9013fba0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f6f901a4710 con 0x7f6f9013f290 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): authenticate will time out at 931.144126s 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59804/0 (socket says 10.20.193.7:59804) 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 -- 10.20.193.7:0/3753641460 learned_addr learned my addr 10.20.193.7:0/3753641460 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): get_auth_request con 0x7f6f9013c4b0 auth_method 0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f9013f290 0x7f6f9010a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f951d6640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6f9013fba0 msgr2=0x7f6f9010ab20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): get_auth_request con 0x7f6f9013f290 auth_method 0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f951d6640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6f9013fba0 0x7f6f9010ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient(hunting): handle_auth_done global_id 94473 payload 824 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f9013f290 msgr2=0x7f6f9010a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f6f9013f290 0x7f6f9010a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6f9013fba0 msgr2=0x7f6f9010ab20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f6f9013fba0 0x7f6f9010ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 monclient: found mon.noname-a 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9008a9e0 con 0x7f6f9013c4b0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f949d5640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b750 tx=0x7f6f8000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80005070 con 0x7f6f9013c4b0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: dump: 2026-02-22T20:58:38.674 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f80010070 con 0x7f6f9013c4b0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80005410 con 0x7f6f9013c4b0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 5 monclient: authenticate success, global_id 94473 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _renew_subs 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f86ffd640 4 set_mon_vals no callback set 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9013eef0 con 0x7f6f9013c4b0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: dump: 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _renew_subs 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f90122d20 con 0x7f6f9013c4b0 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 0x7f6f901a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9010d190 con 0x7f6f9010c120 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 0x7f6f901a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient: get_auth_request con 0x7f6f9010c120 auth_method 0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 10 monclient(hunting): handle_auth_done global_id 94476 payload 824 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f9013f660 con 0x7f6f9010c120 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f6f8001d030 con 0x7f6f9013c4b0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f87fff640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 0x7f6f901a1950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004780 tx=0x7f6f78019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 --2- 10.20.193.7:0/3753641460 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6f6003aa90 0x7f6f6005af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(209..209 src has 64..209) ==== 3897+0+0 (secure 0 0 0) 0x7f6f8004ddd0 con 0x7f6f9013c4b0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780b0040 con 0x7f6f9010c120 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: dump: 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f951d6640 1 --2- 10.20.193.7:0/3753641460 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6f6003aa90 0x7f6f6005af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f951d6640 10 monclient: get_auth_request con 0x7f6f6003aa90 auth_method 0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f6f780b1040 con 0x7f6f9010c120 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 msgr2=0x7f6f901a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 0x7f6f901a1950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004780 tx=0x7f6f78019090 comp rx=0 tx=0).stop 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 msgr2=0x7f6f901a1950 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:38.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f857fa640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9010c120 0x7f6f901a1950 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004780 tx=0x7f6f78019090 comp rx=0 tx=0).stop 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.669+0000 7f6f951d6640 1 --2- 10.20.193.7:0/3753641460 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6f6003aa90 0x7f6f6005af40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f9008db30 tx=0x7f6f8c0091f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 0x7f6f9004ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9005fc70 con 0x7f6f9004ca80 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 0x7f6f9004ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient: get_auth_request con 0x7f6f9004ca80 auth_method 0 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 10 monclient(hunting): handle_auth_done global_id 94479 payload 824 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 1 -- 10.20.193.7:0/3753641460 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f9010b060 con 0x7f6f9004ca80 2026-02-22T20:58:38.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f87fff640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 0x7f6f9004ce50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f900947c0 tx=0x7f6f780a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78003030 con 0x7f6f9004ca80 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 10 monclient: dump: 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f6f78003710 con 0x7f6f9004ca80 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 msgr2=0x7f6f9004ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 0x7f6f9004ce50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f900947c0 tx=0x7f6f780a8000 comp rx=0 tx=0).stop 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 msgr2=0x7f6f9004ce50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f857fa640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9004ca80 0x7f6f9004ce50 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f900947c0 tx=0x7f6f780a8000 comp rx=0 tx=0).stop 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 58, 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 91358, 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:38.678 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:38.679 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.680 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.681 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.682 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6f6003aa90 msgr2=0x7f6f6005af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 --2- 10.20.193.7:0/3753641460 >> v2:10.20.193.61:6800/2336688312 conn(0x7f6f6003aa90 0x7f6f6005af40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f9008db30 tx=0x7f6f8c0091f0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 10 monclient: shutdown 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 msgr2=0x7f6f9010a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b750 tx=0x7f6f8000bc10 comp rx=0 tx=0).stop 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f951d6640 1 -- 10.20.193.7:0/3753641460 reap_dead start 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 shutdown_connections 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 --2- 10.20.193.7:0/3753641460 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f6f9013c4b0 0x7f6f9010a0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 >> 10.20.193.7:0/3753641460 conn(0x7f6f90093df0 msgr2=0x7f6f9013e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 shutdown_connections 2026-02-22T20:58:38.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.673+0000 7f6f96c60640 1 -- 10.20.193.7:0/3753641460 wait complete. 2026-02-22T20:58:38.686 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:58:38.686 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T20:58:38.686 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:58:38.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: get_monmap_and_config 2026-02-22T20:58:38.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: build_initial_monmap 2026-02-22T20:58:38.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: monmap: 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:38.754662+0000 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:38.754662+0000 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:38.755 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 Processor -- start 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 -- start start 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: init 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fac6c13f290 0x7fac6c13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-a con 0x7fac6c13f290 addr v2:10.20.193.7:3300/0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fac6c13fba0 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fac6c13c680 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c08fd70 con 0x7fac6c13c680 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c092bc0 con 0x7fac6c13fba0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fac6c08e1f0 con 0x7fac6c13f290 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac7091c640 10 monclient(hunting): authenticate will time out at 931.227658s 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fac6c13f290 0x7fac6c13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac69d74640 1 -- >> v1:10.20.193.61:6789/0 conn(0x7fac6c13fba0 legacy=0x7fac6c13bf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.61:6789/0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fac6c13f290 0x7fac6c13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59836/0 (socket says 10.20.193.7:59836) 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 -- 10.20.193.7:0/1804773029 learned_addr learned my addr 10.20.193.7:0/1804773029 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): get_auth_request con 0x7fac6c13f290 auth_method 0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6ad76640 1 --1- 10.20.193.7:0/1804773029 >> v1:10.20.193.7:6789/0 conn(0x7fac6c13c680 0x7fac6c1a17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:47558/0 (socket says 10.20.193.7:47558) 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient(hunting): handle_auth_done global_id 94482 payload 274 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 -- 10.20.193.7:0/1804773029 >> v1:10.20.193.61:6789/0 conn(0x7fac6c13fba0 legacy=0x7fac6c13bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 -- 10.20.193.7:0/1804773029 >> v1:10.20.193.7:6789/0 conn(0x7fac6c13c680 legacy=0x7fac6c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 monclient: found mon.noname-a 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.749+0000 7fac6a575640 1 -- 10.20.193.7:0/1804773029 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c08e6d0 con 0x7fac6c13f290 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- 10.20.193.7:0/1804773029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13f290 0x7fac6c13f660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac600090a0 tx=0x7fac6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf52f4c621794c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 1 -- 10.20.193.7:0/1804773029 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab610 con 0x7fac6c13f290 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: dump: 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.757 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 1 -- 10.20.193.7:0/1804773029 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600b0070 con 0x7fac6c13f290 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 5 monclient: authenticate success, global_id 94482 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 1 -- 10.20.193.7:0/1804773029 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab9d0 con 0x7fac6c13f290 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69573640 10 monclient: dump: 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 4 set_mon_vals no callback set 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: shutdown 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/1804773029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13f290 msgr2=0x7fac6c13f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 --2- 10.20.193.7:0/1804773029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13f290 0x7fac6c13f660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac600090a0 tx=0x7fac6001c500 comp rx=0 tx=0).stop 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/1804773029 shutdown_connections 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 --2- 10.20.193.7:0/1804773029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13f290 0x7fac6c13f660 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/1804773029 >> 10.20.193.7:0/1804773029 conn(0x7fac6c093df0 msgr2=0x7fac6c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/1804773029 shutdown_connections 2026-02-22T20:58:38.758 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/1804773029 wait complete. 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: build_initial_monmap 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: monmap: 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 Processor -- start 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- start start 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: init 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 0x7fac6c129e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-a con 0x7fac6c13c680 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fac6c13f290 0x7fac6c12a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-b con 0x7fac6c13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c13fba0 0x7fac6c12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): picked mon.noname-c con 0x7fac6c13fba0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c1a58a0 con 0x7fac6c13c680 2026-02-22T20:58:38.760 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c1a5720 con 0x7fac6c13f290 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c1a5a20 con 0x7fac6c13fba0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient(hunting): authenticate will time out at 931.231027s 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 0x7fac6c129e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 0x7fac6c129e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:59838/0 (socket says 10.20.193.7:59838) 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 -- 10.20.193.7:0/468196656 learned_addr learned my addr 10.20.193.7:0/468196656 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): get_auth_request con 0x7fac6c13c680 auth_method 0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69d74640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fac6c13f290 msgr2=0x7fac6c12a390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.61:3300/0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac69d74640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fac6c13f290 0x7fac6c12a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c13fba0 0x7fac6c12a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): get_auth_request con 0x7fac6c13fba0 auth_method 0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient(hunting): handle_auth_done global_id 94488 payload 824 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c13fba0 msgr2=0x7fac6c12a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c13fba0 0x7fac6c12a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fac6c13f290 msgr2=0x7fac6c12a390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fac6c13f290 0x7fac6c12a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient: _finish_hunting 0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 monclient: found mon.noname-a 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c12cb90 con 0x7fac6c13c680 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac6a575640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 0x7fac6c129e50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac60002410 tx=0x7fac6001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60004220 con 0x7fac6c13c680 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: dump: 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.761 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: _finish_auth 0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600043c0 con 0x7fac6c13c680 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 5 monclient: authenticate success, global_id 94488 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _renew_subs 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac6c12da00 con 0x7fac6c13c680 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60003910 con 0x7fac6c13c680 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 10 monclient: dump: 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac68d72640 4 set_mon_vals no callback set 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _renew_subs 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac6c08a9e0 con 0x7fac6c13c680 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac7091c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.753+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fac60003ab0 con 0x7fac6c13c680 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac7091c640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 0x7fac6c04ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c13f660 con 0x7fac6c088750 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 --2- 10.20.193.7:0/468196656 >> v2:10.20.193.61:6800/2336688312 conn(0x7fac3803aa90 0x7fac3805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 0x7fac6c04ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient: get_auth_request con 0x7fac6c088750 auth_method 0 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.762 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(209..209 src has 64..209) ==== 3897+0+0 (secure 0 0 0) 0x7fac600e9190 con 0x7fac6c13c680 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac6ad76640 1 --2- 10.20.193.7:0/468196656 >> v2:10.20.193.61:6800/2336688312 conn(0x7fac3803aa90 0x7fac3805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac6ad76640 10 monclient: get_auth_request con 0x7fac3803aa90 auth_method 0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 10 monclient(hunting): handle_auth_done global_id 104189 payload 824 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac6c0008e0 con 0x7fac6c088750 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac69d74640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 0x7fac6c04ca80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac6c12c190 tx=0x7fac5400bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5400c980 con 0x7fac6c088750 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 10 monclient: dump: 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac6ad76640 1 --2- 10.20.193.7:0/468196656 >> v2:10.20.193.61:6800/2336688312 conn(0x7fac3803aa90 0x7fac3805af40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac5c002af0 tx=0x7fac5c0032e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fac54010070 con 0x7fac6c088750 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 msgr2=0x7fac6c04ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.763 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 0x7fac6c04ca80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac6c12c190 tx=0x7fac5400bd00 comp rx=0 tx=0).stop 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 msgr2=0x7fac6c04ca80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.757+0000 7fac52ffd640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088750 0x7fac6c04ca80 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac6c12c190 tx=0x7fac5400bd00 comp rx=0 tx=0).stop 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 0x7fac6c1908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c13c470 con 0x7fac6c088b20 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 0x7fac6c1908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient: get_auth_request con 0x7fac6c088b20 auth_method 0 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 10 monclient(hunting): handle_auth_done global_id 104192 payload 824 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 1 -- 10.20.193.7:0/468196656 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac6c12c460 con 0x7fac6c088b20 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac69d74640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 0x7fac6c1908c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac54011000 tx=0x7fac54005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5401a3b0 con 0x7fac6c088b20 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:38.764 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 10 monclient: dump: 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5036 (secure 0 0 0) 0x7fac5401a3b0 con 0x7fac6c088b20 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 msgr2=0x7fac6c1908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 0x7fac6c1908c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac54011000 tx=0x7fac54005b20 comp rx=0 tx=0).stop 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 msgr2=0x7fac6c1908c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac52ffd640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fac6c088b20 0x7fac6c1908c0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac54011000 tx=0x7fac54005b20 comp rx=0 tx=0).stop 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 58, 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 28527, 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.765 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:38.766 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.767 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.768 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:58:38.769 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 >> v2:10.20.193.61:6800/2336688312 conn(0x7fac3803aa90 msgr2=0x7fac3805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 --2- 10.20.193.7:0/468196656 >> v2:10.20.193.61:6800/2336688312 conn(0x7fac3803aa90 0x7fac3805af40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fac5c002af0 tx=0x7fac5c0032e0 comp rx=0 tx=0).stop 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 10 monclient: shutdown 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 msgr2=0x7fac6c129e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 --2- 10.20.193.7:0/468196656 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fac6c13c680 0x7fac6c129e50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac60002410 tx=0x7fac6001ad40 comp rx=0 tx=0).stop 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac6ad76640 1 -- 10.20.193.7:0/468196656 reap_dead start 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac6ad76640 1 -- 10.20.193.7:0/468196656 reap_dead start 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 shutdown_connections 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 >> 10.20.193.7:0/468196656 conn(0x7fac6c093df0 msgr2=0x7fac6c0574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 shutdown_connections 2026-02-22T20:58:38.770 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:38.761+0000 7fac7091c640 1 -- 10.20.193.7:0/468196656 wait complete. 2026-02-22T20:58:38.773 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:58:38.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:58:39.451 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:39.451 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: starting. 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21442 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: created object 0... 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: created object 25... 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: created object 49... 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: finishing. 2026-02-22T20:58:39.452 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21477]: shutting down. 2026-02-22T20:58:39.464 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:39.464 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: starting. 2026-02-22T20:58:39.464 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: listing objects. 2026-02-22T20:58:39.465 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: listed object 0... 2026-02-22T20:58:39.465 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: listed object 25... 2026-02-22T20:58:39.465 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: saw 50 objects 2026-02-22T20:58:39.465 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21479]: shutting down. 2026-02-22T20:58:40.408 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:40.408 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21478]: starting. 2026-02-22T20:58:40.408 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21478]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21442 2026-02-22T20:58:40.408 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21478]: shutting down. 2026-02-22T20:58:40.411 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:40.411 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:40.411 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:40.413 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:41.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:41.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: starting. 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21529 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: created object 0... 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: created object 25... 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: created object 49... 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: finishing. 2026-02-22T20:58:42.464 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21530]: shutting down. 2026-02-22T20:58:43.416 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21531]: starting. 2026-02-22T20:58:43.416 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21531]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21529 2026-02-22T20:58:43.416 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21531]: shutting down. 2026-02-22T20:58:45.470 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: starting. 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21529 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: created object 0... 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: created object 25... 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: created object 49... 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: finishing. 2026-02-22T20:58:45.471 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21564]: shutting down. 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: starting. 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: listing objects. 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: listed object 0... 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: listed object 25... 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: saw 50 objects 2026-02-22T20:58:45.481 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21566]: shutting down. 2026-02-22T20:58:46.425 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:46.426 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21565]: starting. 2026-02-22T20:58:46.426 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21565]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21529 2026-02-22T20:58:46.426 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21565]: shutting down. 2026-02-22T20:58:46.429 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:46.429 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:46.429 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:46.431 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:46.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:46.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: starting. 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21616 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: created object 0... 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: created object 25... 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: created object 49... 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: finishing. 2026-02-22T20:58:48.413 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21617]: shutting down. 2026-02-22T20:58:49.363 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21618]: starting. 2026-02-22T20:58:49.364 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21618]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21616 2026-02-22T20:58:49.364 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21618]: shutting down. 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: starting. 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21616 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: created object 0... 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: created object 25... 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: created object 49... 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: finishing. 2026-02-22T20:58:51.420 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21651]: shutting down. 2026-02-22T20:58:51.431 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: starting. 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: listing objects. 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: listed object 0... 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: listed object 25... 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: saw 50 objects 2026-02-22T20:58:51.432 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21653]: shutting down. 2026-02-22T20:58:51.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:51.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:52.372 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:52.372 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21652]: starting. 2026-02-22T20:58:52.372 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21652]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21616 2026-02-22T20:58:52.372 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21652]: shutting down. 2026-02-22T20:58:52.375 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:52.375 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:52.375 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:52.377 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: starting. 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21703 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: created object 0... 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: created object 25... 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: created object 49... 2026-02-22T20:58:54.428 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: finishing. 2026-02-22T20:58:54.429 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21704]: shutting down. 2026-02-22T20:58:55.381 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21705]: starting. 2026-02-22T20:58:55.381 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21705]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21703 2026-02-22T20:58:55.381 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21705]: shutting down. 2026-02-22T20:58:56.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:58:56.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:58:57.412 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: starting. 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21703 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: created object 0... 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: created object 25... 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: created object 49... 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: finishing. 2026-02-22T20:58:57.413 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21738]: shutting down. 2026-02-22T20:58:57.423 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:57.423 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: starting. 2026-02-22T20:58:57.423 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: listing objects. 2026-02-22T20:58:57.423 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: listed object 0... 2026-02-22T20:58:57.423 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: listed object 25... 2026-02-22T20:58:57.424 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: saw 50 objects 2026-02-22T20:58:57.424 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21740]: shutting down. 2026-02-22T20:58:58.363 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:58.363 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21739]: starting. 2026-02-22T20:58:58.363 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21739]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21703 2026-02-22T20:58:58.363 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21739]: shutting down. 2026-02-22T20:58:58.366 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:58.366 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:58:58.366 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:58:58.368 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:58:58.774 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-22T20:58:58.774 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T20:58:58.775 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T20:58:58.777 INFO:tasks.ceph.mon.b:Started 2026-02-22T20:58:58.777 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:58:58.777 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: get_monmap_and_config 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: build_initial_monmap 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: monmap: 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:58:58.847018+0000 2026-02-22T20:58:58.849 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:58:58.847018+0000 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 Processor -- start 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 -- start start 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: init 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-22T20:58:58.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f375005d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): picked mon.noname-b con 0x7f375013c6e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f375013f180 addr v1:10.20.193.7:6789/0 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f375013fc80 addr v1:10.20.193.61:6789/0 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375008a850 con 0x7f375013f180 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375008a390 con 0x7f375013fc80 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f375008a610 con 0x7f375013c6e0 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.841+0000 7f3756969640 10 monclient(hunting): authenticate will time out at 951.319941s 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f375005d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f375013f180 0x7f375013f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36498/0 (socket says 10.20.193.7:36498) 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 1 -- 10.20.193.7:0/2474458533 learned_addr learned my addr 10.20.193.7:0/2474458533 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): get_auth_request con 0x7f375013c6e0 auth_method 0 2026-02-22T20:58:58.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_done global_id 104276 payload 274 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/2474458533 >> v1:10.20.193.61:6789/0 conn(0x7f375013fc80 legacy=0x7f37501a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/2474458533 >> v1:10.20.193.7:6789/0 conn(0x7f375013f180 legacy=0x7f375013f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 monclient: found mon.noname-b 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/2474458533 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375008b990 con 0x7f375013c6e0 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 1 -- 10.20.193.7:0/2474458533 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365078684 0 0) 0x7f375008a850 con 0x7f375013f180 2026-02-22T20:58:58.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:58:58.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- 10.20.193.7:0/2474458533 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f375005d2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f373c009840 tx=0x7f373c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ede30d5df59ba0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:58.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 1 -- 10.20.193.7:0/2474458533 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b0070 con 0x7f375013c6e0 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: dump: 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: _finish_auth 0 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: _check_auth_tickets 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 1 -- 10.20.193.7:0/2474458533 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c0ab600 con 0x7f375013c6e0 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:58.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 5 monclient: authenticate success, global_id 104276 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 1 -- 10.20.193.7:0/2474458533 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0ab9d0 con 0x7f375013c6e0 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374effd640 10 monclient: dump: 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: get_monmap_and_config success 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 4 set_mon_vals no callback set 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: shutdown 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:58.858 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/2474458533 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 msgr2=0x7f375005d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 --2- 10.20.193.7:0/2474458533 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f375005d2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f373c009840 tx=0x7f373c01c460 comp rx=0 tx=0).stop 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/2474458533 shutdown_connections 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 --2- 10.20.193.7:0/2474458533 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f375005d2b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/2474458533 >> 10.20.193.7:0/2474458533 conn(0x7f375008f860 msgr2=0x7f375008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/2474458533 shutdown_connections 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/2474458533 wait complete. 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: build_initial_monmap 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: monmap: 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.859 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 Processor -- start 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- start start 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: init 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _reopen_session rank -1 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): picked mon.noname-c con 0x7f375013c6e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f375013f180 0x7f37501509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): picked mon.noname-a con 0x7f375013f180 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f375013fc80 0x7f3750129520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): picked mon.noname-b con 0x7f375013fc80 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f375008a190 con 0x7f375013f180 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f37501a5670 con 0x7f375013fc80 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): start opening mon connection 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f37501a57f0 con 0x7f375013c6e0 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): _renew_subs 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient(hunting): authenticate will time out at 951.323242s 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:58.860 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49632/0 (socket says 10.20.193.7:49632) 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/3638552510 learned_addr learned my addr 10.20.193.7:0/3638552510 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): get_auth_request con 0x7f375013c6e0 auth_method 0 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f375013f180 0x7f37501509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): get_auth_request con 0x7f375013f180 auth_method 0 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3754edf640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f375013fc80 0x7f3750129520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3754edf640 10 monclient(hunting): get_auth_request con 0x7f375013fc80 auth_method 0 2026-02-22T20:58:58.861 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3754edf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3754edf640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3754edf640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient(hunting): handle_auth_done global_id 104279 payload 824 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/3638552510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f375013fc80 msgr2=0x7f3750129520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f375013fc80 0x7f3750129520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f375013f180 msgr2=0x7f37501509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f375013f180 0x7f37501509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient: _finish_hunting 0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 monclient: found mon.noname-c 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 -- 10.20.193.7:0/3638552510 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375013b800 con 0x7f375013c6e0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374ffff640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f373c01c4a0 tx=0x7f373c019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b9070 con 0x7f375013c6e0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: dump: 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.862 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: _finish_auth 0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: _check_auth_tickets 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c0aba70 con 0x7f375013c6e0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 5 monclient: authenticate success, global_id 104279 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _renew_subs 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3750086620 con 0x7f375013c6e0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b0040 con 0x7f375013c6e0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374cff9640 10 monclient: dump: 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:58:58.863 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f374e7fc640 4 set_mon_vals no callback set 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _renew_subs 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.845+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f375012aef0 con 0x7f375013c6e0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f3756969640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f3756969640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f3756969640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37500382a0 con 0x7f375013c6e0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f373c0b3070 con 0x7f375013c6e0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 1 --2- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 0x7f372005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(229..229 src has 64..229) ==== 3503+0+0 (secure 0 0 0) 0x7f373c0e7970 con 0x7f375013c6e0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374f7fe640 1 --2- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 0x7f372005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374f7fe640 10 monclient: get_auth_request con 0x7f372003ab20 auth_method 0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374f7fe640 1 --2- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 0x7f372005afd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f375008b330 tx=0x7f3740007e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f373c016170 con 0x7f375013c6e0 2026-02-22T20:58:58.864 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:58:58.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.849+0000 7f374cff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f375005d2b0 con 0x7f375013c6e0 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f374cff9640 1 -- 10.20.193.7:0/3638552510 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f373c0abe20 con 0x7f375013c6e0 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f374cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f374cff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:58:58.966 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 msgr2=0x7f372005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 0x7f372005afd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f375008b330 tx=0x7f3740007e00 comp rx=0 tx=0).stop 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 10 monclient: shutdown 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 msgr2=0x7f37501504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f373c01c4a0 tx=0x7f373c019200 comp rx=0 tx=0).stop 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 shutdown_connections 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> v2:10.20.193.61:6800/2336688312 conn(0x7f372003ab20 0x7f372005afd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f375013fc80 0x7f3750129520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f375013f180 0x7f37501509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 --2- 10.20.193.7:0/3638552510 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f375013c6e0 0x7f37501504b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:58:58.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 >> 10.20.193.7:0/3638552510 conn(0x7f375008f860 msgr2=0x7f3750089010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:58:58.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 shutdown_connections 2026-02-22T20:58:58.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:58:58.961+0000 7f3756969640 1 -- 10.20.193.7:0/3638552510 wait complete. 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: starting. 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21790 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: created object 0... 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: created object 25... 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: created object 49... 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: finishing. 2026-02-22T20:59:00.446 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21791]: shutting down. 2026-02-22T20:59:01.398 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21792]: starting. 2026-02-22T20:59:01.398 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21792]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21790 2026-02-22T20:59:01.398 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21792]: shutting down. 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_20:59:01] 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_20:59:01 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T20:59:01.942 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['.mgr', 'rbd'] 2026-02-22T20:59:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T20:59:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T20:59:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:01.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:01.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T20:59:01.961 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T20:59:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T20:59:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T20:59:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:59:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T20:59:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T20:59:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T20:59:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T20:59:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T20:59:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:59:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T20:59:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T20:59:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:59:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:59:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:59:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T20:59:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T20:59:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:59:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T20:59:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T20:59:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T20:59:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T20:59:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T20:59:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T20:59:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T20:59:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T20:59:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1] pools [1, 2] with 6 osds, pg_target 600 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T20:59:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T20:59:01.981 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:01.982 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:01.982 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: get_monmap_and_config 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: build_initial_monmap 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: monmap: 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:02.050 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:02.050405+0000 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:02.050405+0000 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:02.051 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 Processor -- start 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 -- start start 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: init 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1d1c13cef0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-a con 0x7f1d1c13d9d0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1d1c17e9a0 0x7f1d1c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-c con 0x7f1d1c17e9a0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:02.052 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1c05d510 con 0x7f1d1c13cef0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c08b800 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c08a720 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d21834640 10 monclient(hunting): authenticate will time out at 954.523663s 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39664/0 (socket says 10.20.193.7:39664) 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/1833371068 learned_addr learned my addr 10.20.193.7:0/1833371068 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): get_auth_request con 0x7f1d1c13d9d0 auth_method 0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1affd640 1 --1- 10.20.193.7:0/1833371068 >> v1:10.20.193.7:6789/0 conn(0x7f1d1c13cef0 0x7f1d1c13d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36514/0 (socket says 10.20.193.7:36514) 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1b7fe640 1 --2- 10.20.193.7:0/1833371068 >> v2:10.20.193.61:3300/0 conn(0x7f1d1c17e9a0 0x7f1d1c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1b7fe640 10 monclient(hunting): get_auth_request con 0x7f1d1c17e9a0 auth_method 0 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient(hunting): handle_auth_done global_id 94617 payload 274 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/1833371068 >> v2:10.20.193.61:3300/0 conn(0x7f1d1c17e9a0 msgr2=0x7f1d1c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 --2- 10.20.193.7:0/1833371068 >> v2:10.20.193.61:3300/0 conn(0x7f1d1c17e9a0 0x7f1d1c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.053 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/1833371068 >> v1:10.20.193.7:6789/0 conn(0x7f1d1c13cef0 legacy=0x7f1d1c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:02.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:59:02.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.045+0000 7f1d1a7fc640 1 monclient: found mon.noname-a 2026-02-22T20:59:02.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:02.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:02.054 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/1833371068 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c08aa00 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 --2- 10.20.193.7:0/1833371068 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c13de50 tx=0x7f1d0401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677fee6461fa8c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 1 -- 10.20.193.7:0/1833371068 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d040aa660 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: dump: 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 1 -- 10.20.193.7:0/1833371068 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d040af070 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.055 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 1 -- 10.20.193.7:0/1833371068 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d040aaa20 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 5 monclient: authenticate success, global_id 94617 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 4 set_mon_vals no callback set 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d19ffb640 10 monclient: dump: 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: shutdown 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- 10.20.193.7:0/1833371068 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13d9d0 msgr2=0x7f1d1c17e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- 10.20.193.7:0/1833371068 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c13de50 tx=0x7f1d0401c4e0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- 10.20.193.7:0/1833371068 shutdown_connections 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- 10.20.193.7:0/1833371068 >> v2:10.20.193.61:3300/0 conn(0x7f1d1c17e9a0 0x7f1d1c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- 10.20.193.7:0/1833371068 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- 10.20.193.7:0/1833371068 >> 10.20.193.7:0/1833371068 conn(0x7f1d1c08f860 msgr2=0x7f1d1c08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:02.056 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- 10.20.193.7:0/1833371068 shutdown_connections 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- 10.20.193.7:0/1833371068 wait complete. 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: build_initial_monmap 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: monmap: 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 Processor -- start 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- start start 2026-02-22T20:59:02.057 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: init 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 0x7f1d1c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-a con 0x7f1d1c13cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.059 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-b con 0x7f1d1c13d9d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): picked mon.noname-c con 0x7f1d1c17e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1a1e70 con 0x7f1d1c13cef0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1a1cf0 con 0x7f1d1c13d9d0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c1a1ff0 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d21834640 10 monclient(hunting): authenticate will time out at 954.527735s 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 0x7f1d1c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 0x7f1d1c19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39680/0 (socket says 10.20.193.7:39680) 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49642/0 (socket says 10.20.193.7:49642) 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 1 -- 10.20.193.7:0/536774097 learned_addr learned my addr 10.20.193.7:0/536774097 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): get_auth_request con 0x7f1d1c13cef0 auth_method 0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): get_auth_request con 0x7f1d1c17e9a0 auth_method 0 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:02.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 10 monclient(hunting): get_auth_request con 0x7f1d1c13d9d0 auth_method 0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 msgr2=0x7f1d1c17e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 10 monclient(hunting): handle_auth_done global_id 104300 payload 824 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 -- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 msgr2=0x7f1d1c17e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 1 -- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 msgr2=0x7f1d1c17e460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1a7fc640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.049+0000 7f1d1b7fe640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 1 -- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 msgr2=0x7f1d1c19e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 0x7f1d1c19e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 1 monclient: found mon.noname-c 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 1 -- 10.20.193.7:0/536774097 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c12a490 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1b7fe640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c007d80 tx=0x7f1d0c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:02.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00ee30 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: dump: 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c003a90 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c004020 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 10 monclient: dump: 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:02.062 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 5 monclient: authenticate success, global_id 104300 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d197fa640 4 set_mon_vals no callback set 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _renew_subs 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c05c830 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _renew_subs 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c12a1b0 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1d0c0041c0 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c0382a0 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 --2- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 0x7f1cec05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(232..232 src has 64..232) ==== 3503+0+0 (secure 0 0 0) 0x7f1d0c04eb50 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1affd640 1 --2- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 0x7f1cec05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1affd640 10 monclient: get_auth_request con 0x7f1cec03ab20 auth_method 0 2026-02-22T20:59:02.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.053+0000 7f1d1affd640 1 --2- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 0x7f1cec05afd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d10007fd0 tx=0x7f1d10002990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:02.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.057+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1d0c01c370 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.057+0000 7f1cf3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:02.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.057+0000 7f1cf3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1d1c19f080 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1cf3fff640 1 -- 10.20.193.7:0/536774097 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f1d0c021160 con 0x7f1d1c17e9a0 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1cf3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1cf3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:02.170 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 msgr2=0x7f1cec05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 0x7f1cec05afd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1d10007fd0 tx=0x7f1d10002990 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 10 monclient: shutdown 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 msgr2=0x7f1d1c086930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c007d80 tx=0x7f1d0c00e4b0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 shutdown_connections 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d1c17e9a0 0x7f1d1c086930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1cec03ab20 0x7f1cec05afd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d1c13d9d0 0x7f1d1c17e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 --2- 10.20.193.7:0/536774097 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d1c13cef0 0x7f1d1c19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 >> 10.20.193.7:0/536774097 conn(0x7f1d1c08f860 msgr2=0x7f1d1c05cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 shutdown_connections 2026-02-22T20:59:02.171 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:02.165+0000 7f1d21834640 1 -- 10.20.193.7:0/536774097 wait complete. 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: starting. 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21790 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: created object 0... 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: created object 25... 2026-02-22T20:59:03.450 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: created object 49... 2026-02-22T20:59:03.451 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: finishing. 2026-02-22T20:59:03.451 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21867]: shutting down. 2026-02-22T20:59:03.460 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:03.460 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: starting. 2026-02-22T20:59:03.460 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: listing objects. 2026-02-22T20:59:03.460 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: listed object 0... 2026-02-22T20:59:03.461 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: listed object 25... 2026-02-22T20:59:03.461 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: saw 50 objects 2026-02-22T20:59:03.461 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21869]: shutting down. 2026-02-22T20:59:04.404 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:04.404 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21868]: starting. 2026-02-22T20:59:04.404 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21868]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21790 2026-02-22T20:59:04.404 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21868]: shutting down. 2026-02-22T20:59:04.407 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:04.407 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:04.407 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:04.409 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:05.181 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: get_monmap_and_config 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: monmap: 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:05.241415+0000 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:05.241415+0000 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:05.241 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 Processor -- start 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 -- start start 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: init 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5a3c08c7a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f5a3c090b70 0x7f5a3c1806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-c con 0x7f5a3c090b70 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-b con 0x7f5a3c090f70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3c08d840 con 0x7f5a3c08c7a0 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f5a3c08db20 con 0x7f5a3c090b70 2026-02-22T20:59:05.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c0851e0 con 0x7f5a3c090f70 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a43883640 10 monclient(hunting): authenticate will time out at 957.714602s 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a415f8640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f5a3c08c7a0 0x7f5a3c090460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36526/0 (socket says 10.20.193.7:36526) 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a415f8640 1 -- 10.20.193.7:0/922338641 learned_addr learned my addr 10.20.193.7:0/922338641 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 --2- 10.20.193.7:0/922338641 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): get_auth_request con 0x7f5a3c090f70 auth_method 0 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a40df7640 1 --2- 10.20.193.7:0/922338641 >> v2:10.20.193.61:3300/0 conn(0x7f5a3c090b70 0x7f5a3c1806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a40df7640 10 monclient(hunting): get_auth_request con 0x7f5a3c090b70 auth_method 0 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a40df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a40df7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a40df7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 1 -- 10.20.193.7:0/922338641 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284656625 0 0) 0x7f5a3c08d840 con 0x7f5a3c08c7a0 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 10 monclient(hunting): _negotiate 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 10 monclient(hunting): my global_id is 94635 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a2bfff640 1 -- 10.20.193.7:0/922338641 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003620 con 0x7f5a3c08c7a0 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient(hunting): handle_auth_done global_id 104315 payload 274 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 -- 10.20.193.7:0/922338641 >> v2:10.20.193.61:3300/0 conn(0x7f5a3c090b70 msgr2=0x7f5a3c1806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 --2- 10.20.193.7:0/922338641 >> v2:10.20.193.61:3300/0 conn(0x7f5a3c090b70 0x7f5a3c1806e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 -- 10.20.193.7:0/922338641 >> v1:10.20.193.7:6789/0 conn(0x7f5a3c08c7a0 legacy=0x7f5a3c090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 monclient: found mon.noname-b 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.237+0000 7f5a41df9640 1 -- 10.20.193.7:0/922338641 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c08ed90 con 0x7f5a3c090f70 2026-02-22T20:59:05.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 1 --2- 10.20.193.7:0/922338641 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c1a0c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a38004b00 tx=0x7f5a3801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=242de82ef315d2ff server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 1 -- 10.20.193.7:0/922338641 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380b2070 con 0x7f5a3c090f70 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: dump: 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 1 -- 10.20.193.7:0/922338641 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380a5800 con 0x7f5a3c090f70 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 5 monclient: authenticate success, global_id 104315 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 1 -- 10.20.193.7:0/922338641 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380a5bf0 con 0x7f5a3c090f70 2026-02-22T20:59:05.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 4 set_mon_vals no callback set 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2bfff640 10 monclient: dump: 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: shutdown 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/922338641 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 msgr2=0x7f5a3c1a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- 10.20.193.7:0/922338641 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c1a0c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a38004b00 tx=0x7f5a3801c830 comp rx=0 tx=0).stop 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/922338641 shutdown_connections 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- 10.20.193.7:0/922338641 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c1a0c30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- 10.20.193.7:0/922338641 >> v2:10.20.193.61:3300/0 conn(0x7f5a3c090b70 0x7f5a3c1806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/922338641 >> 10.20.193.7:0/922338641 conn(0x7f5a3c08e050 msgr2=0x7f5a3c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/922338641 shutdown_connections 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/922338641 wait complete. 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: monmap: 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 Processor -- start 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- start start 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: init 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a3c08c7a0 0x7f5a3c1d9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-b con 0x7f5a3c08c7a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-a con 0x7f5a3c090b70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): picked mon.noname-c con 0x7f5a3c090f70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1a3d20 con 0x7f5a3c090b70 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c1a3ba0 con 0x7f5a3c08c7a0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c1a3ea0 con 0x7f5a3c090f70 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient(hunting): authenticate will time out at 957.718113s 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39690/0 (socket says 10.20.193.7:39690) 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 -- 10.20.193.7:0/440848733 learned_addr learned my addr 10.20.193.7:0/440848733 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): get_auth_request con 0x7f5a3c090b70 auth_method 0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49664/0 (socket says 10.20.193.7:49664) 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a3c08c7a0 0x7f5a3c1d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): get_auth_request con 0x7f5a3c090f70 auth_method 0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): get_auth_request con 0x7f5a3c08c7a0 auth_method 0 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a415f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient(hunting): handle_auth_done global_id 94638 payload 824 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 -- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 msgr2=0x7f5a3c059eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 -- 10.20.193.7:0/440848733 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a3c08c7a0 msgr2=0x7f5a3c1d9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a3c08c7a0 0x7f5a3c1d9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 -- 10.20.193.7:0/440848733 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c05b600 con 0x7f5a3c090b70 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a41df9640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a40df7640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a30006b80 tx=0x7f5a3000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30017070 con 0x7f5a3c090b70 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: dump: 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a3000ee50 con 0x7f5a3c090b70 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000f040 con 0x7f5a3c090b70 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 10 monclient: dump: 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.253 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a2b7fe640 4 set_mon_vals no callback set 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 5 monclient: authenticate success, global_id 94638 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _renew_subs 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c05d660 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _renew_subs 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c05be30 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c08d840 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5a30012050 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 --2- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 0x7f5a0c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.241+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(235..235 src has 64..235) ==== 3503+0+0 (secure 0 0 0) 0x7f5a3004e7d0 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a415f8640 1 --2- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 0x7f5a0c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a415f8640 10 monclient: get_auth_request con 0x7f5a0c03ab20 auth_method 0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a415f8640 1 --2- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 0x7f5a0c05afd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c007fd0 tx=0x7f5a2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5a3001fb90 con 0x7f5a3c090b70 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a29ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.245+0000 7f5a29ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5a3c05d150 con 0x7f5a3c090b70 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a29ffb640 1 -- 10.20.193.7:0/440848733 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f5a3001fde0 con 0x7f5a3c090b70 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a29ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a29ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:05.363 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 msgr2=0x7f5a0c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 0x7f5a0c05afd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c007fd0 tx=0x7f5a2c009040 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 10 monclient: shutdown 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 msgr2=0x7f5a3c1d9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.357+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a30006b80 tx=0x7f5a3000ec00 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 shutdown_connections 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a3c090f70 0x7f5a3c059eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a3c090b70 0x7f5a3c1d9b70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a0c03ab20 0x7f5a0c05afd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 --2- 10.20.193.7:0/440848733 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a3c08c7a0 0x7f5a3c1d9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 >> 10.20.193.7:0/440848733 conn(0x7f5a3c08e050 msgr2=0x7f5a3c0891f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.364 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 shutdown_connections 2026-02-22T20:59:05.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.361+0000 7f5a43883640 1 -- 10.20.193.7:0/440848733 wait complete. 2026-02-22T20:59:05.373 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:59:05.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:59:05.373 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 10 monclient: get_monmap_and_config 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 10 monclient: monmap: 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:05.443367+0000 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:05.443367+0000 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:05.443 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:05.444 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:05.444 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:05.444 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:05.444 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 1 Processor -- start 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 1 -- start start 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.437+0000 7fa66e3c5640 10 monclient: init 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa66808b590 0x7fa668139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-a con 0x7fa66808b590 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66813a4d0 0x7fa66813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-b con 0x7fa66813a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa66813d530 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa668089920 con 0x7fa66813d530 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fa66808ab40 con 0x7fa66808b590 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa66808a860 con 0x7fa66813a4d0 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): authenticate will time out at 957.916341s 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa66808b590 0x7fa668139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fa66808b590 0x7fa668139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39692/0 (socket says 10.20.193.7:39692) 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/2212474712 learned_addr learned my addr 10.20.193.7:0/2212474712 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): get_auth_request con 0x7fa66808b590 auth_method 0 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66813a4d0 0x7fa66813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): get_auth_request con 0x7fa66813a4d0 auth_method 0 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_done global_id 94641 payload 274 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66813a4d0 msgr2=0x7fa66813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66813a4d0 0x7fa66813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/2212474712 >> v1:10.20.193.61:6789/0 conn(0x7fa66813d530 legacy=0x7fa66819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/2212474712 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa668089170 con 0x7fa66808b590 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66808b590 0x7fa668139f90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6540090a0 tx=0x7fa65401c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64bc5cb3821bba1 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 1 -- 10.20.193.7:0/2212474712 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6540ab600 con 0x7fa66808b590 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: dump: 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.449 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 1 -- 10.20.193.7:0/2212474712 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540b0070 con 0x7fa66808b590 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 5 monclient: authenticate success, global_id 94641 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 1 -- 10.20.193.7:0/2212474712 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6540ab9c0 con 0x7fa66808b590 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 4 set_mon_vals no callback set 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa666ffd640 10 monclient: dump: 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: shutdown 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.450 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66808b590 msgr2=0x7fa668139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66808b590 0x7fa668139f90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6540090a0 tx=0x7fa65401c590 comp rx=0 tx=0).stop 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/2212474712 shutdown_connections 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66813a4d0 0x7fa66813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/2212474712 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66808b590 0x7fa668139f90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/2212474712 >> 10.20.193.7:0/2212474712 conn(0x7fa66808faa0 msgr2=0x7fa66808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/2212474712 shutdown_connections 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/2212474712 wait complete. 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: monmap: 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 Processor -- start 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- start start 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: init 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 0x7fa668138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-c con 0x7fa66808b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa66813a4d0 0x7fa6681393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-b con 0x7fa66813a4d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813d530 0x7fa668129a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.451 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): picked mon.noname-a con 0x7fa66813d530 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6681a22c0 con 0x7fa66813d530 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa66813aab0 con 0x7fa66813a4d0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa6681a2440 con 0x7fa66808b590 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): authenticate will time out at 957.919041s 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 0x7fa668138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813d530 0x7fa668129a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 0x7fa668138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49680/0 (socket says 10.20.193.7:49680) 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/162116578 learned_addr learned my addr 10.20.193.7:0/162116578 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): get_auth_request con 0x7fa66808b590 auth_method 0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): get_auth_request con 0x7fa66813d530 auth_method 0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa66813a4d0 0x7fa6681393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): get_auth_request con 0x7fa66813a4d0 auth_method 0 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.452 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient(hunting): handle_auth_done global_id 104324 payload 824 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa66813a4d0 msgr2=0x7fa6681393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa66813a4d0 0x7fa6681393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813d530 msgr2=0x7fa668129a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813d530 0x7fa668129a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 monclient: found mon.noname-c 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66812d890 con 0x7fa66808b590 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66c93b640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813d530 0x7fa668129a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa667fff640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 0x7fa668138e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa654002410 tx=0x7fa65401add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654004030 con 0x7fa66808b590 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: dump: 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.453 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540041d0 con 0x7fa66808b590 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654004580 con 0x7fa66808b590 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 5 monclient: authenticate success, global_id 104324 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa6667fc640 4 set_mon_vals no callback set 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _renew_subs 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6680869a0 con 0x7fa66808b590 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa664ff9640 10 monclient: dump: 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _renew_subs 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6681398e0 con 0x7fa66808b590 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 0x7fa66813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.441+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa668139f90 con 0x7fa6681504f0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 0x7fa66813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa654003710 con 0x7fa66808b590 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient: get_auth_request con 0x7fa6681504f0 auth_method 0 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.454 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 10 monclient(hunting): handle_auth_done global_id 94647 payload 824 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa66812b530 con 0x7fa6681504f0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 --2- 10.20.193.7:0/162116578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa63803ab20 0x7fa63805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(236..236 src has 64..236) ==== 3897+0+0 (secure 0 0 0) 0x7fa6540e8f10 con 0x7fa66808b590 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa6677fe640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 0x7fa66813ac50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6680889b0 tx=0x7fa658011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65800fa00 con 0x7fa6681504f0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 10 monclient: dump: 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa66c93b640 1 --2- 10.20.193.7:0/162116578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa63803ab20 0x7fa63805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa66c93b640 10 monclient: get_auth_request con 0x7fa63803ab20 auth_method 0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fa65800fa00 con 0x7fa6681504f0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 msgr2=0x7fa66813ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 0x7fa66813ac50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6680889b0 tx=0x7fa658011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:05.455 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 msgr2=0x7fa66813ac50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa664ff9640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6681504f0 0x7fa66813ac50 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6680889b0 tx=0x7fa658011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:05.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa66c93b640 1 --2- 10.20.193.7:0/162116578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa63803ab20 0x7fa63805afd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa65c003b30 tx=0x7fa65c004270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.456 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa66e3c5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.445+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 0x7fa66813b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa66805fc70 con 0x7fa66813b190 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 0x7fa66813b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient: get_auth_request con 0x7fa66813b190 auth_method 0 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 10 monclient(hunting): handle_auth_done global_id 94650 payload 824 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 1 -- 10.20.193.7:0/162116578 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa66812a770 con 0x7fa66813b190 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa6677fe640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 0x7fa66813b590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa658019000 tx=0x7fa6580047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658022b20 con 0x7fa66813b190 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 10 monclient: dump: 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7fa658026070 con 0x7fa66813b190 2026-02-22T20:59:05.457 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 msgr2=0x7fa66813b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 0x7fa66813b590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa658019000 tx=0x7fa6580047b0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 msgr2=0x7fa66813b590 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa664ff9640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa66813b190 0x7fa66813b590 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa658019000 tx=0x7fa6580047b0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 118133, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:59:05.458 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.459 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.460 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.461 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:05.462 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.463 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:05.464 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa63803ab20 msgr2=0x7fa63805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/162116578 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa63803ab20 0x7fa63805afd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa65c003b30 tx=0x7fa65c004270 comp rx=0 tx=0).stop 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 10 monclient: shutdown 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 msgr2=0x7fa668138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 --2- 10.20.193.7:0/162116578 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa66808b590 0x7fa668138e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa654002410 tx=0x7fa65401add0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66c93b640 1 -- 10.20.193.7:0/162116578 reap_dead start 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66c93b640 1 -- 10.20.193.7:0/162116578 reap_dead start 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 shutdown_connections 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 >> 10.20.193.7:0/162116578 conn(0x7fa66808faa0 msgr2=0x7fa668086d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 shutdown_connections 2026-02-22T20:59:05.465 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.449+0000 7fa66e3c5640 1 -- 10.20.193.7:0/162116578 wait complete. 2026-02-22T20:59:05.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:05.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:59:05.465 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: get_monmap_and_config 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: monmap: 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:05.525995+0000 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:05.525995+0000 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:05.526 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 Processor -- start 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 -- start start 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: init 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe488091c70 0x7fe488092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-c con 0x7fe488091c70 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe48813f1b0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-b con 0x7fe48813fce0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48808e6a0 con 0x7fe48813f1b0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe48808e910 con 0x7fe488091c70 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe48808ebf0 con 0x7fe48813fce0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48f391640 10 monclient(hunting): authenticate will time out at 957.999258s 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe488091c70 0x7fe488092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48c905640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7fe48813f1b0 0x7fe48813f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:56814/0 (socket says 10.20.193.7:56814) 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49688/0 (socket says 10.20.193.7:49688) 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 -- 10.20.193.7:0/371317416 learned_addr learned my addr 10.20.193.7:0/371317416 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): get_auth_request con 0x7fe48813fce0 auth_method 0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): get_auth_request con 0x7fe488091c70 auth_method 0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient(hunting): handle_auth_done global_id 104327 payload 274 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 -- 10.20.193.7:0/371317416 >> v2:10.20.193.61:3300/0 conn(0x7fe488091c70 msgr2=0x7fe488092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 --2- 10.20.193.7:0/371317416 >> v2:10.20.193.61:3300/0 conn(0x7fe488091c70 0x7fe488092040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 -- 10.20.193.7:0/371317416 >> v1:10.20.193.61:6789/0 conn(0x7fe48813f1b0 legacy=0x7fe48813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 monclient: found mon.noname-b 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.521+0000 7fe48d907640 1 -- 10.20.193.7:0/371317416 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48808eed0 con 0x7fe48813fce0 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 1 --2- 10.20.193.7:0/371317416 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe484009580 tx=0x7fe48401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d870c8c4475a04ce server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 1 -- 10.20.193.7:0/371317416 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840b2070 con 0x7fe48813fce0 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: dump: 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.529 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 1 -- 10.20.193.7:0/371317416 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4840a59d0 con 0x7fe48813fce0 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 1 -- 10.20.193.7:0/371317416 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5dc0 con 0x7fe48813fce0 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 5 monclient: authenticate success, global_id 104327 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 4 set_mon_vals no callback set 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe477fff640 10 monclient: dump: 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.530 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: shutdown 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- 10.20.193.7:0/371317416 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 msgr2=0x7fe4881a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- 10.20.193.7:0/371317416 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe484009580 tx=0x7fe48401c8f0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- 10.20.193.7:0/371317416 shutdown_connections 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- 10.20.193.7:0/371317416 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe4881a1510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- 10.20.193.7:0/371317416 >> v2:10.20.193.61:3300/0 conn(0x7fe488091c70 0x7fe488092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- 10.20.193.7:0/371317416 >> 10.20.193.7:0/371317416 conn(0x7fe488093d80 msgr2=0x7fe488090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- 10.20.193.7:0/371317416 shutdown_connections 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- 10.20.193.7:0/371317416 wait complete. 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: monmap: 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 Processor -- start 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- start start 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: init 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 0x7fe488150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-a con 0x7fe488091c70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe48813f1b0 0x7fe488150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-b con 0x7fe48813f1b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe48812aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): picked mon.noname-c con 0x7fe48813fce0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881a43f0 con 0x7fe488091c70 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881a4270 con 0x7fe48813f1b0 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe4881a4570 con 0x7fe48813fce0 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48f391640 10 monclient(hunting): authenticate will time out at 958.003445s 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 0x7fe488150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 0x7fe488150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39722/0 (socket says 10.20.193.7:39722) 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 -- 10.20.193.7:0/2522933961 learned_addr learned my addr 10.20.193.7:0/2522933961 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): get_auth_request con 0x7fe488091c70 auth_method 0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe48812aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): get_auth_request con 0x7fe48813fce0 auth_method 0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d907640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48c905640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe48813f1b0 0x7fe488150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48c905640 10 monclient(hunting): get_auth_request con 0x7fe48813f1b0 auth_method 0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48c905640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48c905640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48c905640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient(hunting): handle_auth_done global_id 94653 payload 824 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 msgr2=0x7fe48812aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48813fce0 0x7fe48812aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe48813f1b0 msgr2=0x7fe488150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe48813f1b0 0x7fe488150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48812e800 con 0x7fe488091c70 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe48d106640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 0x7fe488150520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe47800e980 tx=0x7fe47800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478017070 con 0x7fe488091c70 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe475ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.525+0000 7fe475ffb640 10 monclient: dump: 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47800ca00 con 0x7fe488091c70 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47800cdf0 con 0x7fe488091c70 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 5 monclient: authenticate success, global_id 94653 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 monclient: _renew_subs 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe4777fe640 4 set_mon_vals no callback set 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48808a970 con 0x7fe488091c70 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: dump: 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 monclient: _renew_subs 2026-02-22T20:59:05.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48812c4a0 con 0x7fe488091c70 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 0x7fe48812b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe488092040 con 0x7fe48812b000 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 0x7fe48812b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient: get_auth_request con 0x7fe48812b000 auth_method 0 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 10 monclient(hunting): handle_auth_done global_id 104333 payload 824 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe48812e5e0 con 0x7fe48812b000 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe478013470 con 0x7fe488091c70 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48c905640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 0x7fe48812b3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe48812d620 tx=0x7fe47c0030a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 --2- 10.20.193.7:0/2522933961 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe45803ab20 0x7fe45805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(236..236 src has 64..236) ==== 3897+0+0 (secure 0 0 0) 0x7fe47804f060 con 0x7fe488091c70 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c019070 con 0x7fe48812b000 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: dump: 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.536 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48d907640 1 --2- 10.20.193.7:0/2522933961 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe45803ab20 0x7fe45805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48d907640 10 monclient: get_auth_request con 0x7fe45803ab20 auth_method 0 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fe47c010510 con 0x7fe48812b000 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 msgr2=0x7fe48812b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 0x7fe48812b3d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe48812d620 tx=0x7fe47c0030a0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 msgr2=0x7fe48812b3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe475ffb640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b000 0x7fe48812b3d0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe48812d620 tx=0x7fe47c0030a0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.529+0000 7fe48d907640 1 --2- 10.20.193.7:0/2522933961 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe45803ab20 0x7fe45805afd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe48401afa0 tx=0x7fe4840a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 0x7fe4880876f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe488092890 con 0x7fe48812b910 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 0x7fe4880876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient: get_auth_request con 0x7fe48812b910 auth_method 0 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 10 monclient(hunting): handle_auth_done global_id 104336 payload 824 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 1 -- 10.20.193.7:0/2522933961 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe48812d000 con 0x7fe48812b910 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48c905640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 0x7fe4880876f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe47c013000 tx=0x7fe47c0026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c019050 con 0x7fe48812b910 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 10 monclient: dump: 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5047 (secure 0 0 0) 0x7fe47c01a040 con 0x7fe48812b910 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 msgr2=0x7fe4880876f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 0x7fe4880876f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe47c013000 tx=0x7fe47c0026e0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 msgr2=0x7fe4880876f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe475ffb640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe48812b910 0x7fe4880876f0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe47c013000 tx=0x7fe47c0026e0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 55299, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.539 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.540 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.541 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.542 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.543 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe45803ab20 msgr2=0x7fe45805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 --2- 10.20.193.7:0/2522933961 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe45803ab20 0x7fe45805afd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe48401afa0 tx=0x7fe4840a7070 comp rx=0 tx=0).stop 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 10 monclient: shutdown 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 msgr2=0x7fe488150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 --2- 10.20.193.7:0/2522933961 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe488091c70 0x7fe488150520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe47800e980 tx=0x7fe47800ee40 comp rx=0 tx=0).stop 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48d907640 1 -- 10.20.193.7:0/2522933961 reap_dead start 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48d907640 1 -- 10.20.193.7:0/2522933961 reap_dead start 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 shutdown_connections 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 >> 10.20.193.7:0/2522933961 conn(0x7fe488093d80 msgr2=0x7fe488056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.544 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 shutdown_connections 2026-02-22T20:59:05.545 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.533+0000 7fe48f391640 1 -- 10.20.193.7:0/2522933961 wait complete. 2026-02-22T20:59:05.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:05.545 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:59:05.545 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: get_monmap_and_config 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: monmap: 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:05.614928+0000 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:05.614928+0000 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:05.615 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 Processor -- start 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 -- start start 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: init 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff32c13f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff32c13fd70 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff32c181ee0 0x7ff32c1a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-a con 0x7ff32c181ee0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c08fd70 con 0x7ff32c13f290 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c092bc0 con 0x7ff32c13fd70 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c08e1f0 con 0x7ff32c181ee0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.609+0000 7ff3344a0640 10 monclient(hunting): authenticate will time out at 958.087920s 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff32c181ee0 0x7ff32c1a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7ff32c13f290 0x7ff32c13f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36528/0 (socket says 10.20.193.7:36528) 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 1 -- 10.20.193.7:0/2279941135 learned_addr learned my addr 10.20.193.7:0/2279941135 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): get_auth_request con 0x7ff32c181ee0 auth_method 0 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_done global_id 94656 payload 274 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/2279941135 >> v1:10.20.193.61:6789/0 conn(0x7ff32c13fd70 legacy=0x7ff32c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/2279941135 >> v1:10.20.193.7:6789/0 conn(0x7ff32c13f290 legacy=0x7ff32c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/2279941135 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c08e6d0 con 0x7ff32c181ee0 2026-02-22T20:59:05.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- 10.20.193.7:0/2279941135 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c1a22c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff328004b00 tx=0x7ff32801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2715691341290da server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 1 -- 10.20.193.7:0/2279941135 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280b2070 con 0x7ff32c181ee0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: dump: 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 1 -- 10.20.193.7:0/2279941135 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3280a5890 con 0x7ff32c181ee0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 1 -- 10.20.193.7:0/2279941135 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280a5c80 con 0x7ff32c181ee0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331213640 10 monclient: dump: 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 5 monclient: authenticate success, global_id 94656 2026-02-22T20:59:05.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:05.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 4 set_mon_vals no callback set 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: shutdown 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- 10.20.193.7:0/2279941135 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 msgr2=0x7ff32c1a22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 --2- 10.20.193.7:0/2279941135 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c1a22c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff328004b00 tx=0x7ff32801c8c0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- 10.20.193.7:0/2279941135 shutdown_connections 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 --2- 10.20.193.7:0/2279941135 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c1a22c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- 10.20.193.7:0/2279941135 >> 10.20.193.7:0/2279941135 conn(0x7ff32c093df0 msgr2=0x7ff32c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- 10.20.193.7:0/2279941135 shutdown_connections 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- 10.20.193.7:0/2279941135 wait complete. 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: monmap: 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 Processor -- start 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- start start 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: init 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13f290 0x7ff32c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-b con 0x7ff32c13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13fd70 0x7ff32c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-c con 0x7ff32c13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): picked mon.noname-a con 0x7ff32c181ee0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1a5870 con 0x7ff32c181ee0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1a56f0 con 0x7ff32c13f290 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c1a59f0 con 0x7ff32c13fd70 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff3344a0640 10 monclient(hunting): authenticate will time out at 958.091654s 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13fd70 0x7ff32c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39728/0 (socket says 10.20.193.7:39728) 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 learned_addr learned my addr 10.20.193.7:0/3357171754 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): get_auth_request con 0x7ff32c181ee0 auth_method 0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): get_auth_request con 0x7ff32c13fd70 auth_method 0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13f290 0x7ff32c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): get_auth_request con 0x7ff32c13f290 auth_method 0 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff331a14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 10 monclient(hunting): handle_auth_done global_id 94662 payload 824 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13fd70 msgr2=0x7ff32c19b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13fd70 0x7ff32c19b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13f290 msgr2=0x7ff32c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.613+0000 7ff332a16640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c13f290 0x7ff32c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c19cfa0 con 0x7ff32c181ee0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff331a14640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff32c13fd70 0x7ff32c19b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332a16640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c19bb90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff32801ce30 tx=0x7ff328019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280b2040 con 0x7ff32c181ee0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: dump: 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3280bb070 con 0x7ff32c181ee0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 5 monclient: authenticate success, global_id 94662 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 monclient: _renew_subs 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c057220 con 0x7ff32c181ee0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280a5e40 con 0x7ff32c181ee0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff330a12640 4 set_mon_vals no callback set 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: dump: 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.623 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 monclient: _renew_subs 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c19f300 con 0x7ff32c181ee0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 0x7ff32c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c19ef80 con 0x7ff32c19b010 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 0x7ff32c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient: get_auth_request con 0x7ff32c19b010 auth_method 0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff3280b5070 con 0x7ff32c181ee0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 10 monclient(hunting): handle_auth_done global_id 114136 payload 824 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff32c13f660 con 0x7ff32c19b010 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 --2- 10.20.193.7:0/3357171754 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2fc03ab20 0x7ff2fc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(236..236 src has 64..236) ==== 3897+0+0 (secure 0 0 0) 0x7ff3280e8e80 con 0x7ff32c181ee0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff332215640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 0x7ff32c19c0d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff32c1a2410 tx=0x7ff31c00fb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff331a14640 1 --2- 10.20.193.7:0/3357171754 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2fc03ab20 0x7ff2fc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff331a14640 10 monclient: get_auth_request con 0x7ff2fc03ab20 auth_method 0 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0059b0 con 0x7ff32c19b010 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: dump: 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7ff31c018070 con 0x7ff32c19b010 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 msgr2=0x7ff32c19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 0x7ff32c19c0d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff32c1a2410 tx=0x7ff31c00fb90 comp rx=0 tx=0).stop 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 msgr2=0x7ff32c19c0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff312ffd640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19b010 0x7ff32c19c0d0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff32c1a2410 tx=0x7ff31c00fb90 comp rx=0 tx=0).stop 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.617+0000 7ff331a14640 1 --2- 10.20.193.7:0/3357171754 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2fc03ab20 0x7ff2fc05afd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff32c1a27d0 tx=0x7ff320007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:05.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 0x7ff32c0889b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c19ca10 con 0x7ff32c19c610 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 0x7ff32c0889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient: get_auth_request con 0x7ff32c19c610 auth_method 0 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 10 monclient(hunting): handle_auth_done global_id 114139 payload 824 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 1 -- 10.20.193.7:0/3357171754 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff32c19e750 con 0x7ff32c19c610 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332215640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 0x7ff32c0889b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00fbd0 tx=0x7ff31c0058f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0073a0 con 0x7ff32c19c610 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 10 monclient: dump: 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.626 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7ff31c0073a0 con 0x7ff32c19c610 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 msgr2=0x7ff32c0889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 0x7ff32c0889b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00fbd0 tx=0x7ff31c0058f0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 msgr2=0x7ff32c0889b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 6807, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 2, 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.627 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:05.628 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:05.629 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:05.630 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T20:59:05.631 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff312ffd640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff32c19c610 0x7ff32c0889b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00fbd0 tx=0x7ff31c0058f0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2fc03ab20 msgr2=0x7ff2fc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 --2- 10.20.193.7:0/3357171754 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff2fc03ab20 0x7ff2fc05afd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff32c1a27d0 tx=0x7ff320007f20 comp rx=0 tx=0).stop 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 10 monclient: shutdown 2026-02-22T20:59:05.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 msgr2=0x7ff32c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 --2- 10.20.193.7:0/3357171754 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff32c181ee0 0x7ff32c19bb90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff32801ce30 tx=0x7ff328019660 comp rx=0 tx=0).stop 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 reap_dead start 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff332a16640 1 -- 10.20.193.7:0/3357171754 reap_dead start 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 shutdown_connections 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 >> 10.20.193.7:0/3357171754 conn(0x7ff32c093df0 msgr2=0x7ff32c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 shutdown_connections 2026-02-22T20:59:05.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.621+0000 7ff3344a0640 1 -- 10.20.193.7:0/3357171754 wait complete. 2026-02-22T20:59:05.634 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:05.634 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:59:05.635 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:59:05.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: get_monmap_and_config 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: monmap: 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:05.697207+0000 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:05.697207+0000 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 Processor -- start 2026-02-22T20:59:05.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 -- start start 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: init 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient: _add_conns ranks=[1,2,0,3,4] 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa6ec13f290 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-b con 0x7fa6ec13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa6ec180d00 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ec08fd70 con 0x7fa6ec180d00 2026-02-22T20:59:05.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ec092bc0 con 0x7fa6ec13f290 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ec08e1f0 con 0x7fa6ec13fd70 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f3b20640 10 monclient(hunting): authenticate will time out at 958.170097s 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f2096640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fa6ec180d00 0x7fa6ec1a10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36542/0 (socket says 10.20.193.7:36542) 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f2096640 1 -- 10.20.193.7:0/3431012677 learned_addr learned my addr 10.20.193.7:0/3431012677 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 1 --2- 10.20.193.7:0/3431012677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): get_auth_request con 0x7fa6ec13fd70 auth_method 0 2026-02-22T20:59:05.701 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient(hunting): handle_auth_done global_id 104342 payload 274 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 1 -- 10.20.193.7:0/3431012677 >> v1:10.20.193.61:6789/0 conn(0x7fa6ec13f290 legacy=0x7fa6ec13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 1 -- 10.20.193.7:0/3431012677 >> v1:10.20.193.7:6789/0 conn(0x7fa6ec180d00 legacy=0x7fa6ec1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 1 monclient: found mon.noname-b 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f0893640 1 -- 10.20.193.7:0/3431012677 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961915683 0 0) 0x7fa6e8002ca0 con 0x7fa6ec180d00 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f1094640 1 -- 10.20.193.7:0/3431012677 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec08e6d0 con 0x7fa6ec13fd70 2026-02-22T20:59:05.702 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.693+0000 7fa6f0893640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 1 --2- 10.20.193.7:0/3431012677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009840 tx=0x7fa6e001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9869a1f61c966b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 1 -- 10.20.193.7:0/3431012677 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00b1070 con 0x7fa6ec13fd70 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: dump: 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.707 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 1 -- 10.20.193.7:0/3431012677 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e00ac640 con 0x7fa6ec13fd70 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 1 -- 10.20.193.7:0/3431012677 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00aca10 con 0x7fa6ec13fd70 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 5 monclient: authenticate success, global_id 104342 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 4 set_mon_vals no callback set 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f0893640 10 monclient: dump: 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.708 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: shutdown 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/3431012677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 msgr2=0x7fa6ec1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/3431012677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009840 tx=0x7fa6e001c400 comp rx=0 tx=0).stop 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/3431012677 shutdown_connections 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/3431012677 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/3431012677 >> 10.20.193.7:0/3431012677 conn(0x7fa6ec093df0 msgr2=0x7fa6ec0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/3431012677 shutdown_connections 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/3431012677 wait complete. 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: build_initial_monmap 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: monmap: 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:05.709 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 Processor -- start 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- start start 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: init 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-a con 0x7fa6ec13f290 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-b con 0x7fa6ec13fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec180d00 0x7fa6ec19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): picked mon.noname-c con 0x7fa6ec180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:05.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec1a5870 con 0x7fa6ec13f290 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec1a56f0 con 0x7fa6ec13fd70 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ec1a59f0 con 0x7fa6ec180d00 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient(hunting): authenticate will time out at 958.173514s 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39742/0 (socket says 10.20.193.7:39742) 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 -- 10.20.193.7:0/2609162348 learned_addr learned my addr 10.20.193.7:0/2609162348 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): get_auth_request con 0x7fa6ec13f290 auth_method 0 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec180d00 0x7fa6ec19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): get_auth_request con 0x7fa6ec180d00 auth_method 0 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f2096640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 10 monclient(hunting): get_auth_request con 0x7fa6ec13fd70 auth_method 0 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient(hunting): handle_auth_done global_id 94668 payload 824 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 -- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec180d00 msgr2=0x7fa6ec19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec180d00 0x7fa6ec19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 -- 10.20.193.7:0/2609162348 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa6ec13fd70 msgr2=0x7fa6ec1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient: _finish_hunting 0 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 monclient: found mon.noname-a 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 -- 10.20.193.7:0/2609162348 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec19e030 con 0x7fa6ec13f290 2026-02-22T20:59:05.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1895640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c520 tx=0x7fa6dc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc017070 con 0x7fa6ec13f290 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: dump: 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6dc006ad0 con 0x7fa6ec13f290 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 5 monclient: authenticate success, global_id 94668 2026-02-22T20:59:05.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _renew_subs 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec08a9e0 con 0x7fa6ec13f290 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc007030 con 0x7fa6ec13f290 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 10 monclient: dump: 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6dbfff640 4 set_mon_vals no callback set 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _renew_subs 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec19da70 con 0x7fa6ec13f290 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec19c890 con 0x7fa6ec13f290 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa6dc0071d0 con 0x7fa6ec13f290 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 --2- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 0x7fa6bc05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(236..236 src has 64..236) ==== 3897+0+0 (secure 0 0 0) 0x7fa6dc04dfe0 con 0x7fa6ec13f290 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 1 --2- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 0x7fa6bc05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 10 monclient: get_auth_request con 0x7fa6bc03ab20 auth_method 0 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.697+0000 7fa6f1094640 1 --2- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 0x7fa6bc05afd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa6e001a090 tx=0x7fa6e00a6070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.701+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa6dc01a360 con 0x7fa6ec13f290 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.701+0000 7fa6da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:05.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.701+0000 7fa6da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:05.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:59:05.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:59:05.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:05.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa6ec13f660 con 0x7fa6ec13f290 2026-02-22T20:59:05.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6da7fc640 1 -- 10.20.193.7:0/2609162348 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa6dc009d40 con 0x7fa6ec13f290 2026-02-22T20:59:05.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:59:05.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:05.819 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.819 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=7,logm=60} crc {auth=2521080710,config=3140514009,health=2003857081,kv=3329530888,logm=3479451743}) 2026-02-22T20:59:05.819 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=13,kv=9,logm=59} crc {auth=583076231,config=3140514009,health=2003857081,kv=3802980238,logm=1702350647}) 2026-02-22T20:59:05.820 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.820 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=7,logm=60} crc {auth=2521080710,config=3140514009,health=2003857081,kv=3329530888,logm=3479451743}) 2026-02-22T20:59:05.820 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=429756496,config=3140514009,health=4052663857,kv=3991984195,logm=919173333}) 2026-02-22T20:59:05.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 msgr2=0x7fa6bc05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 0x7fa6bc05afd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa6e001a090 tx=0x7fa6e00a6070 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 10 monclient: shutdown 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 msgr2=0x7fa6ec19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c520 tx=0x7fa6dc00c9e0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 shutdown_connections 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa6ec180d00 0x7fa6ec19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa6bc03ab20 0x7fa6bc05afd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa6ec13fd70 0x7fa6ec1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 --2- 10.20.193.7:0/2609162348 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa6ec13f290 0x7fa6ec19a6d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 >> 10.20.193.7:0/2609162348 conn(0x7fa6ec093df0 msgr2=0x7fa6ec057420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 shutdown_connections 2026-02-22T20:59:05.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:05.813+0000 7fa6f3b20640 1 -- 10.20.193.7:0/2609162348 wait complete. 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2196223971}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1526380421}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2196223971}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.813+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1761389674}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355705046}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1122685162}) 2026-02-22T20:59:05.824 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355705046}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1373797871}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3129408435}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3852872799}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3129408435}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4177874642}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726706437}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1212931000}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726706437}) 2026-02-22T20:59:05.825 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1350921167}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=466929278}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=491693453}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=466929278}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1920162902}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4213671865}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2932330085}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4213671865}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=376378060}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=399041312}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3098367731}) 2026-02-22T20:59:05.826 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=399041312}) 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.817+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1509614758}) 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291783372}) 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=20734195}) 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291783372}) 2026-02-22T20:59:05.827 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3186681067}) 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2514318229}) 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=222766283}) 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2514318229}) 2026-02-22T20:59:05.829 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1955632924}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=346127343}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=996736625}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=346127343}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4187415691}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3785629016}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2115612693}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3785629016}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3257492080}) 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.830 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3064140021}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=167837413}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3064140021}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1635802460}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1135685072}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1486244897}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1135685072}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.821+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3531349001}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208898833}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3872194299}) 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.831 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208898833}) 2026-02-22T20:59:05.832 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1035943569}) 2026-02-22T20:59:05.832 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.832 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934212126}) 2026-02-22T20:59:05.832 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2433399892}) 2026-02-22T20:59:05.833 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=934212126}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3597282105}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3735820579}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1310578604}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3735820579}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1835419003}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3736855209}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=446963182}) 2026-02-22T20:59:05.835 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3736855209}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1999306538}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=19,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=2873724930,mdsmap=1256979633,mgr=3188950013,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1507670767,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1866704386,osd_snap=4133920409,osdmap=1202501196}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=20,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=2418560634,mdsmap=1256979633,mgr=436450291,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2535601024,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=935146538,osd_metadata=2266821947,osd_pg_creating=1866704386,osd_snap=4133920409,osdmap=3972030411}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=19,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=2873724930,mdsmap=1256979633,mgr=3188950013,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1507670767,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=1866704386,osd_snap=4133920409,osdmap=1202501196}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=20,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=34} crc {logm=3166443636,mdsmap=3140514009,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3245335072,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=1015207667,osd_pg_creating=1866704386,osd_snap=4133920409,osdmap=1552479248}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3612615091}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=459373246}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3612615091}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.825+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=374824555}) 2026-02-22T20:59:05.836 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=667301875}) 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1059552554}) 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=667301875}) 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.829+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1795478665}) 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.837 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=3053323631}) 2026-02-22T20:59:05.838 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=33} crc {osdmap=3584318483}) 2026-02-22T20:59:05.838 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:05.838 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=3053323631}) 2026-02-22T20:59:05.838 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:05.833+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=33} crc {osdmap=340111036}) 2026-02-22T20:59:06.468 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: starting. 2026-02-22T20:59:06.468 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21920 2026-02-22T20:59:06.468 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: created object 0... 2026-02-22T20:59:06.468 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: created object 25... 2026-02-22T20:59:06.468 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: created object 49... 2026-02-22T20:59:06.469 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: finishing. 2026-02-22T20:59:06.469 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[21921]: shutting down. 2026-02-22T20:59:06.834 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:59:06.834 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:06.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: get_monmap_and_config 2026-02-22T20:59:06.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: build_initial_monmap 2026-02-22T20:59:06.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: monmap: 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:06.902638+0000 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:06.902638+0000 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:06.904 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:06.905 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 Processor -- start 2026-02-22T20:59:06.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 -- start start 2026-02-22T20:59:06.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: init 2026-02-22T20:59:06.912 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:06.912 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient: _add_conns ranks=[1,2,3,0,4] 2026-02-22T20:59:06.912 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f787c13cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:06.912 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-b con 0x7f787c13d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f787c17e9a0 0x7f787c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-a con 0x7f787c17e9a0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787c05d510 con 0x7f787c13cef0 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f787c08ad70 con 0x7f787c17e9a0 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f787c08b850 con 0x7f787c13d9d0 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.897+0000 7f78821cf640 10 monclient(hunting): authenticate will time out at 959.375919s 2026-02-22T20:59:06.913 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f787c17e9a0 0x7f787c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f787c17e9a0 0x7f787c19ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39750/0 (socket says 10.20.193.7:39750) 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49758/0 (socket says 10.20.193.7:49758) 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 -- 10.20.193.7:0/2610142941 learned_addr learned my addr 10.20.193.7:0/2610142941 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): get_auth_request con 0x7f787c17e9a0 auth_method 0 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): get_auth_request con 0x7f787c13d9d0 auth_method 0 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:06.914 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient(hunting): handle_auth_done global_id 94671 payload 274 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 -- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 msgr2=0x7f787c17e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 --2- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 -- 10.20.193.7:0/2610142941 >> v1:10.20.193.61:6789/0 conn(0x7f787c13cef0 legacy=0x7f787c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:06.915 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 monclient: found mon.noname-a 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 -- 10.20.193.7:0/2610142941 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c08a770 con 0x7f787c17e9a0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787bfff640 1 --2- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c17e9a0 0x7f787c19ed80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7870009580 tx=0x7f787001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbcae7939d2fdd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 1 -- 10.20.193.7:0/2610142941 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700b2070 con 0x7f787c17e9a0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: dump: 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.916 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 1 -- 10.20.193.7:0/2610142941 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78700a58c0 con 0x7f787c17e9a0 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:06.917 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 1 -- 10.20.193.7:0/2610142941 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700a5cb0 con 0x7f787c17e9a0 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f787a7fc640 10 monclient: dump: 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:06.918 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 5 monclient: authenticate success, global_id 94671 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 4 set_mon_vals no callback set 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 10 monclient: shutdown 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c17e9a0 msgr2=0x7f787c19ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 --2- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c17e9a0 0x7f787c19ed80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7870009580 tx=0x7f787001c8f0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- 10.20.193.7:0/2610142941 shutdown_connections 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 --2- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c17e9a0 0x7f787c19ed80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 --2- 10.20.193.7:0/2610142941 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.919 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- 10.20.193.7:0/2610142941 >> 10.20.193.7:0/2610142941 conn(0x7f787c08f860 msgr2=0x7f787c08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- 10.20.193.7:0/2610142941 shutdown_connections 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- 10.20.193.7:0/2610142941 wait complete. 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 10 monclient: build_initial_monmap 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 10 monclient: monmap: 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:06.920 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 Processor -- start 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 1 -- start start 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.901+0000 7f78821cf640 10 monclient: init 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-a con 0x7f787c13cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-c con 0x7f787c13d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 0x7f787c129580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.921 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): picked mon.noname-b con 0x7f787c17e9a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1a1f50 con 0x7f787c13cef0 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1a1dd0 con 0x7f787c17e9a0 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f787c1a20d0 con 0x7f787c13d9d0 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient(hunting): authenticate will time out at 959.380204s 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39766/0 (socket says 10.20.193.7:39766) 2026-02-22T20:59:06.922 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 -- 10.20.193.7:0/3955949932 learned_addr learned my addr 10.20.193.7:0/3955949932 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): get_auth_request con 0x7f787c13d9d0 auth_method 0 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): get_auth_request con 0x7f787c13cef0 auth_method 0 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:06.923 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787bfff640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 0x7f787c129580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient(hunting): handle_auth_done global_id 104351 payload 824 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 -- 10.20.193.7:0/3955949932 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 msgr2=0x7f787c129580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 0x7f787c129580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 -- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 msgr2=0x7f787c12cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 monclient: found mon.noname-c 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:06.924 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 -- 10.20.193.7:0/3955949932 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c10e400 con 0x7f787c13d9d0 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787bfff640 10 monclient: get_auth_request con 0x7f787c17e9a0 auth_method 0 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787bfff640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 0x7f787c129580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787affd640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f786c004780 tx=0x7f786c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c00c8e0 con 0x7f787c13d9d0 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: dump: 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.925 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c00ca80 con 0x7f787c13d9d0 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:06.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c004030 con 0x7f787c13d9d0 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 10 monclient: dump: 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:06.927 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7879ffb640 4 set_mon_vals no callback set 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 5 monclient: authenticate success, global_id 104351 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _renew_subs 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c05c680 con 0x7f787c13d9d0 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _renew_subs 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c10e120 con 0x7f787c13d9d0 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:06.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c087dd0 con 0x7f787c13d9d0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f786c0041d0 con 0x7f787c13d9d0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 --2- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 0x7f784c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(237..237 src has 64..237) ==== 3897+0+0 (secure 0 0 0) 0x7f786c04ec80 con 0x7f787c13d9d0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 --2- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 0x7f784c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 10 monclient: get_auth_request con 0x7f784c03ab20 auth_method 0 2026-02-22T20:59:06.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.905+0000 7f787b7fe640 1 --2- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 0x7f784c05afd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7868002770 tx=0x7f7868007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:06.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.909+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f786c054020 con 0x7f787c13d9d0 2026-02-22T20:59:06.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.909+0000 7f7857fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:06.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:06.909+0000 7f7857fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:06.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:06.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f787c05fc00 con 0x7f787c13d9d0 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f7857fff640 1 -- 10.20.193.7:0/3955949932 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f786c017020 con 0x7f787c13d9d0 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f7857fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:07.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f7857fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:07.026 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 msgr2=0x7f784c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 0x7f784c05afd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7868002770 tx=0x7f7868007f60 comp rx=0 tx=0).stop 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 10 monclient: shutdown 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 msgr2=0x7f787c17e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f786c004780 tx=0x7f786c00ecd0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 shutdown_connections 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> v2:10.20.193.61:6800/2336688312 conn(0x7f784c03ab20 0x7f784c05afd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f787c17e9a0 0x7f787c129580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f787c13d9d0 0x7f787c17e460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 --2- 10.20.193.7:0/3955949932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f787c13cef0 0x7f787c12cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 >> 10.20.193.7:0/3955949932 conn(0x7f787c08f860 msgr2=0x7f787c0584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 shutdown_connections 2026-02-22T20:59:07.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.021+0000 7f78821cf640 1 -- 10.20.193.7:0/3955949932 wait complete. 2026-02-22T20:59:07.036 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:59:07.036 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:59:07.036 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:59:07.036 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: get_monmap_and_config 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: monmap: 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:07.106659+0000 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:07.106659+0000 2026-02-22T20:59:07.112 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 Processor -- start 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 -- start start 2026-02-22T20:59:07.113 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: init 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f04d408c7a0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f04d4090b70 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f04d4090f70 0x7f04d41a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-c con 0x7f04d4090f70 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d408d840 con 0x7f04d4090b70 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d408db20 con 0x7f04d408c7a0 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f04d40851e0 con 0x7f04d4090f70 2026-02-22T20:59:07.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d8870640 10 monclient(hunting): authenticate will time out at 959.579685s 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1d74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f04d4090b70 0x7f04d41806e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36550/0 (socket says 10.20.193.7:36550) 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1d74640 1 -- 10.20.193.7:0/535137610 learned_addr learned my addr 10.20.193.7:0/535137610 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382251195 0 0) 0x7f04d408d840 con 0x7f04d4090b70 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 10 monclient(hunting): _negotiate 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 10 monclient(hunting): my global_id is 94677 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d2d76640 1 --2- 10.20.193.7:0/535137610 >> v2:10.20.193.61:3300/0 conn(0x7f04d4090f70 0x7f04d41a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.101+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c0003620 con 0x7f04d4090b70 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): get_auth_request con 0x7f04d4090f70 auth_method 0 2026-02-22T20:59:07.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474987135 0 0) 0x7f04c0003620 con 0x7f04d4090b70 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 >> v2:10.20.193.61:3300/0 conn(0x7f04d4090f70 msgr2=0x7f04d41a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 --2- 10.20.193.7:0/535137610 >> v2:10.20.193.61:3300/0 conn(0x7f04d4090f70 0x7f04d41a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 >> v1:10.20.193.61:6789/0 conn(0x7f04d408c7a0 legacy=0x7f04d4090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:07.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d408ed90 con 0x7f04d4090b70 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f04bc002e60 con 0x7f04d4090b70 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: dump: 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.117 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 >> v1:10.20.193.7:6789/0 conn(0x7f04d4090b70 legacy=0x7f04d41806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04c0003bc0 0x7f04c0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): picked mon.b con 0x7f04c0003bc0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00048d0 0x7f04c0004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): picked mon.c con 0x7f04c00048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 0x7f04c0065b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): picked mon.a con 0x7f04c00054d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40851e0 con 0x7f04c00054d0 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0066410 con 0x7f04c0003bc0 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f04c0066610 con 0x7f04c00048d0 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:07.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 0x7f04c0065b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): get_auth_request con 0x7f04c00054d0 auth_method 0 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00048d0 0x7f04c0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): get_auth_request con 0x7f04c00048d0 auth_method 0 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2575640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04c0003bc0 0x7f04c0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2575640 10 monclient(hunting): get_auth_request con 0x7f04c0003bc0 auth_method 0 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient(hunting): handle_auth_done global_id 94677 payload 293 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 -- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00048d0 msgr2=0x7f04c0004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00048d0 0x7f04c0004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 -- 10.20.193.7:0/535137610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04c0003bc0 msgr2=0x7f04c0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04c0003bc0 0x7f04c0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 monclient: found mon.a 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 -- 10.20.193.7:0/535137610 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c0003620 con 0x7f04c00054d0 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 5 monclient: authenticate success, global_id 94677 2026-02-22T20:59:07.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1d74640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00048d0 0x7f04c0004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 -- 10.20.193.7:0/535137610 reap_dead start 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d2d76640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 0x7f04c0065b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009f50 tx=0x7f04c401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fa4e7366824d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc007db0 con 0x7f04c00054d0 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: dump: 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.123 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4003c90 con 0x7f04c00054d0 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 1 -- 10.20.193.7:0/535137610 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4009b50 con 0x7f04c00054d0 2026-02-22T20:59:07.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d1573640 10 monclient: dump: 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.125 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 4 set_mon_vals no callback set 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 10 monclient: shutdown 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 -- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 msgr2=0x7f04c0065b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 0x7f04c0065b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009f50 tx=0x7f04c401ce60 comp rx=0 tx=0).stop 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 -- 10.20.193.7:0/535137610 shutdown_connections 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 --2- 10.20.193.7:0/535137610 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04c00054d0 0x7f04c0065b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 -- 10.20.193.7:0/535137610 >> 10.20.193.7:0/535137610 conn(0x7f04d408e050 msgr2=0x7f04d408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 -- 10.20.193.7:0/535137610 shutdown_connections 2026-02-22T20:59:07.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 1 -- 10.20.193.7:0/535137610 wait complete. 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.105+0000 7f04d8870640 10 monclient: monmap: 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:07.127 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 Processor -- start 2026-02-22T20:59:07.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- start start 2026-02-22T20:59:07.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: init 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-c con 0x7f04c00054d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04d414fe00 0x7f04d413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-b con 0x7f04d414fe00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d41366e0 0x7f04d4136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): picked mon.noname-a con 0x7f04d41366e0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40907f0 con 0x7f04d41366e0 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4090670 con 0x7f04d414fe00 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f04d4090970 con 0x7f04c00054d0 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): authenticate will time out at 959.584540s 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d41366e0 0x7f04d4136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49774/0 (socket says 10.20.193.7:49774) 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 -- 10.20.193.7:0/4200293488 learned_addr learned my addr 10.20.193.7:0/4200293488 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): get_auth_request con 0x7f04c00054d0 auth_method 0 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): get_auth_request con 0x7f04d41366e0 auth_method 0 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04d414fe00 0x7f04d413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): get_auth_request con 0x7f04d414fe00 auth_method 0 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient(hunting): handle_auth_done global_id 104354 payload 824 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04d414fe00 msgr2=0x7f04d413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f04d414fe00 0x7f04d413ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d41366e0 msgr2=0x7f04d4136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d41366e0 0x7f04d4136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 monclient: found mon.noname-c 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d413a110 con 0x7f04c00054d0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2575640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04c800e7b0 tx=0x7f04c800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8002aa0 con 0x7f04c00054d0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: dump: 2026-02-22T20:59:07.139 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8018070 con 0x7f04c00054d0 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8002e60 con 0x7f04c00054d0 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 5 monclient: authenticate success, global_id 104354 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _renew_subs 2026-02-22T20:59:07.140 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d0d72640 4 set_mon_vals no callback set 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d413a3f0 con 0x7f04c00054d0 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: dump: 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _renew_subs 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.141 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d408b6e0 con 0x7f04c00054d0 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 0x7f04d4059eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4088740 con 0x7f04d4137080 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 0x7f04d4059eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient: get_auth_request con 0x7f04d4137080 auth_method 0 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f04c800c6c0 con 0x7f04c00054d0 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 10 monclient(hunting): handle_auth_done global_id 94683 payload 824 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04d413f6b0 con 0x7f04d4137080 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 --2- 10.20.193.7:0/4200293488 >> v2:10.20.193.61:6800/2336688312 conn(0x7f04a003ab20 0x7f04a005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(237..237 src has 64..237) ==== 3897+0+0 (secure 0 0 0) 0x7f04c804e630 con 0x7f04c00054d0 2026-02-22T20:59:07.142 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d1d74640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 0x7f04d4059eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04d408ad70 tx=0x7f04bc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011660 con 0x7f04d4137080 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: dump: 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 1 --2- 10.20.193.7:0/4200293488 >> v2:10.20.193.61:6800/2336688312 conn(0x7f04a003ab20 0x7f04a005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 10 monclient: get_auth_request con 0x7f04a003ab20 auth_method 0 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f04bc01a070 con 0x7f04d4137080 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:07.143 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 msgr2=0x7f04d4059eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 0x7f04d4059eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04d408ad70 tx=0x7f04bc007430 comp rx=0 tx=0).stop 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 msgr2=0x7f04d4059eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04baffd640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d4137080 0x7f04d4059eb0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04d408ad70 tx=0x7f04bc007430 comp rx=0 tx=0).stop 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.109+0000 7f04d2d76640 1 --2- 10.20.193.7:0/4200293488 >> v2:10.20.193.61:6800/2336688312 conn(0x7f04a003ab20 0x7f04a005afd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04c401d700 tx=0x7f04c4004b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 0x7f04d405a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04d405fc70 con 0x7f04d405a3f0 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 0x7f04d405a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient: get_auth_request con 0x7f04d405a3f0 auth_method 0 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 10 monclient(hunting): handle_auth_done global_id 94686 payload 824 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 1 -- 10.20.193.7:0/4200293488 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04d4137450 con 0x7f04d405a3f0 2026-02-22T20:59:07.144 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d1d74640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 0x7f04d405a7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04bc002410 tx=0x7f04bc003190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011d50 con 0x7f04d405a3f0 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 10 monclient: dump: 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f04bc011d50 con 0x7f04d405a3f0 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 msgr2=0x7f04d405a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 0x7f04d405a7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04bc002410 tx=0x7f04bc003190 comp rx=0 tx=0).stop 2026-02-22T20:59:07.145 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 msgr2=0x7f04d405a7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04baffd640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f04d405a3f0 0x7f04d405a7f0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04bc002410 tx=0x7f04bc003190 comp rx=0 tx=0).stop 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 119797, 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:07.146 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 3, 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:07.147 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.148 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.149 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.150 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.151 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.152 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:07.153 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:07.154 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 >> v2:10.20.193.61:6800/2336688312 conn(0x7f04a003ab20 msgr2=0x7f04a005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 --2- 10.20.193.7:0/4200293488 >> v2:10.20.193.61:6800/2336688312 conn(0x7f04a003ab20 0x7f04a005afd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04c401d700 tx=0x7f04c4004b30 comp rx=0 tx=0).stop 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 10 monclient: shutdown 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 msgr2=0x7f04d413e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04c800e7b0 tx=0x7f04c800ec70 comp rx=0 tx=0).stop 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d2d76640 1 -- 10.20.193.7:0/4200293488 reap_dead start 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 shutdown_connections 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 --2- 10.20.193.7:0/4200293488 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f04c00054d0 0x7f04d413e850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.155 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 >> 10.20.193.7:0/4200293488 conn(0x7f04d408e050 msgr2=0x7f04d40854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 shutdown_connections 2026-02-22T20:59:07.156 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.113+0000 7f04d8870640 1 -- 10.20.193.7:0/4200293488 wait complete. 2026-02-22T20:59:07.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:07.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:59:07.156 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:59:07.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 10 monclient: get_monmap_and_config 2026-02-22T20:59:07.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 10 monclient: monmap: 2026-02-22T20:59:07.231 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:07.223077+0000 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:07.223077+0000 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:07.232 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 1 Processor -- start 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 1 -- start start 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.217+0000 7f4dfb395640 10 monclient: init 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _add_conns ranks=[2,1,3,4,0] 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-b con 0x7f4df4090940 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4df4088170 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 0x7f4df419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-a con 0x7f4df4136d30 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df408d840 con 0x7f4df4088170 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f4df40912f0 con 0x7f4df4136d30 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4df408d1b0 con 0x7f4df4090940 2026-02-22T20:59:07.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): authenticate will time out at 959.696172s 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 0x7f4df419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49784/0 (socket says 10.20.193.7:49784) 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 -- 10.20.193.7:0/61381441 learned_addr learned my addr 10.20.193.7:0/61381441 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): get_auth_request con 0x7f4df4090940 auth_method 0 2026-02-22T20:59:07.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): get_auth_request con 0x7f4df4136d30 auth_method 0 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): handle_auth_done global_id 104357 payload 274 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 -- 10.20.193.7:0/61381441 >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 msgr2=0x7f4df419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 --2- 10.20.193.7:0/61381441 >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 0x7f4df419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 -- 10.20.193.7:0/61381441 >> v1:10.20.193.61:6789/0 conn(0x7f4df4088170 legacy=0x7f4df4136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 monclient: found mon.noname-b 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 -- 10.20.193.7:0/61381441 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df408c2f0 con 0x7f4df4090940 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- 10.20.193.7:0/61381441 >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 0x7f4df419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 --2- 10.20.193.7:0/61381441 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4de40090a0 tx=0x7f4de401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c382f57a8797f1a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 1 -- 10.20.193.7:0/61381441 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b0070 con 0x7f4df4090940 2026-02-22T20:59:07.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: dump: 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.239 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 1 -- 10.20.193.7:0/61381441 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40ab640 con 0x7f4df4090940 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 1 -- 10.20.193.7:0/61381441 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40aba10 con 0x7f4df4090940 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 5 monclient: authenticate success, global_id 104357 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 4 set_mon_vals no callback set 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de3fff640 10 monclient: dump: 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.242 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: shutdown 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/61381441 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 msgr2=0x7f4df4087c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- 10.20.193.7:0/61381441 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4de40090a0 tx=0x7f4de401c500 comp rx=0 tx=0).stop 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/61381441 shutdown_connections 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- 10.20.193.7:0/61381441 >> v2:10.20.193.7:3300/0 conn(0x7f4df4136d30 0x7f4df419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- 10.20.193.7:0/61381441 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4090940 0x7f4df4087c30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/61381441 >> 10.20.193.7:0/61381441 conn(0x7f4df408e050 msgr2=0x7f4df408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/61381441 shutdown_connections 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/61381441 wait complete. 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: monmap: 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:07.244 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 Processor -- start 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- start start 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: init 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.245 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4df4088170 0x7f4df4136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-b con 0x7f4df4088170 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4df4090940 0x7f4df4129230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-a con 0x7f4df4090940 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): picked mon.noname-c con 0x7f4df4136d30 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4df41a2060 con 0x7f4df4090940 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.246 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4df4088540 con 0x7f4df4088170 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4df41a21e0 con 0x7f4df4136d30 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient(hunting): authenticate will time out at 959.699509s 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49796/0 (socket says 10.20.193.7:49796) 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 -- 10.20.193.7:0/1461859207 learned_addr learned my addr 10.20.193.7:0/1461859207 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): get_auth_request con 0x7f4df4136d30 auth_method 0 2026-02-22T20:59:07.247 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4df4090940 0x7f4df4129230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 10 monclient(hunting): get_auth_request con 0x7f4df4090940 auth_method 0 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.248 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4df4088170 0x7f4df4136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): get_auth_request con 0x7f4df4088170 auth_method 0 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient(hunting): handle_auth_done global_id 104360 payload 824 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4df4088170 msgr2=0x7f4df4136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4df4088170 0x7f4df4136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4df4090940 msgr2=0x7f4df4129230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4df4090940 0x7f4df4129230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 monclient: found mon.noname-c 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df4129cb0 con 0x7f4df4136d30 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df8909640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4df4090940 0x7f4df4129230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4df990b640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d90 tx=0x7f4df000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0003a90 con 0x7f4df4136d30 2026-02-22T20:59:07.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: dump: 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.251 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0003c50 con 0x7f4df4136d30 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0004030 con 0x7f4df4136d30 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de1ffb640 10 monclient: dump: 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.253 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 5 monclient: authenticate success, global_id 104360 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4de37fe640 4 set_mon_vals no callback set 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _renew_subs 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df4057a10 con 0x7f4df4136d30 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _renew_subs 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.221+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df4057730 con 0x7f4df4136d30 2026-02-22T20:59:07.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4dfb395640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4df00041d0 con 0x7f4df4136d30 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4dfb395640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 0x7f4df412c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4df4138750 con 0x7f4df412c2b0 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 0x7f4df412c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient: get_auth_request con 0x7f4df412c2b0 auth_method 0 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 --2- 10.20.193.7:0/1461859207 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dc403ab20 0x7f4dc405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(237..237 src has 64..237) ==== 3897+0+0 (secure 0 0 0) 0x7f4df0005e00 con 0x7f4df4136d30 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 10 monclient(hunting): handle_auth_done global_id 104363 payload 824 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4df4087c30 con 0x7f4df412c2b0 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df910a640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 0x7f4df412c680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a130 tx=0x7f4de401ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df8909640 1 --2- 10.20.193.7:0/1461859207 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dc403ab20 0x7f4dc405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b9070 con 0x7f4df412c2b0 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 10 monclient: dump: 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df8909640 10 monclient: get_auth_request con 0x7f4dc403ab20 auth_method 0 2026-02-22T20:59:07.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f4de40abd50 con 0x7f4df412c2b0 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 msgr2=0x7f4df412c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 0x7f4df412c680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a130 tx=0x7f4de401ad40 comp rx=0 tx=0).stop 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 msgr2=0x7f4df412c680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4de1ffb640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412c2b0 0x7f4df412c680 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a130 tx=0x7f4de401ad40 comp rx=0 tx=0).stop 2026-02-22T20:59:07.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.225+0000 7f4df8909640 1 --2- 10.20.193.7:0/1461859207 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dc403ab20 0x7f4dc405afd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4df413a8f0 tx=0x7f4de8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.260 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 0x7f4df4089660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4df4056210 con 0x7f4df412cbc0 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 0x7f4df4089660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient: get_auth_request con 0x7f4df412cbc0 auth_method 0 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 10 monclient(hunting): handle_auth_done global_id 104366 payload 824 2026-02-22T20:59:07.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 1 -- 10.20.193.7:0/1461859207 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4df405fc70 con 0x7f4df412cbc0 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df910a640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 0x7f4df4089660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4de40090a0 tx=0x7f4de40192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b9040 con 0x7f4df412cbc0 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 10 monclient: dump: 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.262 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5047 (secure 0 0 0) 0x7f4de40be720 con 0x7f4df412cbc0 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 msgr2=0x7f4df4089660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 0x7f4df4089660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4de40090a0 tx=0x7f4de40192a0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 msgr2=0x7f4df4089660 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4de1ffb640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df412cbc0 0x7f4df4089660 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4de40090a0 tx=0x7f4de40192a0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 56994, 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:07.264 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 3, 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.265 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.266 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:07.267 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.268 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.269 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.270 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.271 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.272 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.273 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:07.274 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.275 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:07.276 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:07.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dc403ab20 msgr2=0x7f4dc405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 --2- 10.20.193.7:0/1461859207 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4dc403ab20 0x7f4dc405afd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4df413a8f0 tx=0x7f4de8009040 comp rx=0 tx=0).stop 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 10 monclient: shutdown 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 msgr2=0x7f4df4129770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d90 tx=0x7f4df000c490 comp rx=0 tx=0).stop 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4df990b640 1 -- 10.20.193.7:0/1461859207 reap_dead start 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 shutdown_connections 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 --2- 10.20.193.7:0/1461859207 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4df4136d30 0x7f4df4129770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 >> 10.20.193.7:0/1461859207 conn(0x7f4df408e050 msgr2=0x7f4df4086ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 shutdown_connections 2026-02-22T20:59:07.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.229+0000 7f4dfb395640 1 -- 10.20.193.7:0/1461859207 wait complete. 2026-02-22T20:59:07.278 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:07.278 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:59:07.279 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:59:07.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.333+0000 7fbcb3826640 10 monclient: get_monmap_and_config 2026-02-22T20:59:07.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.333+0000 7fbcb3826640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.333+0000 7fbcb3826640 10 monclient: monmap: 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:07.339557+0000 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:07.339557+0000 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:07.340 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 Processor -- start 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- start start 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: init 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbcac05d1c0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbcac160600 0x7fbcac1809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-c con 0x7fbcac160600 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbcac180f20 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac13fbd0 con 0x7fbcac180f20 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac08b770 con 0x7fbcac05d1c0 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac08a6d0 con 0x7fbcac160600 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient(hunting): authenticate will time out at 959.812453s 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fbcac180f20 0x7fbcac1a1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:36562/0 (socket says 10.20.193.7:36562) 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/519129518 learned_addr learned my addr 10.20.193.7:0/519129518 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 1 --2- 10.20.193.7:0/519129518 >> v2:10.20.193.61:3300/0 conn(0x7fbcac160600 0x7fbcac1809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): get_auth_request con 0x7fbcac160600 auth_method 0 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578498893 0 0) 0x7fbca8002ca0 con 0x7fbcac180f20 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): _negotiate 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): my global_id is 94695 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc94003620 con 0x7fbcac180f20 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456712209 0 0) 0x7fbc94003620 con 0x7fbcac180f20 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 >> v2:10.20.193.61:3300/0 conn(0x7fbcac160600 msgr2=0x7fbcac1809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 --2- 10.20.193.7:0/519129518 >> v2:10.20.193.61:3300/0 conn(0x7fbcac160600 0x7fbcac1809e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 >> v1:10.20.193.61:6789/0 conn(0x7fbcac05d1c0 legacy=0x7fbcac05d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.344 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac08ba50 con 0x7fbcac180f20 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fbca80033b0 con 0x7fbcac180f20 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: dump: 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 >> v1:10.20.193.7:6789/0 conn(0x7fbcac180f20 legacy=0x7fbcac1a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:07.345 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 0x7fbc94003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): picked mon.c con 0x7fbc94003bc0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc940048d0 0x7fbc94004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): picked mon.b con 0x7fbc940048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc94005480 0x7fbc94065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): picked mon.a con 0x7fbc94005480 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940662f0 con 0x7fbc94005480 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940664a0 con 0x7fbc940048d0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbc940666a0 con 0x7fbc94003bc0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 0x7fbc94003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc94005480 0x7fbc94065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): get_auth_request con 0x7fbc94003bc0 auth_method 0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): get_auth_request con 0x7fbc94005480 auth_method 0 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.346 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient(hunting): handle_auth_done global_id 94695 payload 293 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb0d9a640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc940048d0 0x7fbc94004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 -- 10.20.193.7:0/519129518 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc940048d0 msgr2=0x7fbc94004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc940048d0 0x7fbc94004d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 -- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc94005480 msgr2=0x7fbc94065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc94005480 0x7fbc94065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 monclient: found mon.c 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 -- 10.20.193.7:0/519129518 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc94003620 con 0x7fbc94003bc0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbc94005480 0x7fbc94065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 5 monclient: authenticate success, global_id 94695 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/519129518 reap_dead start 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb159b640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 0x7fbc94003fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c007fd0 tx=0x7fbc9c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4393d7de3070d12 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.347 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0b0070 con 0x7fbc94003bc0 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: dump: 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9c006ad0 con 0x7fbc94003bc0 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 1 -- 10.20.193.7:0/519129518 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003af0 con 0x7fbc94003bc0 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbc9bfff640 10 monclient: dump: 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.348 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 4 set_mon_vals no callback set 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: shutdown 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 msgr2=0x7fbc94003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 0x7fbc94003fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c007fd0 tx=0x7fbc9c01c3a0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- 10.20.193.7:0/519129518 shutdown_connections 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 --2- 10.20.193.7:0/519129518 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbc94003bc0 0x7fbc94003fb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- 10.20.193.7:0/519129518 >> 10.20.193.7:0/519129518 conn(0x7fbcac08faa0 msgr2=0x7fbcac08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- 10.20.193.7:0/519129518 shutdown_connections 2026-02-22T20:59:07.349 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 1 -- 10.20.193.7:0/519129518 wait complete. 2026-02-22T20:59:07.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.352 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.337+0000 7fbcb3826640 10 monclient: monmap: 2026-02-22T20:59:07.352 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.352 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 Processor -- start 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- start start 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: init 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc94003bc0 0x7fbcac146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-b con 0x7fbc94003bc0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbcac15f3b0 0x7fbcac143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-a con 0x7fbcac15f3b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): picked mon.noname-c con 0x7fbcac15f820 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac08ed40 con 0x7fbcac15f3b0 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac08ebc0 con 0x7fbc94003bc0 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.353 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac08eec0 con 0x7fbcac15f820 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): authenticate will time out at 959.816548s 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:49838/0 (socket says 10.20.193.7:49838) 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/4051170172 learned_addr learned my addr 10.20.193.7:0/4051170172 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): get_auth_request con 0x7fbcac15f820 auth_method 0 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbcac15f3b0 0x7fbcac143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): get_auth_request con 0x7fbcac15f3b0 auth_method 0 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc94003bc0 0x7fbcac146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient(hunting): handle_auth_done global_id 104369 payload 824 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc94003bc0 msgr2=0x7fbcac146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.354 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc94003bc0 0x7fbcac146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbcac15f3b0 msgr2=0x7fbcac143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbcac15f3b0 0x7fbcac143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 monclient: found mon.noname-c 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac146eb0 con 0x7fbcac15f820 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient: get_auth_request con 0x7fbc94003bc0 auth_method 0 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbc94003bc0 0x7fbcac146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb1d9c640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcac08a420 tx=0x7fbca8002e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8017020 con 0x7fbcac15f820 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: dump: 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.355 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca8007670 con 0x7fbcac15f820 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800a520 con 0x7fbcac15f820 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 5 monclient: authenticate success, global_id 104369 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _renew_subs 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc9b7fe640 4 set_mon_vals no callback set 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac147d20 con 0x7fbcac15f820 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: dump: 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _renew_subs 2026-02-22T20:59:07.356 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac086690 con 0x7fbcac15f820 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 0x7fbcac0879e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac144d90 con 0x7fbcac1449c0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 0x7fbcac0879e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient: get_auth_request con 0x7fbcac1449c0 auth_method 0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbca801c400 con 0x7fbcac15f820 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 --2- 10.20.193.7:0/4051170172 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbc7c03ab20 0x7fbc7c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(237..237 src has 64..237) ==== 3897+0+0 (secure 0 0 0) 0x7fbca804ed70 con 0x7fbcac15f820 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 10 monclient(hunting): handle_auth_done global_id 114163 payload 824 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcac0382a0 con 0x7fbcac1449c0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 1 --2- 10.20.193.7:0/4051170172 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbc7c03ab20 0x7fbc7c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 10 monclient: get_auth_request con 0x7fbc7c03ab20 auth_method 0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 0x7fbcac0879e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcac147f30 tx=0x7fbc94005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0b8070 con 0x7fbcac1449c0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.357 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: dump: 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fbc9c007030 con 0x7fbcac1449c0 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 msgr2=0x7fbcac0879e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 0x7fbcac0879e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcac147f30 tx=0x7fbc94005900 comp rx=0 tx=0).stop 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 msgr2=0x7fbcac0879e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbc99ffb640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac1449c0 0x7fbcac0879e0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcac147f30 tx=0x7fbc94005900 comp rx=0 tx=0).stop 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.341+0000 7fbcb0d9a640 1 --2- 10.20.193.7:0/4051170172 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbc7c03ab20 0x7fbc7c05afd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcac05fb70 tx=0x7fbca0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 0x7fbcac04ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac147480 con 0x7fbcac04ca80 2026-02-22T20:59:07.358 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 0x7fbcac04ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient: get_auth_request con 0x7fbcac04ca80 auth_method 0 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 10 monclient(hunting): handle_auth_done global_id 114166 payload 824 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 1 -- 10.20.193.7:0/4051170172 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcac142600 con 0x7fbcac04ca80 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb159b640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 0x7fbcac04ce80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01cc40 tx=0x7fbc9c0a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0b8040 con 0x7fbcac04ca80 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 10 monclient: dump: 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4712 (secure 0 0 0) 0x7fbc9c0bf720 con 0x7fbcac04ca80 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:07.359 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 msgr2=0x7fbcac04ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 0x7fbcac04ce80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01cc40 tx=0x7fbc9c0a6000 comp rx=0 tx=0).stop 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 msgr2=0x7fbcac04ce80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbc99ffb640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbcac04ca80 0x7fbcac04ce80 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01cc40 tx=0x7fbc9c0a6000 comp rx=0 tx=0).stop 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 60, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 8535, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 4, 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.360 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:07.361 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:07.362 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.363 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:07.364 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21922]: starting. 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21922]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21920 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[21922]: shutting down. 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbc7c03ab20 msgr2=0x7fbc7c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 --2- 10.20.193.7:0/4051170172 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbc7c03ab20 0x7fbc7c05afd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcac05fb70 tx=0x7fbca0008040 comp rx=0 tx=0).stop 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 10 monclient: shutdown 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.365 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 msgr2=0x7fbcac144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcac08a420 tx=0x7fbca8002e10 comp rx=0 tx=0).stop 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb1d9c640 1 -- 10.20.193.7:0/4051170172 reap_dead start 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 shutdown_connections 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 --2- 10.20.193.7:0/4051170172 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbcac15f820 0x7fbcac144480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 >> 10.20.193.7:0/4051170172 conn(0x7fbcac08faa0 msgr2=0x7fbcac13b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 shutdown_connections 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.345+0000 7fbcb3826640 1 -- 10.20.193.7:0/4051170172 wait complete. 2026-02-22T20:59:07.366 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:07.366 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-22T20:59:07.366 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:59:07.366 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-22T20:59:07.366 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-22T20:59:07.366 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T20:59:07.366 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:59:07.374 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T20:59:07.375 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:59:07.376 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T20:59:07.377 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:59:07.378 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:59:07.378 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:59:07.378 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T20:59:07.378 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:59:07.378 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T20:59:07.378 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T20:59:07.378 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:59:07.378 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T20:59:07.379 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T20:59:07.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: get_monmap_and_config 2026-02-22T20:59:07.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: monmap: 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:07.482675+0000 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:07.482675+0000 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:07.483 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 Processor -- start 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 -- start start 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: init 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd408b050 0x7f9cd408b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd408b050 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd405c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd405c520 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 0x7f9cd41a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd405ce90 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd408e690 con 0x7f9cd408b050 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd408e970 con 0x7f9cd405ce90 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd408ec50 con 0x7f9cd405c520 2026-02-22T20:59:07.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cdb51a640 10 monclient(hunting): authenticate will time out at 959.955902s 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cd8a8e640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 msgr2=0x7f9cd405c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.477+0000 7f9cd8a8e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd405c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd408b050 0x7f9cd408b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd408b050 0x7f9cd408b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39842/0 (socket says 10.20.193.7:39842) 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 -- 10.20.193.7:0/3398235832 learned_addr learned my addr 10.20.193.7:0/3398235832 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): get_auth_request con 0x7f9cd408b050 auth_method 0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient(hunting): handle_auth_done global_id 94722 payload 274 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 -- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 msgr2=0x7f9cd405c950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd405c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 1 --2- 10.20.193.7:0/3398235832 >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 0x7f9cd41a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 -- 10.20.193.7:0/3398235832 >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 msgr2=0x7f9cd41a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- 10.20.193.7:0/3398235832 >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 0x7f9cd41a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 monclient: found mon.noname-a 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 -- 10.20.193.7:0/3398235832 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd408ef30 con 0x7f9cd408b050 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 10 monclient: get_auth_request con 0x7f9cd405ce90 auth_method 0 2026-02-22T20:59:07.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 1 --2- 10.20.193.7:0/3398235832 >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 0x7f9cd41a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd408b050 0x7f9cd408b420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9cd408f350 tx=0x7f9cc401cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb22062dc13cb92 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 1 -- 10.20.193.7:0/3398235832 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40b1070 con 0x7f9cd408b050 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: dump: 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.488 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 1 -- 10.20.193.7:0/3398235832 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40ac670 con 0x7f9cd408b050 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 1 -- 10.20.193.7:0/3398235832 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40a8050 con 0x7f9cd408b050 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 5 monclient: authenticate success, global_id 94722 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 4 set_mon_vals no callback set 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc3fff640 10 monclient: dump: 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: shutdown 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd408b050 msgr2=0x7f9cd408b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd408b050 0x7f9cd408b420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9cd408f350 tx=0x7f9cc401cf60 comp rx=0 tx=0).stop 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/3398235832 shutdown_connections 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/3398235832 >> v2:10.20.193.61:3300/0 conn(0x7f9cd405ce90 0x7f9cd41a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd405c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/3398235832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd408b050 0x7f9cd408b420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/3398235832 >> 10.20.193.7:0/3398235832 conn(0x7f9cd408f640 msgr2=0x7f9cd408fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/3398235832 shutdown_connections 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/3398235832 wait complete. 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: build_initial_monmap 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: monmap: 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:07.489 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 Processor -- start 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- start start 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: init 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd4110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd405c520 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd405ce90 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 0x7f9cd411f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd408b050 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd408bd80 con 0x7f9cd405ce90 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd408bc00 con 0x7f9cd408b050 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd41a35c0 con 0x7f9cd405c520 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient(hunting): authenticate will time out at 959.959214s 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 msgr2=0x7f9cd4110280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd928f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd4110280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:39846/0 (socket says 10.20.193.7:39846) 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 -- 10.20.193.7:0/2623916131 learned_addr learned my addr 10.20.193.7:0/2623916131 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): get_auth_request con 0x7f9cd405ce90 auth_method 0 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 0x7f9cd411f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient(hunting): handle_auth_done global_id 94725 payload 824 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 -- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 msgr2=0x7f9cd4110280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd4110280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 -- 10.20.193.7:0/2623916131 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 msgr2=0x7f9cd411f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 0x7f9cd411f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient: _finish_hunting 0 2026-02-22T20:59:07.490 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 monclient: found mon.noname-a 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 -- 10.20.193.7:0/2623916131 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd4128eb0 con 0x7f9cd405ce90 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 10 monclient: get_auth_request con 0x7f9cd408b050 auth_method 0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd9a90640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 0x7f9cd411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cd8a8e640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800b520 tx=0x7f9cc800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80060d0 con 0x7f9cd405ce90 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: dump: 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc8014070 con 0x7f9cd405ce90 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8006490 con 0x7f9cd405ce90 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc37fe640 4 set_mon_vals no callback set 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cc1ffb640 10 monclient: dump: 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 5 monclient: authenticate success, global_id 94725 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _renew_subs 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.491 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd4086830 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _renew_subs 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.481+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd4127bc0 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cdb51a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cdb51a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cdb51a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd405c930 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9cc8006630 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cc1ffb640 1 --2- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 0x7f9ca405af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7f9cc804e250 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cd928f640 1 --2- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 0x7f9ca405af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cd928f640 10 monclient: get_auth_request con 0x7f9ca403aae0 auth_method 0 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.485+0000 7f9cd928f640 1 --2- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 0x7f9ca405af90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009690 tx=0x7f9cc4004820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.489+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f9cd4086830 con 0x7f9cd405ce90 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.489+0000 7f9cc1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:07.492 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.489+0000 7f9cc1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:07.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9cd403a2b0 con 0x7f9cd405ce90 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cc1ffb640 1 -- 10.20.193.7:0/2623916131 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f9cc8005070 con 0x7f9cd405ce90 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cc1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cc1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:07.602 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 msgr2=0x7f9ca405af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 0x7f9ca405af90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009690 tx=0x7f9cc4004820 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 10 monclient: shutdown 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 msgr2=0x7f9cd41a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800b520 tx=0x7f9cc800b9e0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 shutdown_connections 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403aae0 0x7f9ca405af90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd408b050 0x7f9cd411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd405ce90 0x7f9cd41a0240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 --2- 10.20.193.7:0/2623916131 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd405c520 0x7f9cd4110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 >> 10.20.193.7:0/2623916131 conn(0x7f9cd408f640 msgr2=0x7f9cd4123950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 shutdown_connections 2026-02-22T20:59:07.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:07.597+0000 7f9cdb51a640 1 -- 10.20.193.7:0/2623916131 wait complete. 2026-02-22T20:59:10.612 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: get_monmap_and_config 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: build_initial_monmap 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: monmap: 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:10.673 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:10.673681+0000 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:10.673681+0000 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 Processor -- start 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 -- start start 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: init 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient: _add_conns ranks=[1,4,0,2,3] 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f56cc13cef0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:10.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-c con 0x7f56cc13d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f56cc17e9a0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc05d510 con 0x7f56cc17e9a0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc08b800 con 0x7f56cc13cef0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc08a720 con 0x7f56cc13d9d0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56d15d4640 10 monclient(hunting): authenticate will time out at 963.146881s 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56cb7fe640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f56cc17e9a0 0x7f56cc19ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:47484/0 (socket says 10.20.193.7:47484) 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56cb7fe640 1 -- 10.20.193.7:0/3328451961 learned_addr learned my addr 10.20.193.7:0/3328451961 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 1 --2- 10.20.193.7:0/3328451961 >> v2:10.20.193.61:3300/0 conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): get_auth_request con 0x7f56cc13d9d0 auth_method 0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 1 -- 10.20.193.7:0/3328451961 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825461218 0 0) 0x7f56cc05d510 con 0x7f56cc17e9a0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 10 monclient(hunting): _negotiate 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 10 monclient(hunting): my global_id is 94728 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56c9ffb640 1 -- 10.20.193.7:0/3328451961 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b8003620 con 0x7f56cc17e9a0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient(hunting): handle_auth_done global_id 114187 payload 274 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 1 -- 10.20.193.7:0/3328451961 >> v1:10.20.193.61:6789/0 conn(0x7f56cc13cef0 legacy=0x7f56cc13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 1 -- 10.20.193.7:0/3328451961 >> v1:10.20.193.7:6789/0 conn(0x7f56cc17e9a0 legacy=0x7f56cc19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient: _finish_hunting 0 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 1 monclient: found mon.noname-c 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:10.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.669+0000 7f56ca7fc640 1 -- 10.20.193.7:0/3328451961 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc08aa00 con 0x7f56cc13d9d0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ca7fc640 1 --2- 10.20.193.7:0/3328451961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56b4004780 tx=0x7f56b401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52dde473800c7f7c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 1 -- 10.20.193.7:0/3328451961 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40b1070 con 0x7f56cc13d9d0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: dump: 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:10.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 5 monclient: authenticate success, global_id 114187 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 1 -- 10.20.193.7:0/3328451961 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b40a8050 con 0x7f56cc13d9d0 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 1 -- 10.20.193.7:0/3328451961 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b40ac840 con 0x7f56cc13d9d0 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c9ffb640 10 monclient: dump: 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:10.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 4 set_mon_vals no callback set 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: shutdown 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/3328451961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13d9d0 msgr2=0x7f56cc17e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 --2- 10.20.193.7:0/3328451961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56b4004780 tx=0x7f56b401c4d0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/3328451961 shutdown_connections 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 --2- 10.20.193.7:0/3328451961 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/3328451961 >> 10.20.193.7:0/3328451961 conn(0x7f56cc08f860 msgr2=0x7f56cc08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/3328451961 shutdown_connections 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/3328451961 wait complete. 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: build_initial_monmap 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: monmap: 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:10.678 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 Processor -- start 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- start start 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: init 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13cef0 0x7f56cc18d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-b con 0x7f56cc13cef0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-c con 0x7f56cc13d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): picked mon.noname-a con 0x7f56cc17e9a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc1a3050 con 0x7f56cc17e9a0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc1a2ed0 con 0x7f56cc13cef0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc1a31d0 con 0x7f56cc13d9d0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient(hunting): authenticate will time out at 963.150098s 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ca7fc640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 msgr2=0x7f56cc17e460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ca7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:54362/0 (socket says 10.20.193.7:54362) 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 -- 10.20.193.7:0/2293545484 learned_addr learned my addr 10.20.193.7:0/2293545484 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): get_auth_request con 0x7f56cc17e9a0 auth_method 0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient(hunting): handle_auth_done global_id 94731 payload 824 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 -- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 msgr2=0x7f56cc17e460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 -- 10.20.193.7:0/2293545484 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13cef0 msgr2=0x7f56cc18d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13cef0 0x7f56cc18d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:10.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 monclient: found mon.noname-a 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 -- 10.20.193.7:0/2293545484 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc13bba0 con 0x7f56cc17e9a0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56cb7fe640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00cb10 tx=0x7f56bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc017070 con 0x7f56cc17e9a0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: dump: 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc00ac70 con 0x7f56cc17e9a0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc012600 con 0x7f56cc17e9a0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 10 monclient: dump: 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 5 monclient: authenticate success, global_id 94731 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _renew_subs 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc12b5d0 con 0x7f56cc17e9a0 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56c97fa640 4 set_mon_vals no callback set 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _renew_subs 2026-02-22T20:59:10.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc129270 con 0x7f56cc17e9a0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc13d2c0 con 0x7f56cc17e9a0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f56bc0127a0 con 0x7f56cc17e9a0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 --2- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 0x7f569805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7f56bc04e560 con 0x7f56cc17e9a0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56caffd640 1 --2- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 0x7f569805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.673+0000 7f56caffd640 10 monclient: get_auth_request con 0x7f569803aa90 auth_method 0 2026-02-22T20:59:10.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.677+0000 7f56caffd640 1 --2- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 0x7f569805af40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f56cc129d60 tx=0x7f56c0007ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:10.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.677+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f56bc00ae20 con 0x7f56cc17e9a0 2026-02-22T20:59:10.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.677+0000 7f56ab7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:10.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.677+0000 7f56ab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:10.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:10.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:10.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:10.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f56cc12b350 con 0x7f56cc17e9a0 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56ab7fe640 1 -- 10.20.193.7:0/2293545484 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f56bc013650 con 0x7f56cc17e9a0 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56ab7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56ab7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 msgr2=0x7f569805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 0x7f569805af40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f56cc129d60 tx=0x7f56c0007ab0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 10 monclient: shutdown 2026-02-22T20:59:10.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 msgr2=0x7f56cc18d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00cb10 tx=0x7f56bc00a060 comp rx=0 tx=0).stop 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 shutdown_connections 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f56cc17e9a0 0x7f56cc18d5f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f56cc13d9d0 0x7f56cc17e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> v2:10.20.193.61:6800/2336688312 conn(0x7f569803aa90 0x7f569805af40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 --2- 10.20.193.7:0/2293545484 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f56cc13cef0 0x7f56cc18d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 >> 10.20.193.7:0/2293545484 conn(0x7f56cc08f860 msgr2=0x7f56cc087b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 shutdown_connections 2026-02-22T20:59:10.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:10.789+0000 7f56d15d4640 1 -- 10.20.193.7:0/2293545484 wait complete. 2026-02-22T20:59:11.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:11.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:13.806 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: get_monmap_and_config 2026-02-22T20:59:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: build_initial_monmap 2026-02-22T20:59:13.881 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: monmap: 2026-02-22T20:59:13.881 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:13.881 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:13.877156+0000 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:13.877156+0000 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.882 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 Processor -- start 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 -- start start 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: init 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f580813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-b con 0x7f580813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f580813d800 0x7f5808139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-c con 0x7f580813d800 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f580813a110 0x7f580813a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-a con 0x7f580813a110 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.883 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f580808ad70 con 0x7f580813a110 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f580805d510 con 0x7f580813d800 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f580808b800 con 0x7f580813cef0 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient(hunting): authenticate will time out at 966.350060s 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806575640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 msgr2=0x7f580813d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f580813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f580813a110 0x7f580813a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f580813a110 0x7f580813a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:54378/0 (socket says 10.20.193.7:54378) 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 -- 10.20.193.7:0/3527782981 learned_addr learned my addr 10.20.193.7:0/3527782981 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:13.884 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): get_auth_request con 0x7f580813a110 auth_method 0 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 1 --2- 10.20.193.7:0/3527782981 >> v2:10.20.193.61:3300/0 conn(0x7f580813d800 0x7f5808139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): get_auth_request con 0x7f580813d800 auth_method 0 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:13.885 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient(hunting): handle_auth_done global_id 94734 payload 274 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 -- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 msgr2=0x7f580813d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 --2- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f580813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 -- 10.20.193.7:0/3527782981 >> v2:10.20.193.61:3300/0 conn(0x7f580813d800 msgr2=0x7f5808139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 --2- 10.20.193.7:0/3527782981 >> v2:10.20.193.61:3300/0 conn(0x7f580813d800 0x7f5808139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient: _finish_hunting 0 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 monclient: found mon.noname-a 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 -- 10.20.193.7:0/3527782981 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580808a720 con 0x7f580813a110 2026-02-22T20:59:13.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5806d76640 1 --2- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f580813a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5808089160 tx=0x7f57f801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d973afb30e5cd248 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 1 -- 10.20.193.7:0/3527782981 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80b2070 con 0x7f580813a110 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: dump: 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:13.887 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: _finish_auth 0 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: _check_auth_tickets 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 1 -- 10.20.193.7:0/3527782981 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f80a5840 con 0x7f580813a110 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 1 -- 10.20.193.7:0/3527782981 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80a5c30 con 0x7f580813a110 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f5805573640 10 monclient: dump: 2026-02-22T20:59:13.888 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 5 monclient: authenticate success, global_id 94734 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:13.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.873+0000 7f580cc95640 4 set_mon_vals no callback set 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: shutdown 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 msgr2=0x7f580813a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f580813a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5808089160 tx=0x7f57f801c8a0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3527782981 shutdown_connections 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f580813a590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- 10.20.193.7:0/3527782981 >> v2:10.20.193.61:3300/0 conn(0x7f580813d800 0x7f5808139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- 10.20.193.7:0/3527782981 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f580813d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3527782981 >> 10.20.193.7:0/3527782981 conn(0x7f580808f860 msgr2=0x7f580808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3527782981 shutdown_connections 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3527782981 wait complete. 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: build_initial_monmap 2026-02-22T20:59:13.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: monmap: 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 Processor -- start 2026-02-22T20:59:13.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- start start 2026-02-22T20:59:13.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: init 2026-02-22T20:59:13.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:13.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:13.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-a con 0x7f580813a110 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f5808126260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-c con 0x7f580813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f580813d800 0x7f58081267a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): picked mon.noname-b con 0x7f580813d800 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5808088fa0 con 0x7f580813a110 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5808088e20 con 0x7f580813d800 2026-02-22T20:59:13.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f58081a0c90 con 0x7f580813cef0 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient(hunting): authenticate will time out at 966.353805s 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5805d74640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 msgr2=0x7f5808126260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:54390/0 (socket says 10.20.193.7:54390) 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 -- 10.20.193.7:0/3561773321 learned_addr learned my addr 10.20.193.7:0/3561773321 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:13.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): get_auth_request con 0x7f580813a110 auth_method 0 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5805d74640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f5808126260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:13.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient(hunting): handle_auth_done global_id 94737 payload 824 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 -- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 msgr2=0x7f5808126260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f5808126260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 -- 10.20.193.7:0/3561773321 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f580813d800 msgr2=0x7f58081267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f580813d800 0x7f58081267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient: _finish_hunting 0 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 monclient: found mon.noname-a 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:13.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 -- 10.20.193.7:0/3561773321 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5808107c30 con 0x7f580813a110 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5806575640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00b550 tx=0x7f57fc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0060d0 con 0x7f580813a110 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: dump: 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:13.900 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:13.901 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57fc014070 con 0x7f580813a110 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc006490 con 0x7f580813a110 2026-02-22T20:59:13.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 10 monclient: dump: 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 5 monclient: authenticate success, global_id 94737 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5804d72640 4 set_mon_vals no callback set 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _renew_subs 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5808105d70 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _renew_subs 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5808107950 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f57fc006630 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580813d2c0 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 --2- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 0x7f57d405af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7f57fc04e420 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5805d74640 1 --2- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 0x7f57d405af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5805d74640 10 monclient: get_auth_request con 0x7f57d403aa80 auth_method 0 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.877+0000 7f5805d74640 1 --2- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 0x7f57d405af30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5808127340 tx=0x7f57f0009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.881+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f57fc008710 con 0x7f580813a110 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.881+0000 7f57eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:13.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.881+0000 7f57eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f580cc95640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f580cc95640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f580cc95640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f580805fc00 con 0x7f580813a110 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f57eeffd640 1 -- 10.20.193.7:0/3561773321 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7f57fc04d360 con 0x7f580813a110 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f57eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.989+0000 7f57eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:13.995 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 msgr2=0x7f57d405af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 0x7f57d405af30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5808127340 tx=0x7f57f0009290 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 10 monclient: shutdown 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 msgr2=0x7f5808129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00b550 tx=0x7f57fc00ba10 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 shutdown_connections 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> v2:10.20.193.61:6800/2336688312 conn(0x7f57d403aa80 0x7f57d405af30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f580813d800 0x7f58081267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f580813cef0 0x7f5808126260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 --2- 10.20.193.7:0/3561773321 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f580813a110 0x7f5808129fb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 >> 10.20.193.7:0/3561773321 conn(0x7f580808f860 msgr2=0x7f580813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 shutdown_connections 2026-02-22T20:59:13.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:13.993+0000 7f580cc95640 1 -- 10.20.193.7:0/3561773321 wait complete. 2026-02-22T20:59:16.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:16.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:17.006 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: get_monmap_and_config 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: build_initial_monmap 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: monmap: 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:17.077190+0000 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:17.077190+0000 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:17.077 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:17.078 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:17.078 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:17.078 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 Processor -- start 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 -- start start 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: init 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f78f8057fe0 0x7f78f808bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-c con 0x7f78f8057fe0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f78f808c490 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78f808c8f0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f80583b0 con 0x7f78f808c8f0 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f8056060 con 0x7f78f808c490 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f78f808dda0 con 0x7f78f8057fe0 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient(hunting): authenticate will time out at 969.550067s 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fe167640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f78f808c8f0 0x7f78f81a12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:47488/0 (socket says 10.20.193.7:47488) 2026-02-22T20:59:17.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fe167640 1 -- 10.20.193.7:0/1429734749 learned_addr learned my addr 10.20.193.7:0/1429734749 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 --2- 10.20.193.7:0/1429734749 >> v2:10.20.193.61:3300/0 conn(0x7f78f8057fe0 0x7f78f808bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): get_auth_request con 0x7f78f8057fe0 auth_method 0 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient(hunting): handle_auth_done global_id 114193 payload 274 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 -- 10.20.193.7:0/1429734749 >> v1:10.20.193.61:6789/0 conn(0x7f78f808c490 legacy=0x7f78f817fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 -- 10.20.193.7:0/1429734749 >> v1:10.20.193.7:6789/0 conn(0x7f78f808c8f0 legacy=0x7f78f81a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient: _finish_hunting 0 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 monclient: found mon.noname-c 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:59:17.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 -- 10.20.193.7:0/1429734749 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f808cd30 con 0x7f78f8057fe0 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fd966640 1 --2- 10.20.193.7:0/1429734749 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f8057fe0 0x7f78f808bf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004780 tx=0x7f78e801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2bd8a9f08bd29ad server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 1 -- 10.20.193.7:0/1429734749 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80b0070 con 0x7f78f8057fe0 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: dump: 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:17.083 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: _finish_auth 0 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: _check_auth_tickets 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 1 -- 10.20.193.7:0/1429734749 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e80ab600 con 0x7f78f8057fe0 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 1 -- 10.20.193.7:0/1429734749 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80ab9b0 con 0x7f78f8057fe0 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 5 monclient: authenticate success, global_id 114193 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78ffbf1640 4 set_mon_vals no callback set 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.072+0000 7f78fc964640 10 monclient: dump: 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: shutdown 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/1429734749 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f8057fe0 msgr2=0x7f78f808bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/1429734749 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f8057fe0 0x7f78f808bf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004780 tx=0x7f78e801c440 comp rx=0 tx=0).stop 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/1429734749 shutdown_connections 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/1429734749 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f8057fe0 0x7f78f808bf50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/1429734749 >> 10.20.193.7:0/1429734749 conn(0x7f78f8039320 msgr2=0x7f78f8039720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/1429734749 shutdown_connections 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/1429734749 wait complete. 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: build_initial_monmap 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: monmap: 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:17.084 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 Processor -- start 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- start start 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: init 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-a con 0x7f78f8057fe0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f808c490 0x7f78f81da500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-b con 0x7f78f808c490 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 0x7f78f807a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): picked mon.noname-c con 0x7f78f808c8f0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81a57a0 con 0x7f78f8057fe0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f78f81a5620 con 0x7f78f808c490 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f78f81a5920 con 0x7f78f808c8f0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient(hunting): authenticate will time out at 969.553750s 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fe167640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 msgr2=0x7f78f807a1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fe167640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 0x7f78f807a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:54404/0 (socket says 10.20.193.7:54404) 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 -- 10.20.193.7:0/772925366 learned_addr learned my addr 10.20.193.7:0/772925366 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): get_auth_request con 0x7f78f8057fe0 auth_method 0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f808c490 0x7f78f81da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 10 monclient(hunting): get_auth_request con 0x7f78f808c490 auth_method 0 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient(hunting): handle_auth_done global_id 94740 payload 824 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 -- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 msgr2=0x7f78f807a1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 0x7f78f807a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 -- 10.20.193.7:0/772925366 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f808c490 msgr2=0x7f78f81da500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f808c490 0x7f78f81da500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient: _finish_hunting 0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 monclient: found mon.noname-a 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 -- 10.20.193.7:0/772925366 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f8088740 con 0x7f78f8057fe0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd966640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78e801c480 tx=0x7f78e80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80b0040 con 0x7f78f8057fe0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: dump: 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e80b9070 con 0x7f78f8057fe0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80abbb0 con 0x7f78f8057fe0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e7fff640 4 set_mon_vals no callback set 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 10 monclient: dump: 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 5 monclient: authenticate success, global_id 94740 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _renew_subs 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f807bca0 con 0x7f78f8057fe0 2026-02-22T20:59:17.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _renew_subs 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f807c800 con 0x7f78f8057fe0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f808bf50 con 0x7f78f8057fe0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f78e8003710 con 0x7f78f8057fe0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 --2- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 0x7f78c805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7f78e80e85f0 con 0x7f78f8057fe0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 1 --2- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 0x7f78c805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.076+0000 7f78fd165640 10 monclient: get_auth_request con 0x7f78c803aa90 auth_method 0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.080+0000 7f78fd165640 1 --2- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 0x7f78c805af40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78f80881f0 tx=0x7f78ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.080+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f78e8016150 con 0x7f78f8057fe0 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.080+0000 7f78e67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:17.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.080+0000 7f78e67fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:17.197 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f78f807e9e0 con 0x7f78f8057fe0 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78e67fc640 1 -- 10.20.193.7:0/772925366 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7f78e80a5910 con 0x7f78f8057fe0 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78e67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78e67fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:17.198 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 msgr2=0x7f78c805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 0x7f78c805af40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78f80881f0 tx=0x7f78ec009040 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 10 monclient: shutdown 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 msgr2=0x7f78f81d9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78e801c480 tx=0x7f78e80191e0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 shutdown_connections 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f78f808c8f0 0x7f78f807a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> v2:10.20.193.61:6800/2336688312 conn(0x7f78c803aa90 0x7f78c805af40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f78f808c490 0x7f78f81da500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 --2- 10.20.193.7:0/772925366 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f78f8057fe0 0x7f78f81d9fc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 >> 10.20.193.7:0/772925366 conn(0x7f78f8039320 msgr2=0x7f78f81a1770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 shutdown_connections 2026-02-22T20:59:17.199 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:17.192+0000 7f78ffbf1640 1 -- 10.20.193.7:0/772925366 wait complete. 2026-02-22T20:59:20.209 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:20.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: get_monmap_and_config 2026-02-22T20:59:20.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: build_initial_monmap 2026-02-22T20:59:20.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: monmap: 2026-02-22T20:59:20.271 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:20.271 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:20.270645+0000 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:20.270645+0000 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 Processor -- start 2026-02-22T20:59:20.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 -- start start 2026-02-22T20:59:20.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: init 2026-02-22T20:59:20.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:20.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-b con 0x7fa98413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa98413d800 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-c con 0x7fa98413a2e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98405d510 con 0x7fa98413d800 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fa98408b800 con 0x7fa98413a2e0 2026-02-22T20:59:20.275 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa98408a720 con 0x7fa98413cef0 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa98ad78640 10 monclient(hunting): authenticate will time out at 972.743732s 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa988aed640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa98413d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa988aed640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa97bfff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fa98413d800 0x7fa984139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:40892/0 (socket says 10.20.193.7:40892) 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa97bfff640 1 -- 10.20.193.7:0/219738757 learned_addr learned my addr 10.20.193.7:0/219738757 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa9892ee640 10 monclient(hunting): get_auth_request con 0x7fa98413a2e0 auth_method 0 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa9892ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:20.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa9892ee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:20.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.264+0000 7fa9892ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:20.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.268+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:59:20.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.268+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:20.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.268+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:20.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.268+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:20.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.468+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa98413d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:20.472 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.468+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 10 monclient(hunting): get_auth_request con 0x7fa98413a2e0 auth_method 0 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:20.477 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:20.478 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.472+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:59:20.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.872+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa98413d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:20.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.872+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 10 monclient(hunting): get_auth_request con 0x7fa98413a2e0 auth_method 0 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:20.880 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:20.876+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:59:21.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.676+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa98413d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:21.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.676+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:59:21.685 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 10 monclient(hunting): get_auth_request con 0x7fa98413a2e0 auth_method 0 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:21.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:21.680+0000 7fa9892ee640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:59:21.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:21.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049179244 0 0) 0x7fa98405d510 con 0x7fa98413d800 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 10 monclient(hunting): _negotiate 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 10 monclient(hunting): my global_id is 94743 2026-02-22T20:59:22.405 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.400+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa970003620 con 0x7fa98413d800 2026-02-22T20:59:22.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3427844890 0 0) 0x7fa970003620 con 0x7fa98413d800 2026-02-22T20:59:22.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa98413d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa98413d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 msgr2=0x7fa98419f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.411 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 --2- 10.20.193.7:0/219738757 >> v2:10.20.193.61:3300/0 conn(0x7fa98413a2e0 0x7fa98419f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98408aa00 con 0x7fa98413d800 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fa96c002e60 con 0x7fa98413d800 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: dump: 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 >> v1:10.20.193.7:6789/0 conn(0x7fa98413d800 legacy=0x7fa984139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa970003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): picked mon.b con 0x7fa970003b20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa9700048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.412 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): picked mon.c con 0x7fa98413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa970004e60 0x7fa9700052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): picked mon.a con 0x7fa970004e60 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa98408b800 con 0x7fa970004e60 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa98408a720 con 0x7fa970003b20 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa970065d90 con 0x7fa98413cef0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97bfff640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa9700048d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa97bfff640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa9700048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa970003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): get_auth_request con 0x7fa970003b20 auth_method 0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient(hunting): handle_auth_done global_id 94743 payload 293 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 msgr2=0x7fa9700048d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa98413cef0 0x7fa9700048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa970004e60 msgr2=0x7fa9700052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa970004e60 0x7fa9700052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 monclient: found mon.b 2026-02-22T20:59:22.413 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.61:3300/0 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 1 -- 10.20.193.7:0/219738757 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa970003620 con 0x7fa970003b20 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa988aed640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa98ad78640 5 monclient: authenticate success, global_id 94743 2026-02-22T20:59:22.414 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.404+0000 7fa98ad78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa970003f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa974003a80 tx=0x7fa97401d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4934e3a33d685b server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740099a0 con 0x7fa970003b20 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: dump: 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.416 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9740a9070 con 0x7fa970003b20 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 1 -- 10.20.193.7:0/219738757 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740a5b80 con 0x7fa970003b20 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 4 set_mon_vals no callback set 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97b7fe640 10 monclient: dump: 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: shutdown 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- 10.20.193.7:0/219738757 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 msgr2=0x7fa970003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 --2- 10.20.193.7:0/219738757 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa970003f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa974003a80 tx=0x7fa97401d470 comp rx=0 tx=0).stop 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 -- 10.20.193.7:0/219738757 reap_dead start 2026-02-22T20:59:22.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- 10.20.193.7:0/219738757 shutdown_connections 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- 10.20.193.7:0/219738757 >> 10.20.193.7:0/219738757 conn(0x7fa98408f860 msgr2=0x7fa98408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- 10.20.193.7:0/219738757 shutdown_connections 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- 10.20.193.7:0/219738757 wait complete. 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: build_initial_monmap 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: monmap: 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 Processor -- start 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- start start 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: init 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa984129d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-b con 0x7fa970003b20 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 0x7fa984127d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-c con 0x7fa984127900 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): picked mon.noname-a con 0x7fa9841282b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa984088fa0 con 0x7fa9841282b0 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fa984088e20 con 0x7fa970003b20 2026-02-22T20:59:22.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fa9841a01d0 con 0x7fa984127900 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa98ad78640 10 monclient(hunting): authenticate will time out at 974.887511s 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97bfff640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 msgr2=0x7fa984127d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa97bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 0x7fa984127d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:51158/0 (socket says 10.20.193.7:51158) 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 -- 10.20.193.7:0/2118507063 learned_addr learned my addr 10.20.193.7:0/2118507063 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): get_auth_request con 0x7fa9841282b0 auth_method 0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa984129d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): get_auth_request con 0x7fa970003b20 auth_method 0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa988aed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient(hunting): handle_auth_done global_id 94746 payload 824 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 -- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 msgr2=0x7fa984127d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 0x7fa984127d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 -- 10.20.193.7:0/2118507063 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 msgr2=0x7fa984129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa984129d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 monclient: found mon.noname-a 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.408+0000 7fa9892ee640 1 -- 10.20.193.7:0/2118507063 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98412b590 con 0x7fa9841282b0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9892ee640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa980004b00 tx=0x7fa9800044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98001b020 con 0x7fa9841282b0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: dump: 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980017470 con 0x7fa9841282b0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980017840 con 0x7fa9841282b0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 10 monclient: dump: 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.420 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa97affd640 4 set_mon_vals no callback set 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 5 monclient: authenticate success, global_id 94746 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _renew_subs 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa984086620 con 0x7fa9841282b0 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _renew_subs 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98412b2b0 con 0x7fa9841282b0 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9841a05b0 con 0x7fa9841282b0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa9800179e0 con 0x7fa9841282b0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 --2- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 0x7fa95405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7fa98004f080 con 0x7fa9841282b0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa988aed640 1 --2- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 0x7fa95405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa988aed640 10 monclient: get_auth_request con 0x7fa95403aa90 auth_method 0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.412+0000 7fa988aed640 1 --2- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 0x7fa95405af40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa974002410 tx=0x7fa974005e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.416+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa980025020 con 0x7fa9841282b0 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.416+0000 7fa9797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.416+0000 7fa9797fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:22.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa9841286d0 con 0x7fa9841282b0 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa9797fa640 1 -- 10.20.193.7:0/2118507063 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7fa980024e40 con 0x7fa9841282b0 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa9797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:22.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa9797fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:22.534 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 msgr2=0x7fa95405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 0x7fa95405af40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa974002410 tx=0x7fa974005e00 comp rx=0 tx=0).stop 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 10 monclient: shutdown 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 msgr2=0x7fa98418e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa980004b00 tx=0x7fa9800044f0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 shutdown_connections 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fa9841282b0 0x7fa98418e560 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fa984127900 0x7fa984127d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa95403aa90 0x7fa95405af40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 --2- 10.20.193.7:0/2118507063 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fa970003b20 0x7fa984129d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 >> 10.20.193.7:0/2118507063 conn(0x7fa98408f860 msgr2=0x7fa98413b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 shutdown_connections 2026-02-22T20:59:22.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.528+0000 7fa98ad78640 1 -- 10.20.193.7:0/2118507063 wait complete. 2026-02-22T20:59:22.544 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T20:59:22.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-22T20:59:22.544 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:59:22.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: get_monmap_and_config 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: build_initial_monmap 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: monmap: 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:22.604058+0000 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:22.604058+0000 2026-02-22T20:59:22.605 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 Processor -- start 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- start start 2026-02-22T20:59:22.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: init 2026-02-22T20:59:22.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T20:59:22.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9b4091c70 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:22.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb9b41808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-b con 0x7fb9b41604e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb9b4180e00 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b408e6a0 con 0x7fb9b4180e00 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b408e910 con 0x7fb9b4091c70 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b408ebf0 con 0x7fb9b41604e0 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient(hunting): authenticate will time out at 975.077176s 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b940e640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 msgr2=0x7fb9b41808c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b940e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb9b41808c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fb9b4180e00 0x7fb9b41a11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:40904/0 (socket says 10.20.193.7:40904) 2026-02-22T20:59:22.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 1 -- 10.20.193.7:0/2571402743 learned_addr learned my addr 10.20.193.7:0/2571402743 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159959807 0 0) 0x7fb9b408e6a0 con 0x7fb9b4180e00 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): _negotiate 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): my global_id is 94749 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99c003620 con 0x7fb9b4180e00 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4017921726 0 0) 0x7fb99c003620 con 0x7fb9b4180e00 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 msgr2=0x7fb9b41808c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb9b41808c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 >> v1:10.20.193.61:6789/0 conn(0x7fb9b4091c70 legacy=0x7fb9b4092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b408eed0 con 0x7fb9b4180e00 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fb9b00031e0 con 0x7fb9b4180e00 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: dump: 2026-02-22T20:59:22.622 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 >> v1:10.20.193.7:6789/0 conn(0x7fb9b4180e00 legacy=0x7fb9b41a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb99c003b20 0x7fb99c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): picked mon.a con 0x7fb99c003b20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb99c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): picked mon.c con 0x7fb9b41604e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb99c005010 0x7fb99c065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): picked mon.b con 0x7fb99c005010 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b408ebf0 con 0x7fb99c003b20 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c065fd0 con 0x7fb99c005010 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c066150 con 0x7fb9b41604e0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b940e640 1 -- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 msgr2=0x7fb99c0048d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b940e640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb99c0048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb99c003b20 0x7fb99c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): get_auth_request con 0x7fb99c003b20 auth_method 0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb99c005010 0x7fb99c065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 10 monclient(hunting): get_auth_request con 0x7fb99c005010 auth_method 0 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_done global_id 94749 payload 293 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 -- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 msgr2=0x7fb99c0048d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb9b41604e0 0x7fb99c0048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 -- 10.20.193.7:0/2571402743 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb99c005010 msgr2=0x7fb99c065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb99c005010 0x7fb99c065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 monclient: found mon.a 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 -- 10.20.193.7:0/2571402743 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c003620 con 0x7fb99c003b20 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 5 monclient: authenticate success, global_id 94749 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb99c005010 0x7fb99c065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb99c003b20 0x7fb99c003ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4007fd0 tx=0x7fb9a401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48578e3bb718e080 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40af070 con 0x7fb99c003b20 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: dump: 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.628 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a4006af0 con 0x7fb99c003b20 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 1 -- 10.20.193.7:0/2571402743 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4002d10 con 0x7fb99c003b20 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 4 set_mon_vals no callback set 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9b8c0d640 10 monclient: dump: 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.629 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 10 monclient: shutdown 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb99c003b20 msgr2=0x7fb99c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 --2- 10.20.193.7:0/2571402743 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb99c003b20 0x7fb99c003ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4007fd0 tx=0x7fb9a401c5c0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9ba410640 1 -- 10.20.193.7:0/2571402743 reap_dead start 2026-02-22T20:59:22.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/2571402743 shutdown_connections 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/2571402743 >> 10.20.193.7:0/2571402743 conn(0x7fb9b4093d80 msgr2=0x7fb9b4090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/2571402743 shutdown_connections 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.600+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/2571402743 wait complete. 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: build_initial_monmap 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: monmap: 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.631 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 Processor -- start 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- start start 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: init 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb99c003b20 0x7fb9b4168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-c con 0x7fb99c003b20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 0x7fb9b417fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-a con 0x7fb9b4166ec0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb9b4180380 0x7fb9b4131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): picked mon.noname-b con 0x7fb9b4180380 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4163460 con 0x7fb9b4166ec0 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b41632e0 con 0x7fb9b4180380 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b41635e0 con 0x7fb99c003b20 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): authenticate will time out at 975.080686s 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb99c003b20 msgr2=0x7fb9b4168fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb99c003b20 0x7fb9b4168fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 0x7fb9b417fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 0x7fb9b417fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:51182/0 (socket says 10.20.193.7:51182) 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 -- 10.20.193.7:0/1827275066 learned_addr learned my addr 10.20.193.7:0/1827275066 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): get_auth_request con 0x7fb9b4166ec0 auth_method 0 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb9b4180380 0x7fb9b4131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): get_auth_request con 0x7fb9b4180380 auth_method 0 2026-02-22T20:59:22.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient(hunting): handle_auth_done global_id 94752 payload 824 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb99c003b20 msgr2=0x7fb9b4168fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fb99c003b20 0x7fb9b4168fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb9b4180380 msgr2=0x7fb9b4131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fb9b4180380 0x7fb9b4131ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 monclient: found mon.noname-a 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b4180ae0 con 0x7fb9b4166ec0 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b940e640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 0x7fb9b417fe40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800b520 tx=0x7fb9a800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8017070 con 0x7fb9b4166ec0 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: dump: 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.636 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a80060d0 con 0x7fb9b4166ec0 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80064a0 con 0x7fb9b4166ec0 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 5 monclient: authenticate success, global_id 94752 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _renew_subs 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b408a970 con 0x7fb9b4166ec0 2026-02-22T20:59:22.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a3fff640 4 set_mon_vals no callback set 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: dump: 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _renew_subs 2026-02-22T20:59:22.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b416a7d0 con 0x7fb9b4166ec0 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 0x7fb9b4087c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4092040 con 0x7fb9b4087830 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fb9a8006640 con 0x7fb9b4166ec0 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 0x7fb9b4087c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient: get_auth_request con 0x7fb9b4087830 auth_method 0 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_done global_id 94755 payload 824 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9b4092890 con 0x7fb9b4087830 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 --2- 10.20.193.7:0/1827275066 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb98403aa90 0x7fb98405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7fb9a804de60 con 0x7fb9b4166ec0 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 0x7fb9b4087c00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb99c005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40af040 con 0x7fb9b4087830 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: dump: 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.640 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 1 --2- 10.20.193.7:0/1827275066 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb98403aa90 0x7fb98405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 10 monclient: get_auth_request con 0x7fb98403aa90 auth_method 0 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fb9a40b9070 con 0x7fb9b4087830 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:22.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 msgr2=0x7fb9b4087c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 0x7fb9b4087c00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb99c005900 comp rx=0 tx=0).stop 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 msgr2=0x7fb9b4087c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9a27fc640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4087830 0x7fb9b4087c00 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb99c005900 comp rx=0 tx=0).stop 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.604+0000 7fb9ba410640 1 --2- 10.20.193.7:0/1827275066 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb98403aa90 0x7fb98405af40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0002b80 tx=0x7fb9b0003930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 0x7fb9b4088140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b416a330 con 0x7fb9b4169f30 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 0x7fb9b4088140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient: get_auth_request con 0x7fb9b4169f30 auth_method 0 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 10 monclient(hunting): handle_auth_done global_id 94758 payload 824 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 1 -- 10.20.193.7:0/1827275066 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9b4132bd0 con 0x7fb9b4169f30 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9b9c0f640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 0x7fb9b4088140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb9a4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40af070 con 0x7fb9b4169f30 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 10 monclient: dump: 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.643 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4872 (secure 0 0 0) 0x7fb9a4005590 con 0x7fb9b4169f30 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 msgr2=0x7fb9b4088140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 0x7fb9b4088140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb9a4007d90 comp rx=0 tx=0).stop 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 msgr2=0x7fb9b4088140 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:22.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9a27fc640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4169f30 0x7fb9b4088140 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb9a401c3f0 tx=0x7fb9a4007d90 comp rx=0 tx=0).stop 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 64, 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 135293, 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:22.645 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:22.646 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.647 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.648 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:22.649 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:22.650 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.651 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:22.652 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb98403aa90 msgr2=0x7fb98405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 --2- 10.20.193.7:0/1827275066 >> v2:10.20.193.61:6800/2336688312 conn(0x7fb98403aa90 0x7fb98405af40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0002b80 tx=0x7fb9b0003930 comp rx=0 tx=0).stop 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 10 monclient: shutdown 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 msgr2=0x7fb9b417fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 --2- 10.20.193.7:0/1827275066 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fb9b4166ec0 0x7fb9b417fe40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800b520 tx=0x7fb9a800b920 comp rx=0 tx=0).stop 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9ba410640 1 -- 10.20.193.7:0/1827275066 reap_dead start 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9ba410640 1 -- 10.20.193.7:0/1827275066 reap_dead start 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 shutdown_connections 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 >> 10.20.193.7:0/1827275066 conn(0x7fb9b4093d80 msgr2=0x7fb9b408ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 shutdown_connections 2026-02-22T20:59:22.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.608+0000 7fb9bbe9a640 1 -- 10.20.193.7:0/1827275066 wait complete. 2026-02-22T20:59:22.653 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:59:22.653 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T20:59:22.653 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:59:22.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: get_monmap_and_config 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: build_initial_monmap 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: monmap: 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:22.714697+0000 2026-02-22T20:59:22.716 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:22.714697+0000 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:22.717 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 1 Processor -- start 2026-02-22T20:59:22.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 1 -- start start 2026-02-22T20:59:22.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: init 2026-02-22T20:59:22.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f917808eb20 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9178180640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-b con 0x7f917808f600 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9178180b80 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.708+0000 7f917d0d7640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917808ae20 con 0x7f9178180b80 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917808c210 con 0x7f917808eb20 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f917808a8f0 con 0x7f917808f600 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient(hunting): authenticate will time out at 975.188023s 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 msgr2=0x7f9178180640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9178180640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f9178180b80 0x7f91781a0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:40912/0 (socket says 10.20.193.7:40912) 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 -- 10.20.193.7:0/2868834640 learned_addr learned my addr 10.20.193.7:0/2868834640 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349653704 0 0) 0x7f917808ae20 con 0x7f9178180b80 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _negotiate 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): my global_id is 94761 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9164003620 con 0x7f9178180b80 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333137193 0 0) 0x7f917808c210 con 0x7f917808eb20 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _negotiate 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): my global_id is 114208 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917808ae20 con 0x7f917808eb20 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3153864813 0 0) 0x7f9164003620 con 0x7f9178180b80 2026-02-22T20:59:22.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 msgr2=0x7f9178180640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9178180640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 >> v1:10.20.193.61:6789/0 conn(0x7f917808eb20 legacy=0x7f917808eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917805ff80 con 0x7f9178180b80 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f91680031e0 con 0x7f9178180b80 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: dump: 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.738 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 >> v1:10.20.193.7:6789/0 conn(0x7f9178180b80 legacy=0x7f91781a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9164003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): picked mon.c con 0x7f917808f600 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f91640042d0 0x7f91640048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): picked mon.b con 0x7f91640042d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9164005010 0x7f9164065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): picked mon.a con 0x7f9164005010 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f917808a8f0 con 0x7f9164005010 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9164065fd0 con 0x7f91640042d0 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9164066150 con 0x7f917808f600 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176d76640 1 -- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 msgr2=0x7f9164003d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176d76640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9164003d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9164005010 0x7f9164065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): get_auth_request con 0x7f9164005010 auth_method 0 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f91640042d0 0x7f91640048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 10 monclient(hunting): get_auth_request con 0x7f91640042d0 auth_method 0 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient(hunting): handle_auth_done global_id 94761 payload 293 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 -- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 msgr2=0x7f9164003d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f917808f600 0x7f9164003d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 -- 10.20.193.7:0/2868834640 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f91640042d0 msgr2=0x7f91640048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:22.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f91640042d0 0x7f91640048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 monclient: found mon.a 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 -- 10.20.193.7:0/2868834640 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9164003620 con 0x7f9164005010 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 5 monclient: authenticate success, global_id 94761 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9176575640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f91640042d0 0x7f91640048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9164005010 0x7f9164065a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f916800a7d0 tx=0x7f916801d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85327ae755b21ea server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916800a3f0 con 0x7f9164005010 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: dump: 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91680ad630 con 0x7f9164005010 2026-02-22T20:59:22.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 1 -- 10.20.193.7:0/2868834640 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680ada20 con 0x7f9164005010 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 4 set_mon_vals no callback set 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9175d74640 10 monclient: dump: 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient: shutdown 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9164005010 msgr2=0x7f9164065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 --2- 10.20.193.7:0/2868834640 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9164005010 0x7f9164065a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f916800a7d0 tx=0x7f916801d2a0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f9177577640 1 -- 10.20.193.7:0/2868834640 reap_dead start 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- 10.20.193.7:0/2868834640 shutdown_connections 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- 10.20.193.7:0/2868834640 >> 10.20.193.7:0/2868834640 conn(0x7f9178038f20 msgr2=0x7f91780392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- 10.20.193.7:0/2868834640 shutdown_connections 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 1 -- 10.20.193.7:0/2868834640 wait complete. 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient: build_initial_monmap 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.712+0000 7f917d0d7640 10 monclient: monmap: 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:22.745 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 Processor -- start 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- start start 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: init 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 0x7f917817db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.746 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-a con 0x7f917817d770 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f91781681e0 0x7f9178168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-c con 0x7f91781681e0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9178168b90 0x7f9178169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): picked mon.noname-b con 0x7f9178168b90 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9178162fd0 con 0x7f917817d770 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9178162e50 con 0x7f9178168b90 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9178163150 con 0x7f91781681e0 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): authenticate will time out at 975.192690s 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 1 -- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f91781681e0 msgr2=0x7f9178168650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3301/0 2026-02-22T20:59:22.747 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f91781681e0 0x7f9178168650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 0x7f917817db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 0x7f917817db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:51214/0 (socket says 10.20.193.7:51214) 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 -- 10.20.193.7:0/2035471385 learned_addr learned my addr 10.20.193.7:0/2035471385 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): get_auth_request con 0x7f917817d770 auth_method 0 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient(hunting): handle_auth_done global_id 94764 payload 824 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9178168b90 0x7f9178169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f91781681e0 msgr2=0x7f9178168650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:22.748 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f91781681e0 0x7f9178168650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9178168b90 msgr2=0x7f9178169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9178168b90 0x7f9178169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient: _finish_hunting 0 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 monclient: found mon.noname-a 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9178088770 con 0x7f917817d770 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 10 monclient: get_auth_request con 0x7f9178168b90 auth_method 0 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9178168b90 0x7f9178169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176d76640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 0x7f917817db40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f916c0029a0 tx=0x7f916c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c017070 con 0x7f917817d770 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: dump: 2026-02-22T20:59:22.749 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c005cd0 con 0x7f917817d770 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:22.750 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c007290 con 0x7f917817d770 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 5 monclient: authenticate success, global_id 94764 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: dump: 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9175573640 4 set_mon_vals no callback set 2026-02-22T20:59:22.751 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _renew_subs 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917805dcf0 con 0x7f917817d770 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _renew_subs 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917816bee0 con 0x7f917817d770 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 0x7f9178164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f917816b950 con 0x7f917808eef0 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 0x7f9178164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient: get_auth_request con 0x7f917808eef0 auth_method 0 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f916c007430 con 0x7f917817d770 2026-02-22T20:59:22.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 10 monclient(hunting): handle_auth_done global_id 114211 payload 824 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9178169550 con 0x7f917808eef0 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 --2- 10.20.193.7:0/2035471385 >> v2:10.20.193.61:6800/2336688312 conn(0x7f914403aa90 0x7f914405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(238..238 src has 64..238) ==== 3503+0+0 (secure 0 0 0) 0x7f916c04ddd0 con 0x7f917817d770 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9176575640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 0x7f9178164660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f916000b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916000be60 con 0x7f917808eef0 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: dump: 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.753 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 1 --2- 10.20.193.7:0/2035471385 >> v2:10.20.193.61:6800/2336688312 conn(0x7f914403aa90 0x7f914405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 10 monclient: get_auth_request con 0x7f914403aa90 auth_method 0 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f9160003c60 con 0x7f917808eef0 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 msgr2=0x7f9178164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 0x7f9178164660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f916000b6e0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 msgr2=0x7f9178164660 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f91577fe640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917808eef0 0x7f9178164660 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f916000b6e0 comp rx=0 tx=0).stop 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.716+0000 7f9177577640 1 --2- 10.20.193.7:0/2035471385 >> v2:10.20.193.61:6800/2336688312 conn(0x7f914403aa90 0x7f914405af40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f916800a2a0 tx=0x7f9168003580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:22.754 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 0x7f917804ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f917816a6e0 con 0x7f917804ca80 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 0x7f917804ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient: get_auth_request con 0x7f917804ca80 auth_method 0 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 10 monclient(hunting): handle_auth_done global_id 114214 payload 824 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 1 -- 10.20.193.7:0/2035471385 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9178164ba0 con 0x7f917804ca80 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9176575640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 0x7f917804ce80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f9160005b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91600052e0 con 0x7f917804ca80 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:22.755 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 10 monclient: dump: 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5036 (secure 0 0 0) 0x7f91600052e0 con 0x7f917804ca80 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 msgr2=0x7f917804ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 0x7f917804ce80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f9160005b30 comp rx=0 tx=0).stop 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 msgr2=0x7f917804ce80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:22.756 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f91577fe640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f917804ca80 0x7f917804ce80 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f916000dca0 tx=0x7f9160005b30 comp rx=0 tx=0).stop 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 64, 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 23911, 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: 1 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:22.757 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:22.758 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:22.759 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:22.760 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:22.761 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.762 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.763 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:22.764 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.765 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "num": 8 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:22.766 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 >> v2:10.20.193.61:6800/2336688312 conn(0x7f914403aa90 msgr2=0x7f914405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 --2- 10.20.193.7:0/2035471385 >> v2:10.20.193.61:6800/2336688312 conn(0x7f914403aa90 0x7f914405af40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f916800a2a0 tx=0x7f9168003580 comp rx=0 tx=0).stop 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 10 monclient: shutdown 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 msgr2=0x7f917817db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 --2- 10.20.193.7:0/2035471385 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f917817d770 0x7f917817db40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f916c0029a0 tx=0x7f916c00c960 comp rx=0 tx=0).stop 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9177577640 1 -- 10.20.193.7:0/2035471385 reap_dead start 2026-02-22T20:59:22.767 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f9177577640 1 -- 10.20.193.7:0/2035471385 reap_dead start 2026-02-22T20:59:22.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 shutdown_connections 2026-02-22T20:59:22.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 >> 10.20.193.7:0/2035471385 conn(0x7f9178038f20 msgr2=0x7f917817edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:22.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 shutdown_connections 2026-02-22T20:59:22.768 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:22.720+0000 7f917d0d7640 1 -- 10.20.193.7:0/2035471385 wait complete. 2026-02-22T20:59:22.768 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T20:59:22.768 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: starting. 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: creating pool ceph_test_rados_delete_pools_parallel.trial061-21920 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: created object 0... 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: created object 25... 2026-02-22T20:59:24.445 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: created object 49... 2026-02-22T20:59:24.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: finishing. 2026-02-22T20:59:24.446 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[21955]: shutting down. 2026-02-22T20:59:24.457 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:24.457 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: starting. 2026-02-22T20:59:24.458 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: listing objects. 2026-02-22T20:59:24.458 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: listed object 0... 2026-02-22T20:59:24.458 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: listed object 25... 2026-02-22T20:59:24.459 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: saw 50 objects 2026-02-22T20:59:24.459 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[21957]: shutting down. 2026-02-22T20:59:25.400 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:25.400 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21956]: starting. 2026-02-22T20:59:25.400 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21956]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-21920 2026-02-22T20:59:25.400 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[21956]: shutting down. 2026-02-22T20:59:25.402 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:25.402 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:25.402 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:25.404 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:26.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:26.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: starting. 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22007 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: created object 0... 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: created object 25... 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: created object 49... 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: finishing. 2026-02-22T20:59:27.660 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22008]: shutting down. 2026-02-22T20:59:28.409 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22009]: starting. 2026-02-22T20:59:28.409 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22009]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22007 2026-02-22T20:59:28.409 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22009]: shutting down. 2026-02-22T20:59:30.465 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: starting. 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22007 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: created object 0... 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: created object 25... 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: created object 49... 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: finishing. 2026-02-22T20:59:30.466 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22042]: shutting down. 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: starting. 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: listing objects. 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: listed object 0... 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: listed object 25... 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: saw 50 objects 2026-02-22T20:59:30.477 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22044]: shutting down. 2026-02-22T20:59:31.420 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:31.420 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22043]: starting. 2026-02-22T20:59:31.421 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22043]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22007 2026-02-22T20:59:31.421 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22043]: shutting down. 2026-02-22T20:59:31.422 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:31.422 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:31.422 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:31.425 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:31.943 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:31.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:31.949 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T20:59:31.953 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T20:59:31.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:31.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: starting. 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22094 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: created object 0... 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: created object 25... 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: created object 49... 2026-02-22T20:59:33.418 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: finishing. 2026-02-22T20:59:33.419 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22095]: shutting down. 2026-02-22T20:59:34.369 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22096]: starting. 2026-02-22T20:59:34.369 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22096]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22094 2026-02-22T20:59:34.369 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22096]: shutting down. 2026-02-22T20:59:36.426 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: starting. 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22094 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: created object 0... 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: created object 25... 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: created object 49... 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: finishing. 2026-02-22T20:59:36.427 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22129]: shutting down. 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: starting. 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: listing objects. 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: listed object 0... 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: listed object 25... 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: saw 50 objects 2026-02-22T20:59:36.437 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22131]: shutting down. 2026-02-22T20:59:36.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:36.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:37.378 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:37.378 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22130]: starting. 2026-02-22T20:59:37.379 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22130]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22094 2026-02-22T20:59:37.379 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22130]: shutting down. 2026-02-22T20:59:37.380 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:37.380 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:37.380 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:37.382 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:39.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: starting. 2026-02-22T20:59:39.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22181 2026-02-22T20:59:39.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: created object 0... 2026-02-22T20:59:39.435 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: created object 25... 2026-02-22T20:59:39.436 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: created object 49... 2026-02-22T20:59:39.436 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: finishing. 2026-02-22T20:59:39.436 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22182]: shutting down. 2026-02-22T20:59:40.389 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22183]: starting. 2026-02-22T20:59:40.389 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22183]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22181 2026-02-22T20:59:40.389 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22183]: shutting down. 2026-02-22T20:59:41.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:41.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:42.414 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: starting. 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22181 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: created object 0... 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: created object 25... 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: created object 49... 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: finishing. 2026-02-22T20:59:42.415 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22216]: shutting down. 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: starting. 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: listing objects. 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: listed object 0... 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: listed object 25... 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: saw 50 objects 2026-02-22T20:59:42.426 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22218]: shutting down. 2026-02-22T20:59:42.769 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-22T20:59:42.769 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T20:59:42.769 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T20:59:42.770 INFO:tasks.ceph.mon.c:Started 2026-02-22T20:59:42.770 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:59:42.770 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: get_monmap_and_config 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: build_initial_monmap 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: monmap: 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:42.830004+0000 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:42.830004+0000 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:42.830 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 Processor -- start 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 -- start start 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: init 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0d3808eb20 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0d3808f600 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d381a2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-b con 0x7f0d38181f20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3808c2a0 con 0x7f0d3808eb20 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3808a610 con 0x7f0d3808f600 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3808af40 con 0x7f0d38181f20 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 10 monclient(hunting): authenticate will time out at 995.302887s 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f0d3808eb20 0x7f0d3808eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53078/0 (socket says 10.20.193.7:53078) 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d381a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 1 -- 10.20.193.7:0/156245589 learned_addr learned my addr 10.20.193.7:0/156245589 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): get_auth_request con 0x7f0d38181f20 auth_method 0 2026-02-22T20:59:42.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 msgr2=0x7f0d381a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 msgr2=0x7f0d381a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d381a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d381a2300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150727715 0 0) 0x7f0d3808c2a0 con 0x7f0d3808eb20 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _negotiate 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): my global_id is 94854 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003620 con 0x7f0d3808eb20 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099606124 0 0) 0x7f0d3808a610 con 0x7f0d3808f600 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _negotiate 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): my global_id is 114319 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d3808c2a0 con 0x7f0d3808f600 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1434770645 0 0) 0x7f0d24003620 con 0x7f0d3808eb20 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 msgr2=0x7f0d381a2300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d381a2300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 >> v1:10.20.193.61:6789/0 conn(0x7f0d3808f600 legacy=0x7f0d38180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _finish_hunting 0 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 monclient: found mon.noname-a-legacy 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3808a8f0 con 0x7f0d3808eb20 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _finish_auth 0 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _check_auth_tickets 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f0d2c002e50 con 0x7f0d3808eb20 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T20:59:42.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: dump: 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 >> v1:10.20.193.7:6789/0 conn(0x7f0d3808eb20 legacy=0x7f0d3808eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d24003d30 0x7f0d24004120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): picked mon.b con 0x7f0d24003d30 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): picked mon.c con 0x7f0d38181f20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d24004f30 0x7f0d240053a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): picked mon.a con 0x7f0d24004f30 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3808af40 con 0x7f0d24004f30 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24065d30 con 0x7f0d24003d30 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d24065f30 con 0x7f0d38181f20 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d35d74640 10 monclient(hunting): _finish_auth 0 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): get_auth_request con 0x7f0d38181f20 auth_method 0 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:42.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d24004f30 0x7f0d240053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): get_auth_request con 0x7f0d24004f30 auth_method 0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d24003d30 0x7f0d24004120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 10 monclient(hunting): get_auth_request con 0x7f0d24003d30 auth_method 0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient(hunting): handle_auth_done global_id 94854 payload 293 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d24003d30 msgr2=0x7f0d24004120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d24003d30 0x7f0d24004120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d24004f30 msgr2=0x7f0d240053a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d24004f30 0x7f0d240053a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient: _finish_hunting 0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 monclient: found mon.c 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 1 -- 10.20.193.7:0/156245589 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d24003620 con 0x7f0d38181f20 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient: _finish_auth 0 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 10 monclient: _check_auth_tickets 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d36575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 5 monclient: authenticate success, global_id 94854 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d3c958640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:42.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.824+0000 7f0d37577640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d24004f30 0x7f0d240053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36575640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d240048d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d20007fd0 tx=0x7f0d2001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c24e25d42810f1d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20002dc0 con 0x7f0d38181f20 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: dump: 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d200052a0 con 0x7f0d38181f20 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 1 -- 10.20.193.7:0/156245589 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200068d0 con 0x7f0d38181f20 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35d74640 10 monclient: dump: 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:42.838 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 4 set_mon_vals no callback set 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: shutdown 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 msgr2=0x7f0d240048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 --2- 10.20.193.7:0/156245589 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38181f20 0x7f0d240048d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d20007fd0 tx=0x7f0d2001ed10 comp rx=0 tx=0).stop 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 -- 10.20.193.7:0/156245589 reap_dead start 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/156245589 shutdown_connections 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/156245589 >> 10.20.193.7:0/156245589 conn(0x7f0d38051980 msgr2=0x7f0d38051d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/156245589 shutdown_connections 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/156245589 wait complete. 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: build_initial_monmap 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: monmap: 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 Processor -- start 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- start start 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: init 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:42.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-c con 0x7f0d38127b30 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d38128440 0x7f0d38180800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-b con 0x7f0d38128440 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 0x7f0d381811a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): picked mon.noname-a con 0x7f0d38180d40 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38052b60 con 0x7f0d38180d40 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3805c390 con 0x7f0d38128440 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0d38052ce0 con 0x7f0d38127b30 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient(hunting): authenticate will time out at 995.306057s 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 0x7f0d381811a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:50094/0 (socket says 10.20.193.7:50094) 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 -- 10.20.193.7:0/132810091 learned_addr learned my addr 10.20.193.7:0/132810091 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 10 monclient(hunting): get_auth_request con 0x7f0d38127b30 auth_method 0 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): get_auth_request con 0x7f0d38180d40 auth_method 0 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 -- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 msgr2=0x7f0d38127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 -- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 msgr2=0x7f0d38127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36575640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d38128440 0x7f0d38180800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient(hunting): handle_auth_done global_id 94857 payload 824 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 -- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 msgr2=0x7f0d38127f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 -- 10.20.193.7:0/132810091 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d38128440 msgr2=0x7f0d38180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d38128440 0x7f0d38180800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient: _finish_hunting 0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 monclient: found mon.noname-a 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 -- 10.20.193.7:0/132810091 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3808e6d0 con 0x7f0d38180d40 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d37577640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 0x7f0d381811a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d38056c50 tx=0x7f0d28004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28009b10 con 0x7f0d38180d40 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: dump: 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2801a070 con 0x7f0d38180d40 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 5 monclient: authenticate success, global_id 94857 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d280147d0 con 0x7f0d38180d40 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:42.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 10 monclient: dump: 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d35573640 4 set_mon_vals no callback set 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _renew_subs 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3812b670 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _renew_subs 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d38087840 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3808eef0 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0d28014970 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 --2- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 0x7f0d0405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(258..258 src has 64..258) ==== 3897+0+0 (secure 0 0 0) 0x7f0d2804e600 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 1 --2- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 0x7f0d0405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.828+0000 7f0d36d76640 10 monclient: get_auth_request con 0x7f0d0403ab10 auth_method 0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.832+0000 7f0d36d76640 1 --2- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 0x7f0d0405afc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c004940 tx=0x7f0d2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.832+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f0d28012240 con 0x7f0d38180d40 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.832+0000 7f0d177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:42.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.832+0000 7f0d177fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:42.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d3812aae0 con 0x7f0d38180d40 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d177fe640 1 -- 10.20.193.7:0/132810091 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f0d2801d370 con 0x7f0d38180d40 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d177fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:42.946 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:42.947 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 msgr2=0x7f0d0405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 0x7f0d0405afc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c004940 tx=0x7f0d2c009040 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 10 monclient: shutdown 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 msgr2=0x7f0d381811a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 0x7f0d381811a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d38056c50 tx=0x7f0d28004a10 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 shutdown_connections 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0d38180d40 0x7f0d381811a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0d0403ab10 0x7f0d0405afc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0d38128440 0x7f0d38180800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 --2- 10.20.193.7:0/132810091 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0d38127b30 0x7f0d38127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:42.948 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 >> 10.20.193.7:0/132810091 conn(0x7f0d38051980 msgr2=0x7f0d380899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:42.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 shutdown_connections 2026-02-22T20:59:42.949 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:42.940+0000 7f0d3c958640 1 -- 10.20.193.7:0/132810091 wait complete. 2026-02-22T20:59:43.369 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:43.369 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22217]: starting. 2026-02-22T20:59:43.369 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22217]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22181 2026-02-22T20:59:43.369 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22217]: shutting down. 2026-02-22T20:59:43.371 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:43.371 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:43.371 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:43.374 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:45.455 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: starting. 2026-02-22T20:59:45.455 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22268 2026-02-22T20:59:45.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: created object 0... 2026-02-22T20:59:45.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: created object 25... 2026-02-22T20:59:45.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: created object 49... 2026-02-22T20:59:45.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: finishing. 2026-02-22T20:59:45.456 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22269]: shutting down. 2026-02-22T20:59:45.957 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: get_monmap_and_config 2026-02-22T20:59:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: build_initial_monmap 2026-02-22T20:59:46.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: monmap: 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:46.025120+0000 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:46.025120+0000 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:46.026 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 Processor -- start 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 -- start start 2026-02-22T20:59:46.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: init 2026-02-22T20:59:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient: _add_conns ranks=[1,4,3,2,0] 2026-02-22T20:59:46.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f074413f1f0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-c con 0x7f074413fcd0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0744180cd0 0x7f07441a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-a con 0x7f0744180cd0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07440873e0 con 0x7f074413f1f0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f074408ec40 con 0x7f0744180cd0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f074408e5f0 con 0x7f074413fcd0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074afa4640 10 monclient(hunting): authenticate will time out at 998.498019s 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0744180cd0 0x7f07441a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f0744180cd0 0x7f07441a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40352/0 (socket says 10.20.193.7:40352) 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 -- 10.20.193.7:0/3305356738 learned_addr learned my addr 10.20.193.7:0/3305356738 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): get_auth_request con 0x7f0744180cd0 auth_method 0 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:46.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f073bfff640 1 --2- 10.20.193.7:0/3305356738 >> v2:10.20.193.61:3300/0 conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f073bfff640 10 monclient(hunting): get_auth_request con 0x7f074413fcd0 auth_method 0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f073bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f073bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f073bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient(hunting): handle_auth_done global_id 94875 payload 274 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 -- 10.20.193.7:0/3305356738 >> v2:10.20.193.61:3300/0 conn(0x7f074413fcd0 msgr2=0x7f0744180790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 --2- 10.20.193.7:0/3305356738 >> v2:10.20.193.61:3300/0 conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 -- 10.20.193.7:0/3305356738 >> v1:10.20.193.61:6789/0 conn(0x7f074413f1f0 legacy=0x7f074413f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient: _finish_hunting 0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 monclient: found mon.noname-a 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.020+0000 7f074951a640 1 -- 10.20.193.7:0/3305356738 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074408e8d0 con 0x7f0744180cd0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 1 --2- 10.20.193.7:0/3305356738 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0744180cd0 0x7f07441a10b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f074408edc0 tx=0x7f074001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267d95e4e401ec54 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 1 -- 10.20.193.7:0/3305356738 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400b2070 con 0x7f0744180cd0 2026-02-22T20:59:46.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: dump: 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 1 -- 10.20.193.7:0/3305356738 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400a5710 con 0x7f0744180cd0 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 1 -- 10.20.193.7:0/3305356738 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400a5b00 con 0x7f0744180cd0 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 5 monclient: authenticate success, global_id 94875 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 4 set_mon_vals no callback set 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073b7fe640 10 monclient: dump: 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.035 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: shutdown 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3305356738 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0744180cd0 msgr2=0x7f07441a10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- 10.20.193.7:0/3305356738 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0744180cd0 0x7f07441a10b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f074408edc0 tx=0x7f074001c890 comp rx=0 tx=0).stop 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3305356738 shutdown_connections 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- 10.20.193.7:0/3305356738 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0744180cd0 0x7f07441a10b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- 10.20.193.7:0/3305356738 >> v2:10.20.193.61:3300/0 conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3305356738 >> 10.20.193.7:0/3305356738 conn(0x7f0744093c60 msgr2=0x7f0744094060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:46.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3305356738 shutdown_connections 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3305356738 wait complete. 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: build_initial_monmap 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: monmap: 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 Processor -- start 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- start start 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: init 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-a con 0x7f074413f1f0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-c con 0x7f074413fcd0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 0x7f074412acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): picked mon.noname-b con 0x7f0744180cd0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:46.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07441a4020 con 0x7f074413f1f0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f074408fea0 con 0x7f0744180cd0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f07441a41a0 con 0x7f074413fcd0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient(hunting): authenticate will time out at 998.502050s 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:40358/0 (socket says 10.20.193.7:40358) 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 -- 10.20.193.7:0/3643800379 learned_addr learned my addr 10.20.193.7:0/3643800379 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): get_auth_request con 0x7f074413f1f0 auth_method 0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 10 monclient(hunting): get_auth_request con 0x7f074413fcd0 auth_method 0 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 -- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 msgr2=0x7f0744180790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 -- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 msgr2=0x7f0744180790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:46.038 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 0x7f074412acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 10 monclient(hunting): get_auth_request con 0x7f0744180cd0 auth_method 0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient(hunting): handle_auth_done global_id 94878 payload 824 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 -- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 msgr2=0x7f0744180790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 -- 10.20.193.7:0/3643800379 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 msgr2=0x7f074412acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 0x7f074412acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient: _finish_hunting 0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 monclient: found mon.noname-a 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 -- 10.20.193.7:0/3643800379 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074410f690 con 0x7f074413f1f0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074951a640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 0x7f074412acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f0748d19640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f073400c520 tx=0x7f073400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734017070 con 0x7f074413f1f0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: dump: 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.039 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: _finish_auth 0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: _check_auth_tickets 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0734006ad0 con 0x7f074413f1f0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734007030 con 0x7f074413f1f0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 5 monclient: authenticate success, global_id 94878 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _renew_subs 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073affd640 4 set_mon_vals no callback set 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074410e820 con 0x7f074413f1f0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 10 monclient: dump: 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:46.040 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _renew_subs 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074410cdd0 con 0x7f074413f1f0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074413f5c0 con 0x7f074413f1f0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f07340071d0 con 0x7f074413f1f0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 --2- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 0x7f071405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(261..261 src has 64..261) ==== 3897+0+0 (secure 0 0 0) 0x7f073404dfc0 con 0x7f074413f1f0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 1 --2- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 0x7f071405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:46.041 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.024+0000 7f073bfff640 10 monclient: get_auth_request con 0x7f071403ab20 auth_method 0 2026-02-22T20:59:46.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.028+0000 7f073bfff640 1 --2- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 0x7f071405afd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f074412dcf0 tx=0x7f072c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:46.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.028+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f073401a360 con 0x7f074413f1f0 2026-02-22T20:59:46.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.028+0000 7f07397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:46.042 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.028+0000 7f07397fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f074405fc70 con 0x7f074413f1f0 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f07397fa640 1 -- 10.20.193.7:0/3643800379 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f0734009b10 con 0x7f074413f1f0 2026-02-22T20:59:46.146 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f07397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:46.147 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f07397fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:46.147 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:46.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 msgr2=0x7f071405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:46.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 0x7f071405afd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f074412dcf0 tx=0x7f072c008040 comp rx=0 tx=0).stop 2026-02-22T20:59:46.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 10 monclient: shutdown 2026-02-22T20:59:46.148 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 msgr2=0x7f074410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f073400c520 tx=0x7f073400c9e0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 shutdown_connections 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> v2:10.20.193.61:6800/2336688312 conn(0x7f071403ab20 0x7f071405afd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0744180cd0 0x7f074412acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f074413fcd0 0x7f0744180790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 --2- 10.20.193.7:0/3643800379 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f074413f1f0 0x7f074410de90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 >> 10.20.193.7:0/3643800379 conn(0x7f0744093c60 msgr2=0x7f0744088d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 shutdown_connections 2026-02-22T20:59:46.149 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:46.140+0000 7f074afa4640 1 -- 10.20.193.7:0/3643800379 wait complete. 2026-02-22T20:59:46.410 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22270]: starting. 2026-02-22T20:59:46.410 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22270]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22268 2026-02-22T20:59:46.410 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22270]: shutting down. 2026-02-22T20:59:46.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:46.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:48.467 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:48.467 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: starting. 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22268 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: created object 0... 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: created object 25... 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: created object 49... 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: finishing. 2026-02-22T20:59:48.468 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22303]: shutting down. 2026-02-22T20:59:48.478 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:48.478 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: starting. 2026-02-22T20:59:48.479 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: listing objects. 2026-02-22T20:59:48.479 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: listed object 0... 2026-02-22T20:59:48.479 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: listed object 25... 2026-02-22T20:59:48.479 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: saw 50 objects 2026-02-22T20:59:48.479 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22305]: shutting down. 2026-02-22T20:59:49.157 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: get_monmap_and_config 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: monmap: 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:49.218440+0000 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:49.218440+0000 2026-02-22T20:59:49.218 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:49.219 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 Processor -- start 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 -- start start 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: init 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f628408fd60 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-b con 0x7f628413b280 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f628413b650 0x7f62841a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-a con 0x7f628413b650 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628408e9e0 con 0x7f628408fd60 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f628408ec50 con 0x7f628413b650 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f628408ef30 con 0x7f628413b280 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6289c41640 10 monclient(hunting): authenticate will time out at 1001.691378s 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f628413b650 0x7f62841a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f628413b650 0x7f62841a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60726/0 (socket says 10.20.193.7:60726) 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53744/0 (socket says 10.20.193.7:53744) 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 -- 10.20.193.7:0/3619613915 learned_addr learned my addr 10.20.193.7:0/3619613915 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): get_auth_request con 0x7f628413b650 auth_method 0 2026-02-22T20:59:49.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 10 monclient(hunting): get_auth_request con 0x7f628413b280 auth_method 0 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 -- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 msgr2=0x7f6284180710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 -- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 msgr2=0x7f6284180710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6282ffd640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient(hunting): handle_auth_done global_id 94899 payload 274 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 -- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 msgr2=0x7f6284180710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 -- 10.20.193.7:0/3619613915 >> v1:10.20.193.61:6789/0 conn(0x7f628408fd60 legacy=0x7f628413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 monclient: found mon.noname-a 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.212+0000 7f6283fff640 1 -- 10.20.193.7:0/3619613915 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840870c0 con 0x7f628413b650 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b650 0x7f62841a0c60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6278009580 tx=0x7f627801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65816d6e926addce server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 1 -- 10.20.193.7:0/3619613915 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780b2070 con 0x7f628413b650 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: dump: 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.222 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 1 -- 10.20.193.7:0/3619613915 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62780a58b0 con 0x7f628413b650 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 5 monclient: authenticate success, global_id 94899 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 1 -- 10.20.193.7:0/3619613915 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780a5ca0 con 0x7f628413b650 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62827fc640 10 monclient: dump: 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 4 set_mon_vals no callback set 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: shutdown 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b650 msgr2=0x7f62841a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b650 0x7f62841a0c60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6278009580 tx=0x7f627801c920 comp rx=0 tx=0).stop 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/3619613915 shutdown_connections 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b650 0x7f62841a0c60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- 10.20.193.7:0/3619613915 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b280 0x7f6284180710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/3619613915 >> 10.20.193.7:0/3619613915 conn(0x7f628408ced0 msgr2=0x7f628408d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/3619613915 shutdown_connections 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/3619613915 wait complete. 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: monmap: 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.223 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 Processor -- start 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- start start 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: init 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f628408fd60 0x7f6284139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-b con 0x7f628408fd60 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-a con 0x7f628413b280 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): picked mon.noname-c con 0x7f628413b650 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62841a3d50 con 0x7f628413b280 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f62841a3bd0 con 0x7f628408fd60 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f62841a3ed0 con 0x7f628413b650 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient(hunting): authenticate will time out at 1001.694648s 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60742/0 (socket says 10.20.193.7:60742) 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 -- 10.20.193.7:0/2953896962 learned_addr learned my addr 10.20.193.7:0/2953896962 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): get_auth_request con 0x7f628413b280 auth_method 0 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 10 monclient(hunting): get_auth_request con 0x7f628413b650 auth_method 0 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 -- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 msgr2=0x7f62841278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 -- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 msgr2=0x7f62841278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:49.224 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62837fe640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f628408fd60 0x7f6284139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62837fe640 10 monclient(hunting): get_auth_request con 0x7f628408fd60 auth_method 0 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62837fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f62837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6283fff640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient(hunting): handle_auth_done global_id 94902 payload 824 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 -- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 msgr2=0x7f62841278d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 -- 10.20.193.7:0/2953896962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f628408fd60 msgr2=0x7f6284139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f628408fd60 0x7f6284139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 monclient: found mon.noname-a 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 -- 10.20.193.7:0/2953896962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628412b6b0 con 0x7f628413b280 2026-02-22T20:59:49.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6282ffd640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6274006b80 tx=0x7f627400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274017070 con 0x7f628413b280 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: dump: 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627400c910 con 0x7f628413b280 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627400f040 con 0x7f628413b280 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 5 monclient: authenticate success, global_id 94902 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _renew_subs 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628413cce0 con 0x7f628413b280 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6281ffb640 4 set_mon_vals no callback set 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f625ffff640 10 monclient: dump: 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _renew_subs 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628412a260 con 0x7f628413b280 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.216+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628413ab70 con 0x7f628413b280 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f6274012050 con 0x7f628413b280 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f625ffff640 1 --2- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 0x7f625405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(264..264 src has 64..264) ==== 3897+0+0 (secure 0 0 0) 0x7f627404e540 con 0x7f628413b280 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f62837fe640 1 --2- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 0x7f625405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f62837fe640 10 monclient: get_auth_request con 0x7f625403ab20 auth_method 0 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.220+0000 7f62837fe640 1 --2- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 0x7f625405afd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f62700037b0 tx=0x7f6270009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.224+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f6274016170 con 0x7f628413b280 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.224+0000 7f625ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.224+0000 7f625ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:49.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:49.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:49.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6284129350 con 0x7f628413b280 2026-02-22T20:59:49.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f625ffff640 1 -- 10.20.193.7:0/2953896962 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f627400a0d0 con 0x7f628413b280 2026-02-22T20:59:49.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f625ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:49.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f625ffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:49.338 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:49.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 msgr2=0x7f625405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 0x7f625405afd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f62700037b0 tx=0x7f6270009040 comp rx=0 tx=0).stop 2026-02-22T20:59:49.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 10 monclient: shutdown 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 msgr2=0x7f628413a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6274006b80 tx=0x7f627400ec70 comp rx=0 tx=0).stop 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 shutdown_connections 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f628413b650 0x7f62841278d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f628413b280 0x7f628413a1f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> v2:10.20.193.61:6800/2336688312 conn(0x7f625403ab20 0x7f625405afd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 --2- 10.20.193.7:0/2953896962 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f628408fd60 0x7f6284139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 >> 10.20.193.7:0/2953896962 conn(0x7f628408ced0 msgr2=0x7f628413bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:49.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 shutdown_connections 2026-02-22T20:59:49.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.332+0000 7f6289c41640 1 -- 10.20.193.7:0/2953896962 wait complete. 2026-02-22T20:59:49.348 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:59:49.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:59:49.348 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.412+0000 7f7b1bfff640 10 monclient: get_monmap_and_config 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.412+0000 7f7b1bfff640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.412+0000 7f7b1bfff640 10 monclient: monmap: 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:49.419480+0000 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:49.419480+0000 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:49.419 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22304]: starting. 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22304]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22268 2026-02-22T20:59:49.420 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22304]: shutting down. 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 Processor -- start 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- start start 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: init 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f7b1c13f780 0x7f7b1c13fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f7b1c13f780 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f7b1c055a70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7b1c0563e0 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c056880 con 0x7f7b1c0563e0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c13f110 con 0x7f7b1c13f780 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c087300 con 0x7f7b1c055a70 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient(hunting): authenticate will time out at 1001.892764s 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53762/0 (socket says 10.20.193.7:53762) 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 -- 10.20.193.7:0/871116427 learned_addr learned my addr 10.20.193.7:0/871116427 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c055a70 auth_method 0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 -- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 -- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 --2- 10.20.193.7:0/871116427 >> v2:10.20.193.61:3300/0 conn(0x7f7b1c13f780 0x7f7b1c13fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1a7fc640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7b1c13f780 auth_method 0 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient(hunting): handle_auth_done global_id 114364 payload 274 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 -- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c055ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 -- 10.20.193.7:0/871116427 >> v1:10.20.193.61:6789/0 conn(0x7f7b1c0563e0 legacy=0x7f7b1c1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 monclient: found mon.noname-c 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 -- 10.20.193.7:0/871116427 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c091820 con 0x7f7b1c13f780 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:49.422 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1affd640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c13f780 0x7f7b1c13fb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004780 tx=0x7f7b1001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0387bc757ada01e server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 1 -- 10.20.193.7:0/871116427 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100ab660 con 0x7f7b1c13f780 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: dump: 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 1 -- 10.20.193.7:0/871116427 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b100b0070 con 0x7f7b1c13f780 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 5 monclient: authenticate success, global_id 114364 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 1 -- 10.20.193.7:0/871116427 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100aba20 con 0x7f7b1c13f780 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b19ffb640 10 monclient: dump: 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.423 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 4 set_mon_vals no callback set 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: shutdown 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- 10.20.193.7:0/871116427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c13f780 msgr2=0x7f7b1c13fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c13f780 0x7f7b1c13fb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004780 tx=0x7f7b1001c440 comp rx=0 tx=0).stop 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- 10.20.193.7:0/871116427 shutdown_connections 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c055ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/871116427 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c13f780 0x7f7b1c13fb50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- 10.20.193.7:0/871116427 >> 10.20.193.7:0/871116427 conn(0x7f7b1c0906f0 msgr2=0x7f7b1c090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- 10.20.193.7:0/871116427 shutdown_connections 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- 10.20.193.7:0/871116427 wait complete. 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: monmap: 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:49.424 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.425 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 Processor -- start 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 1 -- start start 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.416+0000 7f7b1bfff640 10 monclient: init 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f7b1c055a70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c0563e0 0x7f7b1c12cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f7b1c0563e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 0x7f7b1c12d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f7b1c13f780 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1a4500 con 0x7f7b1c13f780 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1a4380 con 0x7f7b1c0563e0 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c1a4680 con 0x7f7b1c055a70 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): authenticate will time out at 1001.896181s 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53764/0 (socket says 10.20.193.7:53764) 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 -- 10.20.193.7:0/3585979774 learned_addr learned my addr 10.20.193.7:0/3585979774 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): get_auth_request con 0x7f7b1c055a70 auth_method 0 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 0x7f7b1c12d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b1c13f780 auth_method 0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c0563e0 0x7f7b1c12cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b1c0563e0 auth_method 0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient(hunting): handle_auth_done global_id 94905 payload 824 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 msgr2=0x7f7b1c12ca10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7b1c055a70 0x7f7b1c12ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c0563e0 msgr2=0x7f7b1c12cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f7b1c0563e0 0x7f7b1c12cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 monclient: found mon.noname-a 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c08a9e0 con 0x7f7b1c13f780 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1b7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 0x7f7b1c12d490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c002af0 tx=0x7f7b0c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c016020 con 0x7f7b1c13f780 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: dump: 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.428 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c00aca0 con 0x7f7b1c13f780 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c012620 con 0x7f7b1c13f780 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: dump: 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 5 monclient: authenticate success, global_id 94905 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b197fa640 4 set_mon_vals no callback set 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _renew_subs 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c130130 con 0x7f7b1c13f780 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _renew_subs 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c087f00 con 0x7f7b1c13f780 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 0x7f7b1c08abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c12e390 con 0x7f7b1c1509e0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 0x7f7b1c08abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient: get_auth_request con 0x7f7b1c1509e0 auth_method 0 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 10 monclient(hunting): handle_auth_done global_id 94908 payload 824 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b1c12f880 con 0x7f7b1c1509e0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 0x7f7b1c08abf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b10002410 tx=0x7f7b100191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f7b0c0127c0 con 0x7f7b1c13f780 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 --2- 10.20.193.7:0/3585979774 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7ae803aae0 0x7f7ae805af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(265..265 src has 64..265) ==== 3503+0+0 (secure 0 0 0) 0x7f7b0c04f0b0 con 0x7f7b1c13f780 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100b8070 con 0x7f7b1c1509e0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: dump: 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f7b100b0050 con 0x7f7b1c1509e0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 msgr2=0x7f7b1c08abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 0x7f7b1c08abf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b10002410 tx=0x7f7b100191e0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 msgr2=0x7f7b1c08abf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7afb7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c1509e0 0x7f7b1c08abf0 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b10002410 tx=0x7f7b100191e0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 1 --2- 10.20.193.7:0/3585979774 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7ae803aae0 0x7f7ae805af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 10 monclient: get_auth_request con 0x7f7ae803aae0 auth_method 0 2026-02-22T20:59:49.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.420+0000 7f7b1a7fc640 1 --2- 10.20.193.7:0/3585979774 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7ae803aae0 0x7f7ae805af90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006d80 tx=0x7f7b04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 0x7f7b1c08b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c055ea0 con 0x7f7b1c150db0 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 0x7f7b1c08b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient: get_auth_request con 0x7f7b1c150db0 auth_method 0 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 10 monclient(hunting): handle_auth_done global_id 94911 payload 824 2026-02-22T20:59:49.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 1 -- 10.20.193.7:0/3585979774 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b1c056b30 con 0x7f7b1c150db0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1affd640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 0x7f7b1c08b130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b1001c480 tx=0x7f7b100a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10003030 con 0x7f7b1c150db0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 10 monclient: dump: 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f7b100c2920 con 0x7f7b1c150db0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 msgr2=0x7f7b1c08b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 0x7f7b1c08b130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b1001c480 tx=0x7f7b100a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 msgr2=0x7f7b1c08b130 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7afb7fe640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c150db0 0x7f7b1c08b130 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b1001c480 tx=0x7f7b100a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:49.432 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 162109, 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 1, 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:49.433 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:49.434 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:49.435 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:49.436 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:49.437 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:49.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7ae803aae0 msgr2=0x7f7ae805af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/3585979774 >> v2:10.20.193.61:6800/2336688312 conn(0x7f7ae803aae0 0x7f7ae805af90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006d80 tx=0x7f7b04008040 comp rx=0 tx=0).stop 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 10 monclient: shutdown 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 msgr2=0x7f7b1c12d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 0x7f7b1c12d490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c002af0 tx=0x7f7b0c00a060 comp rx=0 tx=0).stop 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1b7fe640 1 -- 10.20.193.7:0/3585979774 reap_dead start 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 shutdown_connections 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 --2- 10.20.193.7:0/3585979774 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f7b1c13f780 0x7f7b1c12d490 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 >> 10.20.193.7:0/3585979774 conn(0x7f7b1c0906f0 msgr2=0x7f7b1c089fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 shutdown_connections 2026-02-22T20:59:49.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.424+0000 7f7b1bfff640 1 -- 10.20.193.7:0/3585979774 wait complete. 2026-02-22T20:59:49.439 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:49.439 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:59:49.439 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 10 monclient: get_monmap_and_config 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 10 monclient: monmap: 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:49.499090+0000 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:49.499090+0000 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:49.499 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 1 Processor -- start 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 1 -- start start 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.492+0000 7f1ae7d27640 10 monclient: init 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1ae0091c70 0x7f1ae0092040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-c con 0x7f1ae0091c70 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ae013f1b0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1ae013fce0 0x7f1ae01a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-a con 0x7f1ae013fce0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ae008e6a0 con 0x7f1ae013f1b0 2026-02-22T20:59:49.501 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae008e910 con 0x7f1ae013fce0 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae008ebf0 con 0x7f1ae0091c70 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): authenticate will time out at 1001.972120s 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1ae013fce0 0x7f1ae01a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1ae013f1b0 0x7f1ae013f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:45280/0 (socket says 10.20.193.7:45280) 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 -- 10.20.193.7:0/3830053765 learned_addr learned my addr 10.20.193.7:0/3830053765 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): get_auth_request con 0x7f1ae013fce0 auth_method 0 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/3830053765 >> v2:10.20.193.61:3300/0 conn(0x7f1ae0091c70 0x7f1ae0092040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request con 0x7f1ae0091c70 auth_method 0 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_done global_id 94926 payload 274 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/3830053765 >> v2:10.20.193.61:3300/0 conn(0x7f1ae0091c70 msgr2=0x7f1ae0092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- 10.20.193.7:0/3830053765 >> v2:10.20.193.61:3300/0 conn(0x7f1ae0091c70 0x7f1ae0092040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/3830053765 >> v1:10.20.193.7:6789/0 conn(0x7f1ae013f1b0 legacy=0x7f1ae013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 monclient: found mon.noname-a 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/3830053765 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae008eed0 con 0x7f1ae013fce0 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 1 -- 10.20.193.7:0/3830053765 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863136405 0 0) 0x7f1ae008e6a0 con 0x7f1ae013f1b0 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:59:49.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- 10.20.193.7:0/3830053765 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae01a1510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0090990 tx=0x7f1adc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704818f8d9a05e65 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 1 -- 10.20.193.7:0/3830053765 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0b2070 con 0x7f1ae013fce0 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: dump: 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.506 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 5 monclient: authenticate success, global_id 94926 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 1 -- 10.20.193.7:0/3830053765 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1adc0a58d0 con 0x7f1ae013fce0 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 1 -- 10.20.193.7:0/3830053765 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0a5cc0 con 0x7f1ae013fce0 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae4a9a640 10 monclient: dump: 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 4 set_mon_vals no callback set 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: shutdown 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:49.507 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/3830053765 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 msgr2=0x7f1ae01a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/3830053765 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae01a1510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0090990 tx=0x7f1adc01c7f0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/3830053765 shutdown_connections 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/3830053765 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae01a1510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/3830053765 >> v2:10.20.193.61:3300/0 conn(0x7f1ae0091c70 0x7f1ae0092040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/3830053765 >> 10.20.193.7:0/3830053765 conn(0x7f1ae0093d80 msgr2=0x7f1ae0090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/3830053765 shutdown_connections 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/3830053765 wait complete. 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: build_initial_monmap 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: monmap: 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 Processor -- start 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- start start 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: init 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ae0091c70 0x7f1ae01504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-b con 0x7f1ae0091c70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:49.508 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-c con 0x7f1ae013f1b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): picked mon.noname-a con 0x7f1ae013fce0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae01a4270 con 0x7f1ae013fce0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae01a43f0 con 0x7f1ae0091c70 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae01a4570 con 0x7f1ae013f1b0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient(hunting): authenticate will time out at 1001.975007s 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53780/0 (socket says 10.20.193.7:53780) 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60780/0 (socket says 10.20.193.7:60780) 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 -- 10.20.193.7:0/2276034631 learned_addr learned my addr 10.20.193.7:0/2276034631 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 10 monclient(hunting): get_auth_request con 0x7f1ae013f1b0 auth_method 0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): get_auth_request con 0x7f1ae013fce0 auth_method 0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ae0091c70 0x7f1ae01504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:49.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request con 0x7f1ae0091c70 auth_method 0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 msgr2=0x7f1ae0150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 msgr2=0x7f1ae0150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae529b640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient(hunting): handle_auth_done global_id 94932 payload 824 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 msgr2=0x7f1ae0150a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae013f1b0 0x7f1ae0150a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ae0091c70 msgr2=0x7f1ae01504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ae0091c70 0x7f1ae01504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient: _finish_hunting 0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 monclient: found mon.noname-a 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae012c3f0 con 0x7f1ae013fce0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae629d640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1adc019400 tx=0x7f1adc019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0b2040 con 0x7f1ae013fce0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: dump: 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.510 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1adc003c90 con 0x7f1ae013fce0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 5 monclient: authenticate success, global_id 94932 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc004240 con 0x7f1ae013fce0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _renew_subs 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1acffff640 4 set_mon_vals no callback set 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae013d8e0 con 0x7f1ae013fce0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ace7fc640 10 monclient: dump: 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:49.511 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _renew_subs 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae012deb0 con 0x7f1ae013fce0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.496+0000 7f1ae7d27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae0091790 con 0x7f1ae012af40 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012af40 auth_method 0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1adc0b5070 con 0x7f1ae013fce0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ace7fc640 1 --2- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 0x7f1ab005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(265..265 src has 64..265) ==== 3503+0+0 (secure 0 0 0) 0x7f1adc0e8e00 con 0x7f1ae013fce0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae529b640 1 --2- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 0x7f1ab005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae529b640 10 monclient: get_auth_request con 0x7f1ab003ab20 auth_method 0 2026-02-22T20:59:49.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.500+0000 7f1ae529b640 1 --2- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 0x7f1ab005afd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4002770 tx=0x7f1ad4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:49.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:49.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012af40 auth_method 0 2026-02-22T20:59:49.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:49.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:49.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:49.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:49.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:49.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:49.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:49.704+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012af40 auth_method 0 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:50.110 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.108+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012af40 auth_method 0 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:50.916 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:50.912+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: starting. 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22355 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: created object 0... 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: created object 25... 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: created object 49... 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: finishing. 2026-02-22T20:59:51.479 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22356]: shutting down. 2026-02-22T20:59:51.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:51.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:52.366 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22357]: starting. 2026-02-22T20:59:52.367 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22357]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22355 2026-02-22T20:59:52.367 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22357]: shutting down. 2026-02-22T20:59:52.502 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.500+0000 7f1acd7fa640 10 monclient: tick 2026-02-22T20:59:52.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.500+0000 7f1acd7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:59:52.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.500+0000 7f1acd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:52.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.500+0000 7f1acd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012af40 auth_method 0 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T20:59:52.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:52.516+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 10 monclient: tick 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 10 monclient: _check_auth_tickets 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 0x7f1aa8023ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 msgr2=0x7f1ae012b310 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012af40 0x7f1ae012b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1acd7fa640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa8024170 con 0x7f1aa8003640 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 0x7f1aa8023ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1aa8003640 auth_method 0 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_done global_id 124100 payload 824 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1aa8024320 con 0x7f1aa8003640 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 0x7f1aa8023ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0019a00 tx=0x7f1ad0019ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0027070 con 0x7f1aa8003640 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 10 monclient: dump: 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f1ad0017ce0 con 0x7f1aa8003640 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 msgr2=0x7f1aa8023ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 0x7f1aa8023ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0019a00 tx=0x7f1ad0019ec0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 msgr2=0x7f1aa8023ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:53.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.500+0000 7f1ace7fc640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1aa8003640 0x7f1aa8023ac0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0019a00 tx=0x7f1ad0019ec0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:53.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 0x7f1ae00876b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae0092890 con 0x7f1ae012b850 2026-02-22T20:59:53.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 0x7f1ae00876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient: get_auth_request con 0x7f1ae012b850 auth_method 0 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 10 monclient(hunting): handle_auth_done global_id 124103 payload 824 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 1 -- 10.20.193.7:0/2276034631 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ae012e290 con 0x7f1ae012b850 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae5a9c640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 0x7f1ae00876b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0021000 tx=0x7f1ad0004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0027070 con 0x7f1ae012b850 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 10 monclient: dump: 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.510 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7f1ad0028040 con 0x7f1ae012b850 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 msgr2=0x7f1ae00876b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 0x7f1ae00876b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0021000 tx=0x7f1ad0004820 comp rx=0 tx=0).stop 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 msgr2=0x7f1ae00876b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ace7fc640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ae012b850 0x7f1ae00876b0 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0021000 tx=0x7f1ad0004820 comp rx=0 tx=0).stop 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae629d640 1 -- 10.20.193.7:0/2276034631 reap_dead start 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 10699, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 5, 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:53.511 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.512 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:53.513 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.514 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:53.515 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.516 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:53.517 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 msgr2=0x7f1ab005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 0x7f1ab005afd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4002770 tx=0x7f1ad4007d30 comp rx=0 tx=0).stop 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 10 monclient: shutdown 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 msgr2=0x7f1ae012aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1adc019400 tx=0x7f1adc019590 comp rx=0 tx=0).stop 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 shutdown_connections 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ae013fce0 0x7f1ae012aa00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 --2- 10.20.193.7:0/2276034631 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ab003ab20 0x7f1ab005afd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 >> 10.20.193.7:0/2276034631 conn(0x7f1ae0093d80 msgr2=0x7f1ae0056980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 shutdown_connections 2026-02-22T20:59:53.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.504+0000 7f1ae7d27640 1 -- 10.20.193.7:0/2276034631 wait complete. 2026-02-22T20:59:53.525 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:53.525 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:59:53.525 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.584+0000 7fd38034c640 10 monclient: get_monmap_and_config 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.584+0000 7fd38034c640 10 monclient: build_initial_monmap 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.584+0000 7fd38034c640 10 monclient: monmap: 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:53.591428+0000 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:53.591428+0000 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:53.591 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:53.592 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 Processor -- start 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- start start 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient: init 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd37813f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-a con 0x7fd37813fd70 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd378180d00 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37808fd70 con 0x7fd37813f290 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd378092bc0 con 0x7fd378180d00 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd37808e1f0 con 0x7fd37813fd70 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient(hunting): authenticate will time out at 1006.064638s 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37e0c1640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd37813f290 0x7fd37813f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:45288/0 (socket says 10.20.193.7:45288) 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37e0c1640 1 -- 10.20.193.7:0/1986337932 learned_addr learned my addr 10.20.193.7:0/1986337932 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request con 0x7fd37813fd70 auth_method 0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_done global_id 94950 payload 274 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 -- 10.20.193.7:0/1986337932 >> v1:10.20.193.61:6789/0 conn(0x7fd378180d00 legacy=0x7fd3781a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 -- 10.20.193.7:0/1986337932 >> v1:10.20.193.7:6789/0 conn(0x7fd37813f290 legacy=0x7fd37813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient: _finish_hunting 0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 monclient: found mon.noname-a 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 1 -- 10.20.193.7:0/1986337932 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486479562 0 0) 0x7fd368002920 con 0x7fd37813f290 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 -- 10.20.193.7:0/1986337932 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37808e6d0 con 0x7fd37813fd70 2026-02-22T20:59:53.593 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d8c0640 1 --2- 10.20.193.7:0/1986337932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd36c004780 tx=0x7fd36c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b97fe8ec1d367 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 1 -- 10.20.193.7:0/1986337932 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b1070 con 0x7fd37813fd70 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: dump: 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.594 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: _finish_auth 0 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: _check_auth_tickets 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 1 -- 10.20.193.7:0/1986337932 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c0a8050 con 0x7fd37813fd70 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 1 -- 10.20.193.7:0/1986337932 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0ac860 con 0x7fd37813fd70 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 5 monclient: authenticate success, global_id 94950 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 4 set_mon_vals no callback set 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd37d0bf640 10 monclient: dump: 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.595 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 10 monclient: shutdown 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- 10.20.193.7:0/1986337932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 msgr2=0x7fd3781807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 --2- 10.20.193.7:0/1986337932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd36c004780 tx=0x7fd36c01c4d0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- 10.20.193.7:0/1986337932 shutdown_connections 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 --2- 10.20.193.7:0/1986337932 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- 10.20.193.7:0/1986337932 >> 10.20.193.7:0/1986337932 conn(0x7fd378093df0 msgr2=0x7fd3780902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- 10.20.193.7:0/1986337932 shutdown_connections 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.588+0000 7fd38034c640 1 -- 10.20.193.7:0/1986337932 wait complete. 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: build_initial_monmap 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: monmap: 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 Processor -- start 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- start start 2026-02-22T20:59:53.596 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: init 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-c con 0x7fd37813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-a con 0x7fd37813fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd378180d00 0x7fd3781888e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): picked mon.noname-b con 0x7fd378180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:53.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3781a5870 con 0x7fd37813fd70 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd3781a56f0 con 0x7fd378180d00 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd3781a59f0 con 0x7fd37813f290 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): authenticate will time out at 1006.068809s 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53888/0 (socket says 10.20.193.7:53888) 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 -- 10.20.193.7:0/3930453501 learned_addr learned my addr 10.20.193.7:0/3930453501 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): get_auth_request con 0x7fd37813f290 auth_method 0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request con 0x7fd37813fd70 auth_method 0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd378180d00 0x7fd3781888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 10 monclient(hunting): get_auth_request con 0x7fd378180d00 auth_method 0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient(hunting): handle_auth_done global_id 124106 payload 824 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd378180d00 msgr2=0x7fd3781888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd378180d00 0x7fd3781888e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 msgr2=0x7fd3781807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd37813fd70 0x7fd3781807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient: _finish_hunting 0 2026-02-22T20:59:53.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 monclient: found mon.noname-c 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd378056d70 con 0x7fd37813f290 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e0c1640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c700 tx=0x7fd36800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368018070 con 0x7fd37813f290 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: dump: 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: _finish_auth 0 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd368004ae0 con 0x7fd37813f290 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3680070d0 con 0x7fd37813f290 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: dump: 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.600 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37c8be640 4 set_mon_vals no callback set 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 5 monclient: authenticate success, global_id 124106 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _renew_subs 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37819da80 con 0x7fd37813f290 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _renew_subs 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37819e320 con 0x7fd37813f290 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 0x7fd37804ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd37813f660 con 0x7fd37819ec90 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd368007270 con 0x7fd37813f290 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 0x7fd37804ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient: get_auth_request con 0x7fd37819ec90 auth_method 0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 --2- 10.20.193.7:0/3930453501 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(269..269 src has 64..269) ==== 3897+0+0 (secure 0 0 0) 0x7fd36804dc10 con 0x7fd37813f290 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_done global_id 114412 payload 824 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd37819de60 con 0x7fd37819ec90 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 1 --2- 10.20.193.7:0/3930453501 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 10 monclient: get_auth_request con 0x7fd34803ab20 auth_method 0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37d8c0640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 0x7fd37804ca80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01ab80 tx=0x7fd36c019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b9070 con 0x7fd37819ec90 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: dump: 2026-02-22T20:59:53.601 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fd36c0a8040 con 0x7fd37819ec90 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 msgr2=0x7fd37804ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 0x7fd37804ca80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01ab80 tx=0x7fd36c019270 comp rx=0 tx=0).stop 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 msgr2=0x7fd37804ca80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd35effd640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819ec90 0x7fd37804ca80 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01ab80 tx=0x7fd36c019270 comp rx=0 tx=0).stop 2026-02-22T20:59:53.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.592+0000 7fd37e8c2640 1 --2- 10.20.193.7:0/3930453501 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd374003b30 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 0x7fd37808b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd37819cb20 con 0x7fd37819b860 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 0x7fd37808b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient: get_auth_request con 0x7fd37819b860 auth_method 0 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 10 monclient(hunting): handle_auth_done global_id 114415 payload 824 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 1 -- 10.20.193.7:0/3930453501 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd37808c780 con 0x7fd37819b860 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37d8c0640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 0x7fd37808b0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01a100 tx=0x7fd36c0a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b9040 con 0x7fd37819b860 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 10 monclient: dump: 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.603 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5047 (secure 0 0 0) 0x7fd36c0be450 con 0x7fd37819b860 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 msgr2=0x7fd37808b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 0x7fd37808b0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01a100 tx=0x7fd36c0a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 msgr2=0x7fd37808b0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd35effd640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd37819b860 0x7fd37808b0c0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01a100 tx=0x7fd36c0a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 54783, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 5, 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.604 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:53.605 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.606 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.607 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: "num": 8 2026-02-22T20:59:53.608 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 msgr2=0x7fd34805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 --2- 10.20.193.7:0/3930453501 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd34803ab20 0x7fd34805afd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd374003b30 tx=0x7fd374009040 comp rx=0 tx=0).stop 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 10 monclient: shutdown 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 msgr2=0x7fd3781883a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c700 tx=0x7fd36800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd37e8c2640 1 -- 10.20.193.7:0/3930453501 reap_dead start 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 shutdown_connections 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 --2- 10.20.193.7:0/3930453501 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd37813f290 0x7fd3781883a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 >> 10.20.193.7:0/3930453501 conn(0x7fd378093df0 msgr2=0x7fd37813d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:53.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 shutdown_connections 2026-02-22T20:59:53.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.596+0000 7fd38034c640 1 -- 10.20.193.7:0/3930453501 wait complete. 2026-02-22T20:59:53.611 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:53.611 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T20:59:53.611 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: get_monmap_and_config 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: build_initial_monmap 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: monmap: 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:53.672564+0000 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:53.672564+0000 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.672 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 Processor -- start 2026-02-22T20:59:53.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 -- start start 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: init 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1f9c090880 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 0x7f1f9c180ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-b con 0x7f1f9c1606d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1f9c180ff0 0x7f1f9c1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-c con 0x7f1f9c180ff0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c08dd90 con 0x7f1f9c090880 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c08c730 con 0x7f1f9c180ff0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c08d7d0 con 0x7f1f9c1606d0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient(hunting): authenticate will time out at 1006.145424s 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9a575640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1f9c090880 0x7f1f9c090c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:45304/0 (socket says 10.20.193.7:45304) 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9a575640 1 -- 10.20.193.7:0/1972591014 learned_addr learned my addr 10.20.193.7:0/1972591014 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 --2- 10.20.193.7:0/1972591014 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 0x7f1f9c180ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): get_auth_request con 0x7f1f9c1606d0 auth_method 0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9ad76640 1 --2- 10.20.193.7:0/1972591014 >> v2:10.20.193.61:3300/0 conn(0x7f1f9c180ff0 0x7f1f9c1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9ad76640 10 monclient(hunting): get_auth_request con 0x7f1f9c180ff0 auth_method 0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 1 -- 10.20.193.7:0/1972591014 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636848460 0 0) 0x7f1f9c08dd90 con 0x7f1f9c090880 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient(hunting): handle_auth_done global_id 124109 payload 274 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 -- 10.20.193.7:0/1972591014 >> v2:10.20.193.61:3300/0 conn(0x7f1f9c180ff0 msgr2=0x7f1f9c1a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 --2- 10.20.193.7:0/1972591014 >> v2:10.20.193.61:3300/0 conn(0x7f1f9c180ff0 0x7f1f9c1a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 -- 10.20.193.7:0/1972591014 >> v1:10.20.193.7:6789/0 conn(0x7f1f9c090880 legacy=0x7f1f9c090c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient: _finish_hunting 0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 monclient: found mon.noname-b 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 -- 10.20.193.7:0/1972591014 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c08dab0 con 0x7f1f9c1606d0 2026-02-22T20:59:53.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99d74640 1 --2- 10.20.193.7:0/1972591014 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 0x7f1f9c180ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c091440 tx=0x7f1f8401c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ef6729f10113d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 1 -- 10.20.193.7:0/1972591014 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840b1070 con 0x7f1f9c1606d0 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: dump: 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: _finish_auth 0 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: _check_auth_tickets 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 1 -- 10.20.193.7:0/1972591014 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840a4840 con 0x7f1f9c1606d0 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:53.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 1 -- 10.20.193.7:0/1972591014 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a4c10 con 0x7f1f9c1606d0 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 5 monclient: authenticate success, global_id 124109 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f9b577640 4 set_mon_vals no callback set 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.668+0000 7f1f99573640 10 monclient: dump: 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: shutdown 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/1972591014 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 msgr2=0x7f1f9c180ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- 10.20.193.7:0/1972591014 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 0x7f1f9c180ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c091440 tx=0x7f1f8401c100 comp rx=0 tx=0).stop 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/1972591014 shutdown_connections 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- 10.20.193.7:0/1972591014 >> v2:10.20.193.61:3300/0 conn(0x7f1f9c180ff0 0x7f1f9c1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- 10.20.193.7:0/1972591014 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c1606d0 0x7f1f9c180ab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/1972591014 >> 10.20.193.7:0/1972591014 conn(0x7f1f9c08e050 msgr2=0x7f1f9c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/1972591014 shutdown_connections 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/1972591014 wait complete. 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: build_initial_monmap 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: monmap: 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 Processor -- start 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- start start 2026-02-22T20:59:53.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: init 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-c con 0x7f1f9c090880 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 0x7f1f9c07b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-b con 0x7f1f9c1606d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f9c180ff0 0x7f1f9c07be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): picked mon.noname-a con 0x7f1f9c180ff0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c1a4e90 con 0x7f1f9c180ff0 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c1a4d10 con 0x7f1f9c1606d0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c1a5010 con 0x7f1f9c090880 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient(hunting): authenticate will time out at 1006.149431s 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53902/0 (socket says 10.20.193.7:53902) 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 -- 10.20.193.7:0/2536793785 learned_addr learned my addr 10.20.193.7:0/2536793785 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): get_auth_request con 0x7f1f9c090880 auth_method 0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9ad76640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f9c180ff0 0x7f1f9c07be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9ad76640 10 monclient(hunting): get_auth_request con 0x7f1f9c180ff0 auth_method 0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9ad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 0x7f1f9c07b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient(hunting): handle_auth_done global_id 124112 payload 824 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 -- 10.20.193.7:0/2536793785 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 msgr2=0x7f1f9c07b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 0x7f1f9c07b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 -- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f9c180ff0 msgr2=0x7f1f9c07be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f9c180ff0 0x7f1f9c07be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient: _finish_hunting 0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 monclient: found mon.noname-c 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 -- 10.20.193.7:0/2536793785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c07e9a0 con 0x7f1f9c090880 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 10 monclient: get_auth_request con 0x7f1f9c1606d0 auth_method 0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 0x7f1f9c07b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9a575640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f900036c0 tx=0x7f1f9000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90018070 con 0x7f1f9c090880 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: dump: 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.679 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90004cf0 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f900072d0 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 5 monclient: authenticate success, global_id 124112 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _renew_subs 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c08a190 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f98d72640 4 set_mon_vals no callback set 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 10 monclient: dump: 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _renew_subs 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c088740 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c090c50 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1f90007470 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 --2- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 0x7f1f6805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(269..269 src has 64..269) ==== 3897+0+0 (secure 0 0 0) 0x7f1f9004e050 con 0x7f1f9c090880 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 1 --2- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 0x7f1f6805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:53.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 10 monclient: get_auth_request con 0x7f1f6803ab20 auth_method 0 2026-02-22T20:59:53.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.672+0000 7f1f99d74640 1 --2- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 0x7f1f6805afd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1f840095c0 tx=0x7f1f840a6070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:53.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.676+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1f900090e0 con 0x7f1f9c090880 2026-02-22T20:59:53.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.676+0000 7f1f82ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:53.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.676+0000 7f1f82ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:53.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.784+0000 7f1f9b577640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T20:59:53.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.784+0000 7f1f9b577640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T20:59:53.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.784+0000 7f1f9b577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:53.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.784+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f1f9c05fb90 con 0x7f1f9c090880 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=4175745806,config=3140514009,health=1068221574,kv=3991984195,logm=818740768}) 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=1,health=13,kv=10,logm=57} crc {auth=4175745806,config=1228700967,health=3811746669,kv=3991984195,logm=628784021}) 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=4175745806,config=3140514009,health=1068221574,kv=3991984195,logm=818740768}) 2026-02-22T20:59:53.792 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=13,kv=9,logm=57} crc {auth=4175745806,config=3140514009,health=2431850529,kv=2132859567,logm=2470444526}) 2026-02-22T20:59:53.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f82ffd640 1 -- 10.20.193.7:0/2536793785 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f1f90005cf0 con 0x7f1f9c090880 2026-02-22T20:59:53.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f82ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T20:59:53.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f82ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3665526352}) 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=615606957}) 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3665526352}) 2026-02-22T20:59:53.793 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4202918985}) 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 msgr2=0x7f1f6805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 0x7f1f6805afd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1f840095c0 tx=0x7f1f840a6070 comp rx=0 tx=0).stop 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 10 monclient: shutdown 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 msgr2=0x7f1f9c05d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f900036c0 tx=0x7f1f9000c9e0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 shutdown_connections 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1f9c180ff0 0x7f1f9c07be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1f6803ab20 0x7f1f6805afd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1f9c1606d0 0x7f1f9c07b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 --2- 10.20.193.7:0/2536793785 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1f9c090880 0x7f1f9c05d550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:53.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 >> 10.20.193.7:0/2536793785 conn(0x7f1f9c08e050 msgr2=0x7f1f9c088950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:53.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 shutdown_connections 2026-02-22T20:59:53.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:53.788+0000 7f1f9b577640 1 -- 10.20.193.7:0/2536793785 wait complete. 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3570578263}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=798240290}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3570578263}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2384501175}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=563903945}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1497358917}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=563903945}) 2026-02-22T20:59:53.794 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3033348162}) 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1276123450}) 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=268239125}) 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1276123450}) 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.788+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3799863309}) 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.795 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000493768}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=624056748}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1000493768}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1081290295}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539799009}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3242817204}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539799009}) 2026-02-22T20:59:53.796 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3211687114}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1978086522}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1633667525}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1978086522}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=918196673}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3899922812}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=238706737}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3899922812}) 2026-02-22T20:59:53.797 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=734086399}) 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488791622}) 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3281381128}) 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488791622}) 2026-02-22T20:59:53.798 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1075073031}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343889539}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2693565794}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343889539}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.792+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=703929332}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=612456105}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1929073674}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=612456105}) 2026-02-22T20:59:53.799 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1866252510}) 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3932589077}) 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2102402282}) 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3932589077}) 2026-02-22T20:59:53.800 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2326392792}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885854879}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=753510771}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885854879}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1022932784}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=496011754}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2340841949}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=496011754}) 2026-02-22T20:59:53.801 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2790992940}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1259318934}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3552166750}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1259318934}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3216136083}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186132283}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2065755098}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3186132283}) 2026-02-22T20:59:53.802 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1320031071}) 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1337392272}) 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1702921884}) 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1337392272}) 2026-02-22T20:59:53.803 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.796+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3730357209}) 2026-02-22T20:59:53.803 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1154357943}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3979080902}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1154357943}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3271348425}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3620086803}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3550387834}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3620086803}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=427544994}) 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.804 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=322531273}) 2026-02-22T20:59:53.805 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2613622200}) 2026-02-22T20:59:53.805 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.805 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=322531273}) 2026-02-22T20:59:53.805 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=585692004}) 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=42,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=15} crc {logm=2104789959,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3825617946,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=3811572184,osd_snap=4133920409,osdmap=3170306973}) 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=41,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=20} crc {logm=3338670204,mdsmap=3140514009,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=2300258189,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=935146538,osd_metadata=1441135785,osd_pg_creating=3811572184,osd_snap=1914091868,osdmap=153370994}) 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=42,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=15} crc {logm=2104789959,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3825617946,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=3811572184,osd_snap=4133920409,osdmap=3170306973}) 2026-02-22T20:59:53.806 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=42,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=18} crc {logm=2917104363,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=733609665,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=1149718058,osd_pg_creating=3811572184,osd_snap=4133920409,osdmap=2914641756}) 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1549820856}) 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=630057511}) 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1549820856}) 2026-02-22T20:59:53.807 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.800+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3301164201}) 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=824446600}) 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1752751496}) 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=824446600}) 2026-02-22T20:59:53.808 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.804+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3886447408}) 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=94} crc {osdmap=1483216290}) 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=96} crc {osdmap=2419898694}) 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=94} crc {osdmap=1483216290}) 2026-02-22T20:59:53.813 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T20:59:53.808+0000 7f4c158ad640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=95} crc {osdmap=3189734367}) 2026-02-22T20:59:54.804 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T20:59:54.804 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: get_monmap_and_config 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: build_initial_monmap 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: monmap: 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:54.865334+0000 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:54.865334+0000 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:54.865 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 Processor -- start 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 -- start start 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: init 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 0x7f1ef413f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-b con 0x7f1ef4092c20 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ef413f7d0 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1ef413fc00 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef413cd90 con 0x7f1ef413f7d0 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef4056c10 con 0x7f1ef413fc00 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef4140080 con 0x7f1ef4092c20 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient(hunting): authenticate will time out at 1007.338221s 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 0x7f1ef413f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:54.866 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1d74640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f1ef413f7d0 0x7f1ef413bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:45308/0 (socket says 10.20.193.7:45308) 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1d74640 1 -- 10.20.193.7:0/4041651222 learned_addr learned my addr 10.20.193.7:0/4041651222 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): get_auth_request con 0x7f1ef4092c20 auth_method 0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient(hunting): handle_auth_done global_id 124115 payload 274 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 -- 10.20.193.7:0/4041651222 >> v1:10.20.193.61:6789/0 conn(0x7f1ef413fc00 legacy=0x7f1ef413c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 1 -- 10.20.193.7:0/4041651222 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118124671 0 0) 0x7f1ef413cd90 con 0x7f1ef413f7d0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 -- 10.20.193.7:0/4041651222 >> v1:10.20.193.7:6789/0 conn(0x7f1ef413f7d0 legacy=0x7f1ef413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient: _finish_hunting 0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 monclient: found mon.noname-b 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 -- 10.20.193.7:0/4041651222 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef40919a0 con 0x7f1ef4092c20 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef2575640 1 --2- 10.20.193.7:0/4041651222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 0x7f1ef413f290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009840 tx=0x7f1ee801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa2f1e086e176bd server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 1 -- 10.20.193.7:0/4041651222 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80ab430 con 0x7f1ef4092c20 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: dump: 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:54.867 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: _finish_auth 0 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: _check_auth_tickets 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 1 -- 10.20.193.7:0/4041651222 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80b0070 con 0x7f1ef4092c20 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 1 -- 10.20.193.7:0/4041651222 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80ab7f0 con 0x7f1ef4092c20 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 5 monclient: authenticate success, global_id 124115 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef3577640 4 set_mon_vals no callback set 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.860+0000 7f1ef1573640 10 monclient: dump: 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:54.868 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: shutdown 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/4041651222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 msgr2=0x7f1ef413f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 --2- 10.20.193.7:0/4041651222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 0x7f1ef413f290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009840 tx=0x7f1ee801c430 comp rx=0 tx=0).stop 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/4041651222 shutdown_connections 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 --2- 10.20.193.7:0/4041651222 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef4092c20 0x7f1ef413f290 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/4041651222 >> 10.20.193.7:0/4041651222 conn(0x7f1ef40906f0 msgr2=0x7f1ef4090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/4041651222 shutdown_connections 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/4041651222 wait complete. 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: build_initial_monmap 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: monmap: 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 Processor -- start 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- start start 2026-02-22T20:59:54.869 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: init 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ef4092c20 0x7f1ef414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-a con 0x7f1ef4092c20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-c con 0x7f1ef413f7d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:54.870 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ef413fc00 0x7f1ef412a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): picked mon.noname-b con 0x7f1ef413fc00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef413dd70 con 0x7f1ef4092c20 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef41a55a0 con 0x7f1ef413fc00 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef41a5420 con 0x7f1ef413f7d0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient(hunting): authenticate will time out at 1007.341720s 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ef4092c20 0x7f1ef414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53910/0 (socket says 10.20.193.7:53910) 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 -- 10.20.193.7:0/1047115661 learned_addr learned my addr 10.20.193.7:0/1047115661 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): get_auth_request con 0x7f1ef413f7d0 auth_method 0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): get_auth_request con 0x7f1ef4092c20 auth_method 0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2d76640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ef413fc00 0x7f1ef412a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2d76640 10 monclient(hunting): get_auth_request con 0x7f1ef413fc00 auth_method 0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient(hunting): handle_auth_done global_id 124118 payload 824 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 -- 10.20.193.7:0/1047115661 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ef413fc00 msgr2=0x7f1ef412a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ef413fc00 0x7f1ef412a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 -- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ef4092c20 msgr2=0x7f1ef414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ef4092c20 0x7f1ef414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient: _finish_hunting 0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 monclient: found mon.noname-c 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.871 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 -- 10.20.193.7:0/1047115661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef408fa00 con 0x7f1ef413f7d0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef1d74640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c4d0 tx=0x7f1edc00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc018070 con 0x7f1ef413f7d0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: dump: 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc004cf0 con 0x7f1ef413f7d0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc007310 con 0x7f1ef413f7d0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 5 monclient: authenticate success, global_id 124118 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _renew_subs 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef412da30 con 0x7f1ef413f7d0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef0d72640 4 set_mon_vals no callback set 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 10 monclient: dump: 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _renew_subs 2026-02-22T20:59:54.872 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef4150b40 con 0x7f1ef413f7d0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef412d810 con 0x7f1ef413f7d0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1edc0074b0 con 0x7f1ef413f7d0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 --2- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 0x7f1ec005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7f1edc04de50 con 0x7f1ef413f7d0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 1 --2- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 0x7f1ec005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.864+0000 7f1ef2575640 10 monclient: get_auth_request con 0x7f1ec003ab20 auth_method 0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.868+0000 7f1ef2575640 1 --2- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 0x7f1ec005afd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1ee801c470 tx=0x7f1ee80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.868+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1ef408fa00 con 0x7f1ef413f7d0 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.868+0000 7f1edaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:54.873 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.868+0000 7f1edaffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1ef413ccf0 con 0x7f1ef413f7d0 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1edaffd640 1 -- 10.20.193.7:0/1047115661 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f1edc005cf0 con 0x7f1ef413f7d0 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1edaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:54.985 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1edaffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 msgr2=0x7f1ec005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 0x7f1ec005afd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1ee801c470 tx=0x7f1ee80a7000 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 10 monclient: shutdown 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 msgr2=0x7f1ef413c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c4d0 tx=0x7f1edc00c990 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 shutdown_connections 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1ec003ab20 0x7f1ec005afd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1ef413fc00 0x7f1ef412a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1ef413f7d0 0x7f1ef413c310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 --2- 10.20.193.7:0/1047115661 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1ef4092c20 0x7f1ef414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 >> 10.20.193.7:0/1047115661 conn(0x7f1ef40906f0 msgr2=0x7f1ef408e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 shutdown_connections 2026-02-22T20:59:54.986 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:54.980+0000 7f1ef3577640 1 -- 10.20.193.7:0/1047115661 wait complete. 2026-02-22T20:59:54.995 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T20:59:54.995 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-22T20:59:54.995 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T20:59:54.996 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: get_monmap_and_config 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: monmap: 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:55.058075+0000 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:55.058075+0000 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 Processor -- start 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 -- start start 2026-02-22T20:59:55.058 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: init 2026-02-22T20:59:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2026-02-22T20:59:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1d8808b590 0x7f1d88139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-c con 0x7f1d8808b590 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d8813a4d0 0x7f1d8813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-a con 0x7f1d8813a4d0 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1d8813d530 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d88089920 con 0x7f1d8813d530 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8808ab40 con 0x7f1d8813a4d0 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8808a860 con 0x7f1d8808b590 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d8e1c9640 10 monclient(hunting): authenticate will time out at 1007.531475s 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d8813a4d0 0x7f1d8813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f1d8813a4d0 0x7f1d8813cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60824/0 (socket says 10.20.193.7:60824) 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 -- 10.20.193.7:0/690232194 learned_addr learned my addr 10.20.193.7:0/690232194 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): get_auth_request con 0x7f1d8813a4d0 auth_method 0 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 1 --2- 10.20.193.7:0/690232194 >> v2:10.20.193.61:3300/0 conn(0x7f1d8808b590 0x7f1d88139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): get_auth_request con 0x7f1d8808b590 auth_method 0 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_done global_id 94971 payload 274 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 -- 10.20.193.7:0/690232194 >> v2:10.20.193.61:3300/0 conn(0x7f1d8808b590 msgr2=0x7f1d88139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 --2- 10.20.193.7:0/690232194 >> v2:10.20.193.61:3300/0 conn(0x7f1d8808b590 0x7f1d88139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 -- 10.20.193.7:0/690232194 >> v1:10.20.193.61:6789/0 conn(0x7f1d8813d530 legacy=0x7f1d8819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 monclient: found mon.noname-a 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:55.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.052+0000 7f1d86ffd640 1 -- 10.20.193.7:0/690232194 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d88089170 con 0x7f1d8813a4d0 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- 10.20.193.7:0/690232194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d8813cff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d780090a0 tx=0x7f1d7801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f6b88b71c39f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 1 -- 10.20.193.7:0/690232194 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d780ab600 con 0x7f1d8813a4d0 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: dump: 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.072 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 1 -- 10.20.193.7:0/690232194 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d780b0070 con 0x7f1d8813a4d0 2026-02-22T20:59:55.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 1 -- 10.20.193.7:0/690232194 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d780ab9c0 con 0x7f1d8813a4d0 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 5 monclient: authenticate success, global_id 94971 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 4 set_mon_vals no callback set 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d867fc640 10 monclient: dump: 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.074 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: shutdown 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/690232194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 msgr2=0x7f1d8813cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/690232194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d8813cff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d780090a0 tx=0x7f1d7801c550 comp rx=0 tx=0).stop 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/690232194 shutdown_connections 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/690232194 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d8813cff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/690232194 >> v2:10.20.193.61:3300/0 conn(0x7f1d8808b590 0x7f1d88139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/690232194 >> 10.20.193.7:0/690232194 conn(0x7f1d8808faa0 msgr2=0x7f1d8808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/690232194 shutdown_connections 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/690232194 wait complete. 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: monmap: 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.076 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 Processor -- start 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- start start 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: init 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d8808b590 0x7f1d8814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-b con 0x7f1d8808b590 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d88138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-a con 0x7f1d8813a4d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d8813d530 0x7f1d881392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): picked mon.noname-c con 0x7f1d8813d530 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881a2440 con 0x7f1d8813a4d0 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1d881a22c0 con 0x7f1d8808b590 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1d881a25c0 con 0x7f1d8813d530 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): authenticate will time out at 1007.535058s 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d88138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d88138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:60826/0 (socket says 10.20.193.7:60826) 2026-02-22T20:59:55.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 -- 10.20.193.7:0/3920325979 learned_addr learned my addr 10.20.193.7:0/3920325979 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): get_auth_request con 0x7f1d8813a4d0 auth_method 0 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d8813d530 0x7f1d881392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): get_auth_request con 0x7f1d8813d530 auth_method 0 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d877fe640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d8808b590 0x7f1d8814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d877fe640 10 monclient(hunting): get_auth_request con 0x7f1d8808b590 auth_method 0 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient(hunting): handle_auth_done global_id 94974 payload 824 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d8813d530 msgr2=0x7f1d881392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1d8813d530 0x7f1d881392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d8808b590 msgr2=0x7f1d8814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1d8808b590 0x7f1d8814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 monclient: found mon.noname-a 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d88129440 con 0x7f1d8813a4d0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d86ffd640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d88138d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1d78002410 tx=0x7f1d7801ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78004230 con 0x7f1d8813a4d0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:55.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: dump: 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d780043d0 con 0x7f1d8813a4d0 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78003710 con 0x7f1d8813a4d0 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d63fff640 10 monclient: dump: 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.083 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 5 monclient: authenticate success, global_id 94974 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d85ffb640 4 set_mon_vals no callback set 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _renew_subs 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8813cf60 con 0x7f1d8813a4d0 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _renew_subs 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T20:59:55.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d88139810 con 0x7f1d8813a4d0 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 0x7f1d88058e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.056+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880382a0 con 0x7f1d88128190 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 0x7f1d88058e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient: get_auth_request con 0x7f1d88128190 auth_method 0 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1d780038b0 con 0x7f1d8813a4d0 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_done global_id 94977 payload 824 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d88139f90 con 0x7f1d88128190 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 --2- 10.20.193.7:0/3920325979 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d5803ab20 0x7f1d5805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7f1d780e8ff0 con 0x7f1d8813a4d0 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 0x7f1d88058e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004780 tx=0x7f1d74011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400fa30 con 0x7f1d88128190 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:55.086 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 10 monclient: dump: 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d87fff640 1 --2- 10.20.193.7:0/3920325979 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d5803ab20 0x7f1d5805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d87fff640 10 monclient: get_auth_request con 0x7f1d5803ab20 auth_method 0 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f1d7400fa30 con 0x7f1d88128190 2026-02-22T20:59:55.087 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 msgr2=0x7f1d88058e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 0x7f1d88058e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004780 tx=0x7f1d74011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 msgr2=0x7f1d88058e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d63fff640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128190 0x7f1d88058e50 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004780 tx=0x7f1d74011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d87fff640 1 --2- 10.20.193.7:0/3920325979 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d5803ab20 0x7f1d5805afd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c003b30 tx=0x7f1d7c004270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d8e1c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 0x7f1d88059390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d8e1c9640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8805fc70 con 0x7f1d88128560 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 0x7f1d88059390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient: get_auth_request con 0x7f1d88128560 auth_method 0 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.060+0000 7f1d877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d877fe640 10 monclient(hunting): handle_auth_done global_id 94980 payload 824 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d877fe640 1 -- 10.20.193.7:0/3920325979 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d8812af00 con 0x7f1d88128560 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d877fe640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 0x7f1d88059390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d74019000 tx=0x7f1d740047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74022b20 con 0x7f1d88128560 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 10 monclient: dump: 2026-02-22T20:59:55.089 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f1d74026070 con 0x7f1d88128560 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:55.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 msgr2=0x7f1d88059390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 0x7f1d88059390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d74019000 tx=0x7f1d740047b0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 msgr2=0x7f1d88059390 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d63fff640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d88128560 0x7f1d88059390 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d74019000 tx=0x7f1d740047b0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:55.091 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 167749, 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 7, 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.092 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:55.093 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.094 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:55.095 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.096 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.097 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.098 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.099 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.100 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.101 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "num": 4 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:55.102 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:55.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d5803ab20 msgr2=0x7f1d5805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/3920325979 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1d5803ab20 0x7f1d5805afd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c003b30 tx=0x7f1d7c004270 comp rx=0 tx=0).stop 2026-02-22T20:59:55.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 10 monclient: shutdown 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 msgr2=0x7f1d88138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 --2- 10.20.193.7:0/3920325979 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1d8813a4d0 0x7f1d88138d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1d78002410 tx=0x7f1d7801ad90 comp rx=0 tx=0).stop 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d87fff640 1 -- 10.20.193.7:0/3920325979 reap_dead start 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d87fff640 1 -- 10.20.193.7:0/3920325979 reap_dead start 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 shutdown_connections 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 >> 10.20.193.7:0/3920325979 conn(0x7f1d8808faa0 msgr2=0x7f1d8813b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 shutdown_connections 2026-02-22T20:59:55.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.064+0000 7f1d8e1c9640 1 -- 10.20.193.7:0/3920325979 wait complete. 2026-02-22T20:59:55.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:55.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T20:59:55.104 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: starting. 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22355 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: created object 0... 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: created object 25... 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: created object 49... 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: finishing. 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22390]: shutting down. 2026-02-22T20:59:55.105 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: starting. 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: listing objects. 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: listed object 0... 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: listed object 25... 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: saw 50 objects 2026-02-22T20:59:55.106 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22392]: shutting down. 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: get_monmap_and_config 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: monmap: 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:55.174298+0000 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:55.174298+0000 2026-02-22T20:59:55.174 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:55.175 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 Processor -- start 2026-02-22T20:59:55.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 -- start start 2026-02-22T20:59:55.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: init 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient: _add_conns ranks=[1,2,4,3,0] 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcdc408b590 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 0x7fcdc417e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-b con 0x7fcdc413a6a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fcdc417e8b0 0x7fcdc419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-c con 0x7fcdc417e8b0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc4089920 con 0x7fcdc408b590 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fcdc413aad0 con 0x7fcdc417e8b0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc408ab40 con 0x7fcdc413a6a0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc961d640 10 monclient(hunting): authenticate will time out at 1007.647584s 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 0x7fcdc417e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc2ffd640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7fcdc408b590 0x7fcdc4139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:46038/0 (socket says 10.20.193.7:46038) 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request con 0x7fcdc413a6a0 auth_method 0 2026-02-22T20:59:55.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc2ffd640 1 -- 10.20.193.7:0/920918749 learned_addr learned my addr 10.20.193.7:0/920918749 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 1 --2- 10.20.193.7:0/920918749 >> v2:10.20.193.61:3300/0 conn(0x7fcdc417e8b0 0x7fcdc419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): get_auth_request con 0x7fcdc417e8b0 auth_method 0 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_done global_id 124124 payload 274 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 -- 10.20.193.7:0/920918749 >> v2:10.20.193.61:3300/0 conn(0x7fcdc417e8b0 msgr2=0x7fcdc419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/920918749 >> v2:10.20.193.61:3300/0 conn(0x7fcdc417e8b0 0x7fcdc419ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 -- 10.20.193.7:0/920918749 >> v1:10.20.193.61:6789/0 conn(0x7fcdc408b590 legacy=0x7fcdc4139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 monclient: found mon.noname-b 2026-02-22T20:59:55.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.168+0000 7fcdc27fc640 1 -- 10.20.193.7:0/920918749 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc408a860 con 0x7fcdc413a6a0 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/920918749 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 0x7fcdc417e370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009840 tx=0x7fcdac01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a013571a2b32548 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 1 -- 10.20.193.7:0/920918749 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0ab640 con 0x7fcdc413a6a0 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: dump: 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.183 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 1 -- 10.20.193.7:0/920918749 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac0b0070 con 0x7fcdc413a6a0 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 1 -- 10.20.193.7:0/920918749 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0aba00 con 0x7fcdc413a6a0 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 5 monclient: authenticate success, global_id 124124 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 4 set_mon_vals no callback set 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc1ffb640 10 monclient: dump: 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.184 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: shutdown 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- 10.20.193.7:0/920918749 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 msgr2=0x7fcdc417e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- 10.20.193.7:0/920918749 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 0x7fcdc417e370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009840 tx=0x7fcdac01c420 comp rx=0 tx=0).stop 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- 10.20.193.7:0/920918749 shutdown_connections 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- 10.20.193.7:0/920918749 >> v2:10.20.193.61:3300/0 conn(0x7fcdc417e8b0 0x7fcdc419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- 10.20.193.7:0/920918749 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc413a6a0 0x7fcdc417e370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- 10.20.193.7:0/920918749 >> 10.20.193.7:0/920918749 conn(0x7fcdc408faa0 msgr2=0x7fcdc408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- 10.20.193.7:0/920918749 shutdown_connections 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- 10.20.193.7:0/920918749 wait complete. 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: monmap: 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:55.185 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 Processor -- start 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- start start 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: init 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 0x7fcdc4193790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-c con 0x7fcdc408b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcdc413a6a0 0x7fcdc419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-b con 0x7fcdc413a6a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcdc417e8b0 0x7fcdc4138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): picked mon.noname-a con 0x7fcdc417e8b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc41a1e30 con 0x7fcdc417e8b0 2026-02-22T20:59:55.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc41a1cb0 con 0x7fcdc413a6a0 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc41a1fb0 con 0x7fcdc408b590 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc961d640 10 monclient(hunting): authenticate will time out at 1007.651680s 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 0x7fcdc4193790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 0x7fcdc4193790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53928/0 (socket says 10.20.193.7:53928) 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 -- 10.20.193.7:0/3131307120 learned_addr learned my addr 10.20.193.7:0/3131307120 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): get_auth_request con 0x7fcdc408b590 auth_method 0 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcdc417e8b0 0x7fcdc4138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): get_auth_request con 0x7fcdc417e8b0 auth_method 0 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcdc413a6a0 0x7fcdc419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request con 0x7fcdc413a6a0 auth_method 0 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient(hunting): handle_auth_done global_id 124127 payload 824 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcdc413a6a0 msgr2=0x7fcdc419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fcdc413a6a0 0x7fcdc419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcdc417e8b0 msgr2=0x7fcdc4138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fcdc417e8b0 0x7fcdc4138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 monclient: found mon.noname-c 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.172+0000 7fcdc2ffd640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc4129660 con 0x7fcdc408b590 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc2ffd640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 0x7fcdc4193790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c700 tx=0x7fcdb800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8017070 con 0x7fcdc408b590 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: dump: 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb8005bd0 con 0x7fcdc408b590 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8007070 con 0x7fcdc408b590 2026-02-22T20:59:55.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: dump: 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc17fa640 4 set_mon_vals no callback set 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 5 monclient: authenticate success, global_id 124127 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 monclient: _renew_subs 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc4086690 con 0x7fcdc408b590 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 monclient: _renew_subs 2026-02-22T20:59:55.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc412a680 con 0x7fcdc408b590 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 0x7fcdc4127c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc4139f90 con 0x7fcdc41394f0 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fcdb8007210 con 0x7fcdc408b590 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 0x7fcdc4127c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient: get_auth_request con 0x7fcdc41394f0 auth_method 0 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 --2- 10.20.193.7:0/3131307120 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcd9003ab20 0x7fcd9005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_done global_id 124130 payload 824 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdc412b1e0 con 0x7fcdc41394f0 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7fcdb804df50 con 0x7fcdc408b590 2026-02-22T20:59:55.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc37fe640 1 --2- 10.20.193.7:0/3131307120 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcd9003ab20 0x7fcd9005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 0x7fcdc4127c30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc37fe640 10 monclient: get_auth_request con 0x7fcd9003ab20 auth_method 0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0b8070 con 0x7fcdc41394f0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: dump: 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fcdac0b0050 con 0x7fcdc41394f0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 msgr2=0x7fcdc4127c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 0x7fcdc4127c30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0191c0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 msgr2=0x7fcdc4127c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcda37fe640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc41394f0 0x7fcdc4127c30 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0191c0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.176+0000 7fcdc37fe640 1 --2- 10.20.193.7:0/3131307120 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcd9003ab20 0x7fcd9005afd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40871e0 tx=0x7fcdb400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 0x7fcdc4128570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc4128ab0 con 0x7fcdc4128170 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 0x7fcdc4128570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient: get_auth_request con 0x7fcdc4128170 auth_method 0 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 10 monclient(hunting): handle_auth_done global_id 124133 payload 824 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 1 -- 10.20.193.7:0/3131307120 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcdc412b4e0 con 0x7fcdc4128170 2026-02-22T20:59:55.194 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc27fc640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 0x7fcdc4128570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0c2670 con 0x7fcdc4128170 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 10 monclient: dump: 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4713 (secure 0 0 0) 0x7fcdac0c6070 con 0x7fcdc4128170 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 msgr2=0x7fcdc4128570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.195 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 0x7fcdc4128570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 msgr2=0x7fcdc4128570 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcda37fe640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc4128170 0x7fcdc4128570 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdac01aad0 tx=0x7fcdac0a9000 comp rx=0 tx=0).stop 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 12375, 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:55.196 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 7, 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.197 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.198 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:55.199 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:55.200 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.201 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.202 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.203 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:55.204 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.205 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.205 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.205 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:55.205 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcd9003ab20 msgr2=0x7fcd9005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 --2- 10.20.193.7:0/3131307120 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcd9003ab20 0x7fcd9005afd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40871e0 tx=0x7fcdb400b040 comp rx=0 tx=0).stop 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 10 monclient: shutdown 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 msgr2=0x7fcdc4193790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 --2- 10.20.193.7:0/3131307120 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fcdc408b590 0x7fcdc4193790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c700 tx=0x7fcdb800cbc0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc37fe640 1 -- 10.20.193.7:0/3131307120 reap_dead start 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc37fe640 1 -- 10.20.193.7:0/3131307120 reap_dead start 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 shutdown_connections 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 >> 10.20.193.7:0/3131307120 conn(0x7fcdc408faa0 msgr2=0x7fcdc40573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.206 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 shutdown_connections 2026-02-22T20:59:55.207 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.180+0000 7fcdc961d640 1 -- 10.20.193.7:0/3131307120 wait complete. 2026-02-22T20:59:55.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:55.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T20:59:55.207 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T20:59:55.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: get_monmap_and_config 2026-02-22T20:59:55.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.269 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: monmap: 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:55.269760+0000 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:55.269760+0000 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:55.270 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 Processor -- start 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 -- start start 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: init 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f183c13f290 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-c con 0x7f183c13fd70 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f183c180d00 0x7f183c1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-a con 0x7f183c180d00 addr v2:10.20.193.7:3300/0 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c08fd70 con 0x7f183c13f290 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f183c08e1f0 con 0x7f183c180d00 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f183c08ec90 con 0x7f183c13fd70 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.271 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f18441b0640 10 monclient(hunting): authenticate will time out at 1007.742876s 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841f25640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f183c13f290 0x7f183c13f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:45322/0 (socket says 10.20.193.7:45322) 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841f25640 1 -- 10.20.193.7:0/2697085694 learned_addr learned my addr 10.20.193.7:0/2697085694 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 --2- 10.20.193.7:0/2697085694 >> v2:10.20.193.7:3300/0 conn(0x7f183c180d00 0x7f183c1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): get_auth_request con 0x7f183c180d00 auth_method 0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 1 --2- 10.20.193.7:0/2697085694 >> v2:10.20.193.61:3300/0 conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): get_auth_request con 0x7f183c13fd70 auth_method 0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 1 -- 10.20.193.7:0/2697085694 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170917315 0 0) 0x7f182c002920 con 0x7f183c13f290 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 10 monclient(hunting): _negotiate 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 10 monclient(hunting): my global_id is 94989 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1840f23640 1 -- 10.20.193.7:0/2697085694 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1824003620 con 0x7f183c13f290 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient(hunting): handle_auth_done global_id 94986 payload 274 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 -- 10.20.193.7:0/2697085694 >> v2:10.20.193.61:3300/0 conn(0x7f183c13fd70 msgr2=0x7f183c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 --2- 10.20.193.7:0/2697085694 >> v2:10.20.193.61:3300/0 conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 -- 10.20.193.7:0/2697085694 >> v1:10.20.193.7:6789/0 conn(0x7f183c13f290 legacy=0x7f183c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 monclient: found mon.noname-a 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T20:59:55.272 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.264+0000 7f1842726640 1 -- 10.20.193.7:0/2697085694 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c092bc0 con 0x7f183c180d00 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 1 --2- 10.20.193.7:0/2697085694 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c1a10e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f183c092f70 tx=0x7f183801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e96a4f42df58fad server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 1 -- 10.20.193.7:0/2697085694 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380b2070 con 0x7f183c180d00 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: dump: 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 5 monclient: authenticate success, global_id 94986 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 1 -- 10.20.193.7:0/2697085694 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18380a5910 con 0x7f183c180d00 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.273 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 1 -- 10.20.193.7:0/2697085694 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380a5d00 con 0x7f183c180d00 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 4 set_mon_vals no callback set 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1840f23640 10 monclient: dump: 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: shutdown 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2697085694 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 msgr2=0x7f183c1a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- 10.20.193.7:0/2697085694 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c1a10e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f183c092f70 tx=0x7f183801c850 comp rx=0 tx=0).stop 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2697085694 shutdown_connections 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- 10.20.193.7:0/2697085694 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c1a10e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- 10.20.193.7:0/2697085694 >> v2:10.20.193.61:3300/0 conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2697085694 >> 10.20.193.7:0/2697085694 conn(0x7f183c093df0 msgr2=0x7f183c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2697085694 shutdown_connections 2026-02-22T20:59:55.274 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2697085694 wait complete. 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: monmap: 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 Processor -- start 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- start start 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: init 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-c con 0x7f183c13f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-b con 0x7f183c13fd70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c109e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): picked mon.noname-a con 0x7f183c180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1a3fc0 con 0x7f183c180d00 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.276 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1a3e40 con 0x7f183c13fd70 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f183c1a4140 con 0x7f183c13f290 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): authenticate will time out at 1007.746311s 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c109e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53946/0 (socket says 10.20.193.7:53946) 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 -- 10.20.193.7:0/2628542083 learned_addr learned my addr 10.20.193.7:0/2628542083 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): get_auth_request con 0x7f183c13f290 auth_method 0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): get_auth_request con 0x7f183c180d00 auth_method 0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): get_auth_request con 0x7f183c13fd70 auth_method 0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient(hunting): handle_auth_done global_id 124136 payload 824 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c13fd70 msgr2=0x7f183c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c13fd70 0x7f183c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 msgr2=0x7f183c109e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c109e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 monclient: found mon.noname-c 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c10cc50 con 0x7f183c13f290 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f183c180d00 0x7f183c109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841f25640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f182c00c700 tx=0x7f182c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c017070 con 0x7f183c13f290 2026-02-22T20:59:55.277 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: dump: 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c005bb0 con 0x7f183c13f290 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c00a640 con 0x7f183c13f290 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 10 monclient: dump: 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182bfff640 4 set_mon_vals no callback set 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 5 monclient: authenticate success, global_id 124136 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _renew_subs 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c08a9e0 con 0x7f183c13f290 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _renew_subs 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c10bfc0 con 0x7f183c13f290 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.278 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 0x7f183c10a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f183c10ac90 con 0x7f183c10a380 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 0x7f183c10a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f182c00a7e0 con 0x7f183c13f290 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient: get_auth_request con 0x7f183c10a380 auth_method 0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 --2- 10.20.193.7:0/2628542083 >> v2:10.20.193.61:6800/2336688312 conn(0x7f180c03ab20 0x7f180c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7f182c04df00 con 0x7f183c13f290 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 10 monclient(hunting): handle_auth_done global_id 114448 payload 824 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f183c13f660 con 0x7f183c10a380 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 1 --2- 10.20.193.7:0/2628542083 >> v2:10.20.193.61:6800/2336688312 conn(0x7f180c03ab20 0x7f180c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1842726640 10 monclient: get_auth_request con 0x7f180c03ab20 auth_method 0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.268+0000 7f1841724640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 0x7f183c10a750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1830004780 tx=0x7f1830011c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183000fa30 con 0x7f183c10a380 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 10 monclient: dump: 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f183000fa30 con 0x7f183c10a380 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 msgr2=0x7f183c10a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 0x7f183c10a750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1830004780 tx=0x7f1830011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:55.279 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 msgr2=0x7f183c10a750 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f182a7fc640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c10a380 0x7f183c10a750 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1830004780 tx=0x7f1830011c90 comp rx=0 tx=0).stop 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1842726640 1 --2- 10.20.193.7:0/2628542083 >> v2:10.20.193.61:6800/2336688312 conn(0x7f180c03ab20 0x7f180c05afd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f183801a480 tx=0x7f18380a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f18441b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f18441b0640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 0x7f183c08c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f18441b0640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f183c10cfe0 con 0x7f183c08bc00 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 0x7f183c08c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.280 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient: get_auth_request con 0x7f183c08bc00 auth_method 0 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.272+0000 7f1841724640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f1841724640 10 monclient(hunting): handle_auth_done global_id 114451 payload 824 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f1841724640 1 -- 10.20.193.7:0/2628542083 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f183c05fb50 con 0x7f183c08bc00 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f1841724640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 0x7f183c08c000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1830019000 tx=0x7f1830004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830022340 con 0x7f183c08bc00 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 10 monclient: dump: 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5047 (secure 0 0 0) 0x7f1830022340 con 0x7f183c08bc00 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 msgr2=0x7f183c08c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 0x7f183c08c000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1830019000 tx=0x7f1830004820 comp rx=0 tx=0).stop 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 msgr2=0x7f183c08c000 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f182a7fc640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f183c08bc00 0x7f183c08c000 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1830019000 tx=0x7f1830004820 comp rx=0 tx=0).stop 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 66, 2026-02-22T20:59:55.281 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 56463, 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 7, 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.282 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T20:59:55.283 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T20:59:55.284 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T20:59:55.285 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.286 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "num": 6 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T20:59:55.287 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T20:59:55.288 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 >> v2:10.20.193.61:6800/2336688312 conn(0x7f180c03ab20 msgr2=0x7f180c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 --2- 10.20.193.7:0/2628542083 >> v2:10.20.193.61:6800/2336688312 conn(0x7f180c03ab20 0x7f180c05afd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f183801a480 tx=0x7f18380a7070 comp rx=0 tx=0).stop 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 10 monclient: shutdown 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 msgr2=0x7f183c12c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f182c00c700 tx=0x7f182c00cbc0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f1842726640 1 -- 10.20.193.7:0/2628542083 reap_dead start 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 shutdown_connections 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 --2- 10.20.193.7:0/2628542083 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f183c13f290 0x7f183c12c660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.289 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 >> 10.20.193.7:0/2628542083 conn(0x7f183c093df0 msgr2=0x7f183c055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 shutdown_connections 2026-02-22T20:59:55.290 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.276+0000 7f18441b0640 1 -- 10.20.193.7:0/2628542083 wait complete. 2026-02-22T20:59:55.290 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T20:59:55.290 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-22T20:59:55.290 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-22T20:59:55.290 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-22T20:59:55.290 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-22T20:59:55.290 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T20:59:55.290 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T20:59:55.304 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T20:59:55.304 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-22T20:59:55.305 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:55.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: get_monmap_and_config 2026-02-22T20:59:55.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: monmap: 2026-02-22T20:59:55.419 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:55.406853+0000 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:55.406853+0000 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:55.420 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 Processor -- start 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 -- start start 2026-02-22T20:59:55.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: init 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-b con 0x7f5a7813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5a7813d800 addr v1:10.20.193.61:6789/0 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f5a7813a2e0 0x7f5a7819f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-c con 0x7f5a7813a2e0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7805d510 con 0x7f5a7813d800 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7808b800 con 0x7f5a7813a2e0 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7808a720 con 0x7f5a7813cef0 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7e64d640 10 monclient(hunting): authenticate will time out at 1007.879751s 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53990/0 (socket says 10.20.193.7:53990) 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 1 -- 10.20.193.7:0/178366395 learned_addr learned my addr 10.20.193.7:0/178366395 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): get_auth_request con 0x7f5a7813cef0 auth_method 0 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a7cbc3640 1 --2- 10.20.193.7:0/178366395 >> v2:10.20.193.61:3300/0 conn(0x7f5a7813a2e0 0x7f5a7819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.400+0000 7f5a77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 10 monclient(hunting): get_auth_request con 0x7f5a7813a2e0 auth_method 0 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient(hunting): handle_auth_done global_id 124139 payload 274 2026-02-22T20:59:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 -- 10.20.193.7:0/178366395 >> v2:10.20.193.61:3300/0 conn(0x7f5a7813a2e0 msgr2=0x7f5a7819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 --2- 10.20.193.7:0/178366395 >> v2:10.20.193.61:3300/0 conn(0x7f5a7813a2e0 0x7f5a7819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 -- 10.20.193.7:0/178366395 >> v1:10.20.193.61:6789/0 conn(0x7f5a7813d800 legacy=0x7f5a78139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 monclient: found mon.noname-b 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 -- 10.20.193.7:0/178366395 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7808aa00 con 0x7f5a7813cef0 2026-02-22T20:59:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 --2- 10.20.193.7:0/178366395 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a640090a0 tx=0x7f5a6401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=476e205d006641c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 1 -- 10.20.193.7:0/178366395 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b0070 con 0x7f5a7813cef0 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: dump: 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.427 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 1 -- 10.20.193.7:0/178366395 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640ab600 con 0x7f5a7813cef0 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 5 monclient: authenticate success, global_id 124139 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 1 -- 10.20.193.7:0/178366395 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ab9d0 con 0x7f5a7813cef0 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 4 set_mon_vals no callback set 2026-02-22T20:59:55.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a76ffd640 10 monclient: dump: 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.430 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: shutdown 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/178366395 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 msgr2=0x7f5a7813d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/178366395 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a640090a0 tx=0x7f5a6401c500 comp rx=0 tx=0).stop 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/178366395 shutdown_connections 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/178366395 >> v2:10.20.193.61:3300/0 conn(0x7f5a7813a2e0 0x7f5a7819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/178366395 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a7813d2c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/178366395 >> 10.20.193.7:0/178366395 conn(0x7f5a7808f860 msgr2=0x7f5a7808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/178366395 shutdown_connections 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/178366395 wait complete. 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: build_initial_monmap 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: monmap: 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.432 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 Processor -- start 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- start start 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: init 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a7813a2e0 0x7f5a78127a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-b con 0x7f5a7813a2e0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-c con 0x7f5a7813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 0x7f5a781284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): picked mon.noname-a con 0x7f5a7813d800 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781a2360 con 0x7f5a7813d800 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781a21e0 con 0x7f5a7813a2e0 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f5a781a24e0 con 0x7f5a7813cef0 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient(hunting): authenticate will time out at 1007.882912s 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 msgr2=0x7f5a781284c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7cbc3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 0x7f5a781284c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53994/0 (socket says 10.20.193.7:53994) 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 -- 10.20.193.7:0/1780499383 learned_addr learned my addr 10.20.193.7:0/1780499383 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:55.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): get_auth_request con 0x7f5a7813cef0 auth_method 0 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a7813a2e0 0x7f5a78127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient(hunting): get_auth_request con 0x7f5a7813a2e0 auth_method 0 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient(hunting): handle_auth_done global_id 124142 payload 824 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 -- 10.20.193.7:0/1780499383 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a7813a2e0 msgr2=0x7f5a78127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a7813a2e0 0x7f5a78127a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 -- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 msgr2=0x7f5a781284c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 0x7f5a781284c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 monclient: found mon.noname-c 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 -- 10.20.193.7:0/1780499383 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7812b690 con 0x7f5a7813cef0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a777fe640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c520 tx=0x7f5a6800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68017070 con 0x7f5a7813cef0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: dump: 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.436 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: _finish_auth 0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: _check_auth_tickets 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a68006ad0 con 0x7f5a7813cef0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68007030 con 0x7f5a7813cef0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 5 monclient: authenticate success, global_id 124142 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _renew_subs 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7813c850 con 0x7f5a7813cef0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a767fc640 4 set_mon_vals no callback set 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:55.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a74ff9640 10 monclient: dump: 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _renew_subs 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a78129330 con 0x7f5a7813cef0 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.404+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7813d2c0 con 0x7f5a7813cef0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f5a680071d0 con 0x7f5a7813cef0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a74ff9640 1 --2- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 0x7f5a4805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7f5a6804e000 con 0x7f5a7813cef0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a77fff640 1 --2- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 0x7f5a4805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a77fff640 10 monclient: get_auth_request con 0x7f5a4803aa90 auth_method 0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.408+0000 7f5a77fff640 1 --2- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 0x7f5a4805af40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009690 tx=0x7f5a640a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.412+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f5a6801a360 con 0x7f5a7813cef0 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.412+0000 7f5a74ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:55.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.412+0000 7f5a74ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:55.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:55.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:55.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:55.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5a78139fc0 con 0x7f5a7813cef0 2026-02-22T20:59:55.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a74ff9640 1 -- 10.20.193.7:0/1780499383 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f5a68009aa0 con 0x7f5a7813cef0 2026-02-22T20:59:55.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a74ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:55.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a74ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:55.527 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:55.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 msgr2=0x7f5a4805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 0x7f5a4805af40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009690 tx=0x7f5a640a6000 comp rx=0 tx=0).stop 2026-02-22T20:59:55.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 10 monclient: shutdown 2026-02-22T20:59:55.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 msgr2=0x7f5a78127f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800c520 tx=0x7f5a6800c9e0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 shutdown_connections 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f5a7813d800 0x7f5a781284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f5a7813cef0 0x7f5a78127f80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> v2:10.20.193.61:6800/2336688312 conn(0x7f5a4803aa90 0x7f5a4805af40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 --2- 10.20.193.7:0/1780499383 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f5a7813a2e0 0x7f5a78127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 >> 10.20.193.7:0/1780499383 conn(0x7f5a7808f860 msgr2=0x7f5a7813b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 shutdown_connections 2026-02-22T20:59:55.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:55.520+0000 7f5a7e64d640 1 -- 10.20.193.7:0/1780499383 wait complete. 2026-02-22T20:59:56.969 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T20:59:56.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T20:59:58.538 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T20:59:58.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: get_monmap_and_config 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: build_initial_monmap 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: monmap: 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:59:58.601346+0000 2026-02-22T20:59:58.604 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:59:58.601346+0000 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T20:59:58.605 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 Processor -- start 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 -- start start 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: init 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient: _add_conns ranks=[4,2,0,1,3] 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 0x7faa0413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-c con 0x7faa0413cef0 addr v2:10.20.193.61:3300/0 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-b con 0x7faa0413d800 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faa0413a110 addr v1:10.20.193.7:6789/0 2026-02-22T20:59:58.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0405d510 con 0x7faa0413a110 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7faa0408b800 con 0x7faa0413cef0 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faa0408a720 con 0x7faa0413d800 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa09b84640 10 monclient(hunting): authenticate will time out at 1011.074257s 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa03fff640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7faa0413a110 legacy=0x7faa0419e470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57294/0 (socket says 10.20.193.7:57294) 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 -- 10.20.193.7:0/1206173704 learned_addr learned my addr 10.20.193.7:0/1206173704 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): get_auth_request con 0x7faa0413d800 auth_method 0 2026-02-22T20:59:58.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 1 --2- 10.20.193.7:0/1206173704 >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 0x7faa0413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 10 monclient(hunting): get_auth_request con 0x7faa0413cef0 auth_method 0 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient(hunting): handle_auth_done global_id 124145 payload 274 2026-02-22T20:59:58.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 -- 10.20.193.7:0/1206173704 >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 msgr2=0x7faa0413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1206173704 >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 0x7faa0413d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 -- 10.20.193.7:0/1206173704 >> v1:10.20.193.7:6789/0 conn(0x7faa0413a110 legacy=0x7faa0419e470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient: _finish_hunting 0 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 monclient: found mon.noname-b 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa02ffd640 1 -- 10.20.193.7:0/1206173704 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0408aa00 con 0x7faa0413d800 2026-02-22T20:59:58.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.596+0000 7faa037fe640 1 --2- 10.20.193.7:0/1206173704 >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 0x7faa0413d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T20:59:58.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1206173704 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40090a0 tx=0x7fa9f401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc43627b66f98ce server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:58.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 1 -- 10.20.193.7:0/1206173704 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40b0070 con 0x7faa0413d800 2026-02-22T20:59:58.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:58.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T20:59:58.615 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: dump: 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: _finish_auth 0 2026-02-22T20:59:58.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: _check_auth_tickets 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 1 -- 10.20.193.7:0/1206173704 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40ab600 con 0x7faa0413d800 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 5 monclient: authenticate success, global_id 124145 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 1 -- 10.20.193.7:0/1206173704 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40ab9d0 con 0x7faa0413d800 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa027fc640 10 monclient: dump: 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:58.617 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: get_monmap_and_config success 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 4 set_mon_vals no callback set 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: shutdown 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:58.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1206173704 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 msgr2=0x7faa04139bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- 10.20.193.7:0/1206173704 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40090a0 tx=0x7fa9f401c500 comp rx=0 tx=0).stop 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1206173704 shutdown_connections 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- 10.20.193.7:0/1206173704 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413d800 0x7faa04139bd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- 10.20.193.7:0/1206173704 >> v2:10.20.193.61:3300/0 conn(0x7faa0413cef0 0x7faa0413d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1206173704 >> 10.20.193.7:0/1206173704 conn(0x7faa0408f860 msgr2=0x7faa0408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1206173704 shutdown_connections 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1206173704 wait complete. 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: build_initial_monmap 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: monmap: 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T20:59:58.619 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 Processor -- start 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- start start 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: init 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _reopen_session rank -1 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T20:59:58.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-c con 0x7faa0413a110 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 0x7faa04126d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-b con 0x7faa0413cef0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 0x7faa04127250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): picked mon.noname-a con 0x7faa0413d800 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa04088fa0 con 0x7faa0413d800 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7faa04088e20 con 0x7faa0413cef0 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): start opening mon connection 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faa041a23b0 con 0x7faa0413a110 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): _renew_subs 2026-02-22T20:59:58.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient(hunting): authenticate will time out at 1011.077897s 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa03fff640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 msgr2=0x7faa04127250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa03fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 0x7faa04127250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57306/0 (socket says 10.20.193.7:57306) 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 -- 10.20.193.7:0/1456087161 learned_addr learned my addr 10.20.193.7:0/1456087161 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): get_auth_request con 0x7faa0413a110 auth_method 0 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T20:59:58.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient(hunting): handle_auth_done global_id 124148 payload 824 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 -- 10.20.193.7:0/1456087161 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 msgr2=0x7faa04126d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 0x7faa04126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 0x7faa04126d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 -- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 msgr2=0x7faa04127250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 0x7faa04127250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient: _finish_hunting 0 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 monclient: found mon.noname-c 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 -- 10.20.193.7:0/1456087161 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0405cf80 con 0x7faa0413a110 2026-02-22T20:59:58.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 10 monclient: get_auth_request con 0x7faa0413cef0 auth_method 0 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 0x7faa04126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa037fe640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000e850 tx=0x7fa9f000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000f040 con 0x7faa0413a110 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: dump: 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:58.624 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: _finish_auth 0 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: _check_auth_tickets 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f0004230 con 0x7faa0413a110 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: handle_config config(0 keys) 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0003710 con 0x7faa0413a110 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T20:59:58.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa01ffb640 4 set_mon_vals no callback set 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 10 monclient: dump: 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T20:59:58.626 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 5 monclient: authenticate success, global_id 124148 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _renew_subs 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa04086620 con 0x7faa0413a110 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _renew_subs 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0412a1f0 con 0x7faa0413a110 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa040382a0 con 0x7faa0413a110 2026-02-22T20:59:58.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fa9f0012050 con 0x7faa0413a110 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 --2- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 0x7fa9d405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7fa9f004e400 con 0x7faa0413a110 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 0x7fa9d405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 10 monclient: get_auth_request con 0x7fa9d403aa90 auth_method 0 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.600+0000 7faa02ffd640 1 --2- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 0x7fa9d405af40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4004780 tx=0x7fa9f40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.604+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fa9f0017020 con 0x7faa0413a110 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.604+0000 7fa9dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T20:59:58.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.604+0000 7fa9dffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T20:59:58.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7faa09b84640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7faa09b84640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7faa09b84640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faa0413d2c0 con 0x7faa0413a110 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7fa9dffff640 1 -- 10.20.193.7:0/1456087161 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7fa9f000a700 con 0x7faa0413a110 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7fa9dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.716+0000 7fa9dffff640 10 monclient: _finish_command 2 = system:0 2026-02-22T20:59:58.724 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 msgr2=0x7fa9d405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 0x7fa9d405af40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4004780 tx=0x7fa9f40a6000 comp rx=0 tx=0).stop 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 10 monclient: shutdown 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 msgr2=0x7faa041396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000e850 tx=0x7fa9f000ed10 comp rx=0 tx=0).stop 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 shutdown_connections 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faa0413d800 0x7faa04127250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> v2:10.20.193.61:6800/2336688312 conn(0x7fa9d403aa90 0x7fa9d405af40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faa0413cef0 0x7faa04126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 --2- 10.20.193.7:0/1456087161 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faa0413a110 0x7faa041396b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T20:59:58.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 >> 10.20.193.7:0/1456087161 conn(0x7faa0408f860 msgr2=0x7faa0413b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T20:59:58.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 shutdown_connections 2026-02-22T20:59:58.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T20:59:58.720+0000 7faa09b84640 1 -- 10.20.193.7:0/1456087161 wait complete. 2026-02-22T21:00:01.735 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: get_monmap_and_config 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: build_initial_monmap 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: monmap: 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:01.805680+0000 2026-02-22T21:00:01.805 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:01.805680+0000 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 Processor -- start 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 -- start start 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: init 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient: _add_conns ranks=[0,1,4,3,2] 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f555413be70 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:01.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f555413c950 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f555417eb30 0x7f555419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): picked mon.noname-c con 0x7f555417eb30 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55540875d0 con 0x7f555413be70 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55540872f0 con 0x7f555413c950 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f55540878b0 con 0x7f555417eb30 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5558b45640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f555413be70 legacy=0x7f555413c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f555add0640 10 monclient(hunting): authenticate will time out at 1014.278828s 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f555417eb30 0x7f555419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f554bfff640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7f555413c950 0x7f555417d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:36758/0 (socket says 10.20.193.7:36758) 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f554bfff640 1 -- 10.20.193.7:0/206996296 learned_addr learned my addr 10.20.193.7:0/206996296 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): get_auth_request con 0x7f555417eb30 auth_method 0 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:01.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient(hunting): handle_auth_done global_id 114463 payload 274 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 1 -- 10.20.193.7:0/206996296 >> v1:10.20.193.61:6789/0 conn(0x7f555413c950 legacy=0x7f555417d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 1 -- 10.20.193.7:0/206996296 >> v1:10.20.193.7:6789/0 conn(0x7f555413be70 legacy=0x7f555413c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient: _finish_hunting 0 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 1 monclient: found mon.noname-c 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T21:00:01.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.800+0000 7f5559346640 1 -- 10.20.193.7:0/206996296 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555408dbd0 con 0x7f555417eb30 2026-02-22T21:00:01.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- 10.20.193.7:0/206996296 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555417eb30 0x7f555419ef10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5550004b00 tx=0x7f555001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e0dab4eeea3dc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:01.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 1 -- 10.20.193.7:0/206996296 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500b2070 con 0x7f555417eb30 2026-02-22T21:00:01.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:01.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:01.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: dump: 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 5 monclient: authenticate success, global_id 114463 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 1 -- 10.20.193.7:0/206996296 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55500a5780 con 0x7f555417eb30 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 1 -- 10.20.193.7:0/206996296 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500a5b70 con 0x7f555417eb30 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 4 set_mon_vals no callback set 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554b7fe640 10 monclient: dump: 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: shutdown 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/206996296 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555417eb30 msgr2=0x7f555419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 --2- 10.20.193.7:0/206996296 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555417eb30 0x7f555419ef10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5550004b00 tx=0x7f555001c8c0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/206996296 shutdown_connections 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 --2- 10.20.193.7:0/206996296 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555417eb30 0x7f555419ef10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/206996296 >> 10.20.193.7:0/206996296 conn(0x7f555408f860 msgr2=0x7f555408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/206996296 shutdown_connections 2026-02-22T21:00:01.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/206996296 wait complete. 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: build_initial_monmap 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: monmap: 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:01.812 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 Processor -- start 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- start start 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: init 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 0x7f5554139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): picked mon.noname-a con 0x7f555413be70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 0x7f5554139560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): picked mon.noname-b con 0x7f555413c950 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): picked mon.noname-c con 0x7f555417eb30 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a1e80 con 0x7f555413be70 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f555408b780 con 0x7f555413c950 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f55541a2000 con 0x7f555417eb30 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient(hunting): authenticate will time out at 1014.283005s 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5558b45640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 msgr2=0x7f5554139020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5558b45640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 0x7f5554139020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57308/0 (socket says 10.20.193.7:57308) 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 -- 10.20.193.7:0/331210404 learned_addr learned my addr 10.20.193.7:0/331210404 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): get_auth_request con 0x7f555417eb30 auth_method 0 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 0x7f5554139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 10 monclient(hunting): get_auth_request con 0x7f555413c950 auth_method 0 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:01.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient(hunting): handle_auth_done global_id 124151 payload 824 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 -- 10.20.193.7:0/331210404 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 msgr2=0x7f5554139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 0x7f5554139560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 -- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 msgr2=0x7f5554139020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 0x7f5554139020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient: _finish_hunting 0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 monclient: found mon.noname-c 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 -- 10.20.193.7:0/331210404 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555408ec50 con 0x7f555417eb30 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554bfff640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 0x7f5554139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f5559346640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f555001af70 tx=0x7f5550019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500bc020 con 0x7f555417eb30 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: dump: 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5550004040 con 0x7f555417eb30 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500b2040 con 0x7f555417eb30 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 5 monclient: authenticate success, global_id 124151 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _renew_subs 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555410cf60 con 0x7f555417eb30 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f554affd640 4 set_mon_vals no callback set 2026-02-22T21:00:01.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f55497fa640 10 monclient: dump: 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _renew_subs 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.804+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5554107c40 con 0x7f555417eb30 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f555add0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f555add0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f555add0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55540382a0 con 0x7f555417eb30 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f55500b5070 con 0x7f555417eb30 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f55497fa640 1 --2- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 0x7f552405af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7f55500e9340 con 0x7f555417eb30 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f5558b45640 1 --2- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 0x7f552405af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:01.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f5558b45640 10 monclient: get_auth_request con 0x7f552403aa90 auth_method 0 2026-02-22T21:00:01.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.808+0000 7f5558b45640 1 --2- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 0x7f552405af40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5544003a80 tx=0x7f55440092b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:01.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.812+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f55500c6020 con 0x7f555417eb30 2026-02-22T21:00:01.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.812+0000 7f55497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:01.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.812+0000 7f55497fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:01.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f555add0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:01.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f555add0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:01.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f555add0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:01.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f55541083d0 con 0x7f555417eb30 2026-02-22T21:00:01.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f55497fa640 1 -- 10.20.193.7:0/331210404 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1612 (secure 0 0 0) 0x7f5550016540 con 0x7f555417eb30 2026-02-22T21:00:01.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f55497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:01.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.920+0000 7f55497fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:01.930 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:01.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 msgr2=0x7f552405af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:01.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 0x7f552405af40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5544003a80 tx=0x7f55440092b0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.932 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 10 monclient: shutdown 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 msgr2=0x7f555412bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f555001af70 tx=0x7f5550019660 comp rx=0 tx=0).stop 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 shutdown_connections 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f555417eb30 0x7f555412bc20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> v2:10.20.193.61:6800/2336688312 conn(0x7f552403aa90 0x7f552405af40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f555413c950 0x7f5554139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 --2- 10.20.193.7:0/331210404 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f555413be70 0x7f5554139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:01.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 >> 10.20.193.7:0/331210404 conn(0x7f555408f860 msgr2=0x7f555405cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:01.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 shutdown_connections 2026-02-22T21:00:01.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:01.924+0000 7f555add0640 1 -- 10.20.193.7:0/331210404 wait complete. 2026-02-22T21:00:01.943 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_21:00:01] 2026-02-22T21:00:01.944 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T21:00:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_21:00:01 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['rbd', '.mgr', 'ceph_test_rados_delete_pools_parallel.trial061-22355'] 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:01.947 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T21:00:01.948 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T21:00:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:01.962 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T21:00:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T21:00:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T21:00:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T21:00:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T21:00:01.963 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T21:00:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T21:00:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T21:00:01.966 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T21:00:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T21:00:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "ceph_test_rados_delete_pools_parallel.trial061-22355": { 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": {}, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:59:52.384739+0000", 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 32769, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,creating", 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T21:00:01.969 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "269", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T21:00:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 32, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 32, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 32, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 32, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 32, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 86, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "ceph_test_rados_delete_pools_parallel.trial061-22355", 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T21:00:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 1.8799999952316284, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 1.8799999952316284, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 1.8799999952316284, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 1.8799999952316284, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T21:00:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T21:00:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T21:00:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T21:00:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T21:00:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T21:00:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T21:00:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1, -1] pools [1, 2, 86] with 6 osds, pg_target 600 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T21:00:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'ceph_test_rados_delete_pools_parallel.trial061-22355' root_id -1 using 7.064254195601851e-07 of space, bias 1.0, pg target 0.00021192762586805553 quantized to 32 (current 32) 2026-02-22T21:00:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:04.940 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:05.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: get_monmap_and_config 2026-02-22T21:00:05.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: build_initial_monmap 2026-02-22T21:00:05.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: monmap: 2026-02-22T21:00:05.002 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:05.002 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:05.001631+0000 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:05.001631+0000 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:05.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 Processor -- start 2026-02-22T21:00:05.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 -- start start 2026-02-22T21:00:05.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: init 2026-02-22T21:00:05.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:05.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-22T21:00:05.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-b con 0x7fc3d813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc3d813d800 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc3d813a2e0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d805d510 con 0x7fc3d813d800 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d808b800 con 0x7fc3d813a2e0 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d808a720 con 0x7fc3d813cef0 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3ddc8e640 10 monclient(hunting): authenticate will time out at 1017.474725s 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d6ffd640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7fc3d813d800 legacy=0x7fc3d8139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:05.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:57314/0 (socket says 10.20.193.7:57314) 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 learned_addr learned my addr 10.20.193.7:0/624164109 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3d813cef0 auth_method 0 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:05.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:04.996+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3d813cef0 auth_method 0 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:05.204 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T21:00:05.205 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.200+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v1:10.20.193.7:6789/0 conn(0x7fc3d813d800 legacy=0x7fc3d8139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:05.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:05.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3d813cef0 auth_method 0 2026-02-22T21:00:05.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T21:00:05.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:05.604+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v1:10.20.193.7:6789/0 conn(0x7fc3d813d800 legacy=0x7fc3d8139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:06.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:06.409 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3d813cef0 auth_method 0 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-22T21:00:06.410 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:06.408+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v1:10.20.193.7:6789/0 conn(0x7fc3d813d800 legacy=0x7fc3d8139bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:06.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:06.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): tick 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): _check_auth_tickets 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 monclient(hunting): continuing hunt 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 msgr2=0x7fc3d813d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d813cef0 0x7fc3d813d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 -- 10.20.193.7:0/624164109 >> v1:10.20.193.61:6789/0 conn(0x7fc3d813a2e0 legacy=0x7fc3d819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 -- 10.20.193.7:0/624164109 >> v1:10.20.193.7:6789/0 conn(0x7fc3d813d800 legacy=0x7fc3d8139bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient: _add_conns ranks=[4,3] 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b40037d0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 0x7fc3b40447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b4024310 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 -- 10.20.193.7:0/624164109 --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d808a720 con 0x7fc3b4024310 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 1 -- 10.20.193.7:0/624164109 --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b4044e80 con 0x7fc3b40037d0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d57fa640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 msgr2=0x7fc3b40447c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d6ffd640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 0x7fc3b40447c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3b40037d0 auth_method 0 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:08.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.000+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:08.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 msgr2=0x7fc3b40447c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:08.208 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d6ffd640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 0x7fc3b40447c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3b40037d0 auth_method 0 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:08.209 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:08.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:08.210 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.204+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-22T21:00:08.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d6ffd640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 msgr2=0x7fc3b40447c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:08.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d6ffd640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 0x7fc3b40447c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3b40037d0 auth_method 0 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:08.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:08.608+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-22T21:00:09.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.61:3300/0 conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3b40037d0 auth_method 0 2026-02-22T21:00:09.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient(hunting): handle_auth_done global_id 114469 payload 274 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 msgr2=0x7fc3b40447c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:09.419 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> v2:10.20.193.7:3300/0 conn(0x7fc3b4024310 0x7fc3b40447c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 monclient: found mon.noname-c 2026-02-22T21:00:09.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T21:00:09.420 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 -- 10.20.193.7:0/624164109 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d808aa00 con 0x7fc3b40037d0 2026-02-22T21:00:09.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3b4023c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4003760 tx=0x7fc3c401df00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a172bae260ce5e1f server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 1 -- 10.20.193.7:0/624164109 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400f040 con 0x7fc3b40037d0 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: dump: 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.429 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 1 -- 10.20.193.7:0/624164109 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c40a6c60 con 0x7fc3b40037d0 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 1 -- 10.20.193.7:0/624164109 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40b1680 con 0x7fc3b40037d0 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 5 monclient: authenticate success, global_id 114469 2026-02-22T21:00:09.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 4 set_mon_vals no callback set 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d67fc640 10 monclient: dump: 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.431 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 10 monclient: shutdown 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/624164109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 msgr2=0x7fc3b4023c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3b4023c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4003760 tx=0x7fc3c401df00 comp rx=0 tx=0).stop 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3d7fff640 1 -- 10.20.193.7:0/624164109 reap_dead start 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/624164109 shutdown_connections 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/624164109 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3b4023c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/624164109 >> 10.20.193.7:0/624164109 conn(0x7fc3d808f860 msgr2=0x7fc3d808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/624164109 shutdown_connections 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/624164109 wait complete. 2026-02-22T21:00:09.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 10 monclient: build_initial_monmap 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.412+0000 7fc3ddc8e640 10 monclient: monmap: 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 Processor -- start 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- start start 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: init 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3d8113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-b con 0x7fc3b40037d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 0x7fc3d81214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-a con 0x7fc3d8121060 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): picked mon.noname-c con 0x7fc3d8126050 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81a3950 con 0x7fc3d8121060 2026-02-22T21:00:09.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81a37d0 con 0x7fc3b40037d0 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d81a3ad0 con 0x7fc3d8126050 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient(hunting): authenticate will time out at 1021.892607s 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d6ffd640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 msgr2=0x7fc3d81214d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d6ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 0x7fc3d81214d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53228/0 (socket says 10.20.193.7:53228) 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 -- 10.20.193.7:0/2373068921 learned_addr learned my addr 10.20.193.7:0/2373068921 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): get_auth_request con 0x7fc3d8126050 auth_method 0 2026-02-22T21:00:09.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3d8113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request con 0x7fc3b40037d0 auth_method 0 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient(hunting): handle_auth_done global_id 124154 payload 824 2026-02-22T21:00:09.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 -- 10.20.193.7:0/2373068921 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 msgr2=0x7fc3d8113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3d8113c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 -- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 msgr2=0x7fc3d81214d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 0x7fc3d81214d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 monclient: found mon.noname-c 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 -- 10.20.193.7:0/2373068921 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d8129a50 con 0x7fc3d8126050 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d7fff640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3d808f1d0 tx=0x7fc3cc00cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc003c70 con 0x7fc3d8126050 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:09.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: dump: 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc003e10 con 0x7fc3d8126050 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0074e0 con 0x7fc3d8126050 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d5ffb640 4 set_mon_vals no callback set 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 10 monclient: dump: 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.439 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 5 monclient: authenticate success, global_id 124154 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _renew_subs 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d8129d30 con 0x7fc3d8126050 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _renew_subs 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d8129770 con 0x7fc3d8126050 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc3cc007680 con 0x7fc3d8126050 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d813d2c0 con 0x7fc3d8126050 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 --2- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 0x7fc3a805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(270..270 src has 64..270) ==== 3897+0+0 (secure 0 0 0) 0x7fc3cc04dea0 con 0x7fc3d8126050 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 0x7fc3a805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 10 monclient: get_auth_request con 0x7fc3a803aa90 auth_method 0 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.416+0000 7fc3d77fe640 1 --2- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 0x7fc3a805af40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004780 tx=0x7fc3c40b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.420+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fc3cc0090c0 con 0x7fc3d8126050 2026-02-22T21:00:09.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.420+0000 7fc3b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.420+0000 7fc3b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:09.459 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:09.459 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22391]: starting. 2026-02-22T21:00:09.459 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22391]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22355 2026-02-22T21:00:09.460 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22391]: shutting down. 2026-02-22T21:00:09.462 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:09.462 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:09.462 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:09.464 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:09.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3ddc8e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:09.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3ddc8e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:09.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3ddc8e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc3d8139d40 con 0x7fc3d8126050 2026-02-22T21:00:09.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3b3fff640 1 -- 10.20.193.7:0/2373068921 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1605 (secure 0 0 0) 0x7fc3cc006cd0 con 0x7fc3d8126050 2026-02-22T21:00:09.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:09.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.528+0000 7fc3b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:09.536 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:09.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 msgr2=0x7fc3a805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 0x7fc3a805af40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004780 tx=0x7fc3c40b3040 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 10 monclient: shutdown 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 msgr2=0x7fc3d81264c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3d808f1d0 tx=0x7fc3cc00cb30 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 shutdown_connections 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc3d8126050 0x7fc3d81264c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc3d8121060 0x7fc3d81214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc3a803aa90 0x7fc3a805af40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 --2- 10.20.193.7:0/2373068921 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc3b40037d0 0x7fc3d8113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 >> 10.20.193.7:0/2373068921 conn(0x7fc3d808f860 msgr2=0x7fc3d813b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 shutdown_connections 2026-02-22T21:00:09.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.532+0000 7fc3ddc8e640 1 -- 10.20.193.7:0/2373068921 wait complete. 2026-02-22T21:00:09.548 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-22T21:00:09.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-22T21:00:09.548 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T21:00:09.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: get_monmap_and_config 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: build_initial_monmap 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: monmap: 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:09.612574+0000 2026-02-22T21:00:09.613 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:09.612574+0000 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:09.614 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 Processor -- start 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 -- start start 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: init 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): picked mon.noname-b con 0x7f45f813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f45f813fba0 0x7f45f813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): picked mon.noname-c con 0x7f45f813fba0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f45f813c4b0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f808fd70 con 0x7f45f813c4b0 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f45f808e1f0 con 0x7f45f813fba0 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f45f808ec90 con 0x7f45f813f290 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient(hunting): authenticate will time out at 1022.085940s 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53238/0 (socket says 10.20.193.7:53238) 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 -- 10.20.193.7:0/3184121219 learned_addr learned my addr 10.20.193.7:0/3184121219 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request con 0x7f45f813f290 auth_method 0 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 1 --2- 10.20.193.7:0/3184121219 >> v2:10.20.193.61:3300/0 conn(0x7f45f813fba0 0x7f45f813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): get_auth_request con 0x7f45f813fba0 auth_method 0 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_done global_id 124166 payload 274 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 -- 10.20.193.7:0/3184121219 >> v2:10.20.193.61:3300/0 conn(0x7f45f813fba0 msgr2=0x7f45f813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/3184121219 >> v2:10.20.193.61:3300/0 conn(0x7f45f813fba0 0x7f45f813bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 -- 10.20.193.7:0/3184121219 >> v1:10.20.193.61:6789/0 conn(0x7f45f813c4b0 legacy=0x7f45f81a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 monclient: found mon.noname-b 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 -- 10.20.193.7:0/3184121219 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f8092bc0 con 0x7f45f813f290 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/3184121219 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45e80090a0 tx=0x7f45e801c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815975adab161ce0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 1 -- 10.20.193.7:0/3184121219 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80aa600 con 0x7f45f813f290 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: dump: 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.629 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 1 -- 10.20.193.7:0/3184121219 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e80af070 con 0x7f45f813f290 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 1 -- 10.20.193.7:0/3184121219 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80aa9c0 con 0x7f45f813f290 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f45fd09f640 10 monclient: dump: 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 5 monclient: authenticate success, global_id 124166 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.608+0000 7f460032c640 4 set_mon_vals no callback set 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: shutdown 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/3184121219 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 msgr2=0x7f45f813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- 10.20.193.7:0/3184121219 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45e80090a0 tx=0x7f45e801c590 comp rx=0 tx=0).stop 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/3184121219 shutdown_connections 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- 10.20.193.7:0/3184121219 >> v2:10.20.193.61:3300/0 conn(0x7f45f813fba0 0x7f45f813bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- 10.20.193.7:0/3184121219 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f813f660 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/3184121219 >> 10.20.193.7:0/3184121219 conn(0x7f45f8093df0 msgr2=0x7f45f80902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/3184121219 shutdown_connections 2026-02-22T21:00:09.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/3184121219 wait complete. 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: build_initial_monmap 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: monmap: 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:09.633 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 Processor -- start 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- start start 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: init 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f45f813c4b0 0x7f45f812a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): picked mon.noname-b con 0x7f45f813c4b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f812a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): picked mon.noname-c con 0x7f45f813f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f45f813fba0 0x7f45f812ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): picked mon.noname-a con 0x7f45f813fba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8090de0 con 0x7f45f813fba0 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8090c60 con 0x7f45f813c4b0 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f45f81a4710 con 0x7f45f813f290 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): authenticate will time out at 1022.089120s 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe8a2640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f45f813fba0 msgr2=0x7f45f812ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:09.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe8a2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f45f813fba0 0x7f45f812ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f812a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f812a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53246/0 (socket says 10.20.193.7:53246) 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 -- 10.20.193.7:0/598886832 learned_addr learned my addr 10.20.193.7:0/598886832 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): get_auth_request con 0x7f45f813f290 auth_method 0 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f45f813c4b0 0x7f45f812a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request con 0x7f45f813c4b0 auth_method 0 2026-02-22T21:00:09.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient(hunting): handle_auth_done global_id 124169 payload 824 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f45f813c4b0 msgr2=0x7f45f812a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f45f813c4b0 0x7f45f812a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f45f813fba0 msgr2=0x7f45f812ab90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f45f813fba0 0x7f45f812ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 monclient: found mon.noname-c 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f812d150 con 0x7f45f813f290 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fd8a0640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f812a650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009430 tx=0x7f45ec00ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec017070 con 0x7f45f813f290 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: dump: 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.638 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec00c940 con 0x7f45f813f290 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00cd30 con 0x7f45f813f290 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: dump: 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.640 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fc89e640 4 set_mon_vals no callback set 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 5 monclient: authenticate success, global_id 124169 2026-02-22T21:00:09.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _renew_subs 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f812d9f0 con 0x7f45f813f290 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _renew_subs 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f808a9e0 con 0x7f45f813f290 2026-02-22T21:00:09.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 0x7f45f8088a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f45f813f660 con 0x7f45f8088670 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 0x7f45f8088a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient: get_auth_request con 0x7f45f8088670 auth_method 0 2026-02-22T21:00:09.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f45ec013470 con 0x7f45f813f290 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_done global_id 124172 payload 824 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45f80008e0 con 0x7f45f8088670 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 --2- 10.20.193.7:0/598886832 >> v2:10.20.193.61:6800/2336688312 conn(0x7f45c803aa90 0x7f45c805af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(271..271 src has 64..271) ==== 3503+0+0 (secure 0 0 0) 0x7f45ec04ee30 con 0x7f45f813f290 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 0x7f45f8088a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ac040 tx=0x7f45e8019330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80c0480 con 0x7f45f8088670 2026-02-22T21:00:09.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe8a2640 1 --2- 10.20.193.7:0/598886832 >> v2:10.20.193.61:6800/2336688312 conn(0x7f45c803aa90 0x7f45c805af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: dump: 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.646 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.647 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe8a2640 10 monclient: get_auth_request con 0x7f45c803aa90 auth_method 0 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f45e80af040 con 0x7f45f8088670 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 msgr2=0x7f45f8088a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 0x7f45f8088a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ac040 tx=0x7f45e8019330 comp rx=0 tx=0).stop 2026-02-22T21:00:09.648 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 msgr2=0x7f45f8088a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45deffd640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088670 0x7f45f8088a40 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ac040 tx=0x7f45e8019330 comp rx=0 tx=0).stop 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.612+0000 7f45fe8a2640 1 --2- 10.20.193.7:0/598886832 >> v2:10.20.193.61:6800/2336688312 conn(0x7f45c803aa90 0x7f45c805af40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45f4002a60 tx=0x7f45f4002f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 0x7f45f81908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.649 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f45f812b0d0 con 0x7f45f8088f80 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 0x7f45f81908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient: get_auth_request con 0x7f45f8088f80 auth_method 0 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.650 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 10 monclient(hunting): handle_auth_done global_id 124175 payload 824 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 1 -- 10.20.193.7:0/598886832 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f45f812d670 con 0x7f45f8088f80 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe0a1640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 0x7f45f81908c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f45e8002410 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80c53a0 con 0x7f45f8088f80 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.651 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 10 monclient: dump: 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.652 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4869 (secure 0 0 0) 0x7f45e80c0e20 con 0x7f45f8088f80 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 msgr2=0x7f45f81908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.653 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 0x7f45f81908c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f45e8002410 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2026-02-22T21:00:09.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 msgr2=0x7f45f81908c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:09.654 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45deffd640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f8088f80 0x7f45f81908c0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f45e8002410 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2026-02-22T21:00:09.654 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:09.654 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 68, 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 26811, 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T21:00:09.655 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.656 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.657 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.658 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.659 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:09.660 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T21:00:09.661 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.662 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.663 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.664 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:09.665 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 >> v2:10.20.193.61:6800/2336688312 conn(0x7f45c803aa90 msgr2=0x7f45c805af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 --2- 10.20.193.7:0/598886832 >> v2:10.20.193.61:6800/2336688312 conn(0x7f45c803aa90 0x7f45c805af40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45f4002a60 tx=0x7f45f4002f40 comp rx=0 tx=0).stop 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 10 monclient: shutdown 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 msgr2=0x7f45f812a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 --2- 10.20.193.7:0/598886832 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f45f813f290 0x7f45f812a650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009430 tx=0x7f45ec00ee10 comp rx=0 tx=0).stop 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe8a2640 1 -- 10.20.193.7:0/598886832 reap_dead start 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f45fe8a2640 1 -- 10.20.193.7:0/598886832 reap_dead start 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 shutdown_connections 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 >> 10.20.193.7:0/598886832 conn(0x7f45f8093df0 msgr2=0x7f45f8055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 shutdown_connections 2026-02-22T21:00:09.666 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.616+0000 7f460032c640 1 -- 10.20.193.7:0/598886832 wait complete. 2026-02-22T21:00:09.666 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T21:00:09.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-22T21:00:09.666 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T21:00:09.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: get_monmap_and_config 2026-02-22T21:00:09.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: build_initial_monmap 2026-02-22T21:00:09.726 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: monmap: 2026-02-22T21:00:09.726 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:09.725817+0000 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:09.725817+0000 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 Processor -- start 2026-02-22T21:00:09.727 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 -- start start 2026-02-22T21:00:09.728 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: init 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient: _add_conns ranks=[0,2,1,3,4] 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f23b4090980 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-b con 0x7f23b4088340 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f23b417e6f0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b408c320 con 0x7f23b4090980 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b408d1d0 con 0x7f23b417e6f0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2d76640 1 -- >> v1:10.20.193.7:6789/0 conn(0x7f23b4090980 legacy=0x7f23b4087c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.7:6789/0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f23b408cc60 con 0x7f23b4088340 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b9105640 10 monclient(hunting): authenticate will time out at 1022.198995s 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53264/0 (socket says 10.20.193.7:53264) 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 -- 10.20.193.7:0/1584805616 learned_addr learned my addr 10.20.193.7:0/1584805616 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): get_auth_request con 0x7f23b4088340 auth_method 0 2026-02-22T21:00:09.733 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient(hunting): handle_auth_done global_id 124178 payload 274 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 -- 10.20.193.7:0/1584805616 >> v1:10.20.193.61:6789/0 conn(0x7f23b417e6f0 legacy=0x7f23b419ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 -- 10.20.193.7:0/1584805616 >> v1:10.20.193.7:6789/0 conn(0x7f23b4090980 legacy=0x7f23b4087c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 monclient: found mon.noname-b 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.720+0000 7f23b2575640 1 -- 10.20.193.7:0/1584805616 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b408d840 con 0x7f23b4088340 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2575640 1 --2- 10.20.193.7:0/1584805616 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f239c009910 tx=0x7f239c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262fdb0d86ede4df server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 1 -- 10.20.193.7:0/1584805616 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0b0070 con 0x7f23b4088340 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: dump: 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.734 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 1 -- 10.20.193.7:0/1584805616 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c0ab600 con 0x7f23b4088340 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 1 -- 10.20.193.7:0/1584805616 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0ab9d0 con 0x7f23b4088340 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 5 monclient: authenticate success, global_id 124178 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 4 set_mon_vals no callback set 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1d74640 10 monclient: dump: 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.735 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: shutdown 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1584805616 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 msgr2=0x7f23b417e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- 10.20.193.7:0/1584805616 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f239c009910 tx=0x7f239c01c540 comp rx=0 tx=0).stop 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1584805616 shutdown_connections 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- 10.20.193.7:0/1584805616 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b4088340 0x7f23b417e1b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1584805616 >> 10.20.193.7:0/1584805616 conn(0x7f23b408e050 msgr2=0x7f23b408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1584805616 shutdown_connections 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1584805616 wait complete. 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: build_initial_monmap 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: monmap: 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 Processor -- start 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- start start 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: init 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b4088340 0x7f23b405d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-b con 0x7f23b4088340 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f23b4090980 0x7f23b405d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-a con 0x7f23b4090980 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 0x7f23b417df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): picked mon.noname-c con 0x7f23b417e6f0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23b41a2de0 con 0x7f23b4090980 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f23b41a2c60 con 0x7f23b4088340 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f23b41a2f60 con 0x7f23b417e6f0 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): authenticate will time out at 1022.203041s 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2575640 1 -- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f23b4090980 msgr2=0x7f23b405d860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.7:3300/0 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f23b4090980 0x7f23b405d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 0x7f23b417df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 0x7f23b417df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:53270/0 (socket says 10.20.193.7:53270) 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 learned_addr learned my addr 10.20.193.7:0/1728597326 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): get_auth_request con 0x7f23b417e6f0 auth_method 0 2026-02-22T21:00:09.737 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2d76640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b4088340 0x7f23b405d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2d76640 10 monclient(hunting): get_auth_request con 0x7f23b4088340 auth_method 0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient(hunting): handle_auth_done global_id 124181 payload 824 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b4088340 msgr2=0x7f23b405d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b4088340 0x7f23b405d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f23b4090980 msgr2=0x7f23b405d860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f23b4090980 0x7f23b405d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient: _finish_hunting 0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 monclient: found mon.noname-c 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b41385e0 con 0x7f23b417e6f0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b3577640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 0x7f23b417df80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23a400cb60 tx=0x7f23a400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4016030 con 0x7f23b417e6f0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: dump: 2026-02-22T21:00:09.738 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a400aae0 con 0x7f23b417e6f0 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4004a80 con 0x7f23b417e6f0 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23937fe640 10 monclient: dump: 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.739 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b1573640 4 set_mon_vals no callback set 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 5 monclient: authenticate success, global_id 124181 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _renew_subs 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b413a630 con 0x7f23b417e6f0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _renew_subs 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b4190550 con 0x7f23b417e6f0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 0x7f23b419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.724+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f23b4087c30 con 0x7f23b413c3a0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f23a4023060 con 0x7f23b417e6f0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 0x7f23b419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient: get_auth_request con 0x7f23b413c3a0 auth_method 0 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 --2- 10.20.193.7:0/1728597326 >> v2:10.20.193.61:6800/2336688312 conn(0x7f238003aa90 0x7f238005af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(271..271 src has 64..271) ==== 3503+0+0 (secure 0 0 0) 0x7f23a404eab0 con 0x7f23b417e6f0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2575640 1 --2- 10.20.193.7:0/1728597326 >> v2:10.20.193.61:6800/2336688312 conn(0x7f238003aa90 0x7f238005af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2575640 10 monclient: get_auth_request con 0x7f238003aa90 auth_method 0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 10 monclient(hunting): handle_auth_done global_id 114496 payload 824 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23b417e4c0 con 0x7f23b413c3a0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2d76640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 0x7f23b419f4b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23b2575640 1 --2- 10.20.193.7:0/1728597326 >> v2:10.20.193.61:6800/2336688312 conn(0x7f238003aa90 0x7f238005af40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f239c009690 tx=0x7f239c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8016030 con 0x7f23b413c3a0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 10 monclient: dump: 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7f23a800b700 con 0x7f23b413c3a0 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:09.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:09.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 msgr2=0x7f23b419f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 0x7f23b419f4b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a800db90 comp rx=0 tx=0).stop 2026-02-22T21:00:09.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 msgr2=0x7f23b419f4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:09.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.728+0000 7f23937fe640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b413c3a0 0x7f23b419f4b0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a800db90 comp rx=0 tx=0).stop 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 0x7f23b413aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f23b405fc00 con 0x7f23b419f9f0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 0x7f23b413aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient: get_auth_request con 0x7f23b419f9f0 auth_method 0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 10 monclient(hunting): handle_auth_done global_id 114499 payload 824 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 1 -- 10.20.193.7:0/1728597326 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23b408b200 con 0x7f23b419f9f0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b2d76640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 0x7f23b413aa00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a8003920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a801de60 con 0x7f23b419f9f0 2026-02-22T21:00:09.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 10 monclient: dump: 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5038 (secure 0 0 0) 0x7f23a801b740 con 0x7f23b419f9f0 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 msgr2=0x7f23b413aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 0x7f23b413aa00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a8003920 comp rx=0 tx=0).stop 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 msgr2=0x7f23b413aa00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23937fe640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f23b419f9f0 0x7f23b413aa00 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f23a8003a80 tx=0x7f23a8003920 comp rx=0 tx=0).stop 2026-02-22T21:00:09.744 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 68, 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 70919, 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.745 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T21:00:09.746 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:09.747 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.748 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T21:00:09.749 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:09.750 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "num": 7 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:09.751 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:09.752 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 >> v2:10.20.193.61:6800/2336688312 conn(0x7f238003aa90 msgr2=0x7f238005af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 --2- 10.20.193.7:0/1728597326 >> v2:10.20.193.61:6800/2336688312 conn(0x7f238003aa90 0x7f238005af40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f239c009690 tx=0x7f239c0a6000 comp rx=0 tx=0).stop 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 10 monclient: shutdown 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 msgr2=0x7f23b417df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 --2- 10.20.193.7:0/1728597326 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f23b417e6f0 0x7f23b417df80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23a400cb60 tx=0x7f23a400a430 comp rx=0 tx=0).stop 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 reap_dead start 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b3577640 1 -- 10.20.193.7:0/1728597326 reap_dead start 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 shutdown_connections 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 >> 10.20.193.7:0/1728597326 conn(0x7f23b408e050 msgr2=0x7f23b4084b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 shutdown_connections 2026-02-22T21:00:09.753 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:09.732+0000 7f23b9105640 1 -- 10.20.193.7:0/1728597326 wait complete. 2026-02-22T21:00:09.753 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-22T21:00:09.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: starting. 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22443 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: created object 0... 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: created object 25... 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: created object 49... 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: finishing. 2026-02-22T21:00:11.515 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22444]: shutting down. 2026-02-22T21:00:11.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:11.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:12.467 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22445]: starting. 2026-02-22T21:00:12.468 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22445]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22443 2026-02-22T21:00:12.468 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22445]: shutting down. 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: starting. 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22443 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: created object 0... 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: created object 25... 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: created object 49... 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: finishing. 2026-02-22T21:00:13.882 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22481]: shutting down. 2026-02-22T21:00:13.894 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:13.894 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: starting. 2026-02-22T21:00:13.895 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: listing objects. 2026-02-22T21:00:13.895 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: listed object 0... 2026-02-22T21:00:13.895 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: listed object 25... 2026-02-22T21:00:13.895 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: saw 50 objects 2026-02-22T21:00:13.895 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22483]: shutting down. 2026-02-22T21:00:14.834 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:14.834 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22482]: starting. 2026-02-22T21:00:14.834 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22482]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22443 2026-02-22T21:00:14.835 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22482]: shutting down. 2026-02-22T21:00:14.836 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:14.836 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:14.836 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:14.839 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:16.890 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: starting. 2026-02-22T21:00:16.890 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22535 2026-02-22T21:00:16.890 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: created object 0... 2026-02-22T21:00:16.890 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: created object 25... 2026-02-22T21:00:16.891 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: created object 49... 2026-02-22T21:00:16.891 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: finishing. 2026-02-22T21:00:16.891 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22536]: shutting down. 2026-02-22T21:00:16.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:16.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:17.843 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22537]: starting. 2026-02-22T21:00:17.843 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22537]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22535 2026-02-22T21:00:17.843 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22537]: shutting down. 2026-02-22T21:00:19.897 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: starting. 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22535 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: created object 0... 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: created object 25... 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: created object 49... 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: finishing. 2026-02-22T21:00:19.898 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22572]: shutting down. 2026-02-22T21:00:19.909 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:19.909 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: starting. 2026-02-22T21:00:19.909 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: listing objects. 2026-02-22T21:00:19.910 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: listed object 0... 2026-02-22T21:00:19.910 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: listed object 25... 2026-02-22T21:00:19.910 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: saw 50 objects 2026-02-22T21:00:19.910 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22574]: shutting down. 2026-02-22T21:00:20.853 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:20.853 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22573]: starting. 2026-02-22T21:00:20.853 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22573]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22535 2026-02-22T21:00:20.854 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22573]: shutting down. 2026-02-22T21:00:20.855 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:20.855 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:20.855 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:20.857 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:21.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:21.971 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:22.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: starting. 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22626 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: created object 0... 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: created object 25... 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: created object 49... 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: finishing. 2026-02-22T21:00:22.909 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22627]: shutting down. 2026-02-22T21:00:23.832 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22628]: starting. 2026-02-22T21:00:23.832 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22628]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22626 2026-02-22T21:00:23.832 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22628]: shutting down. 2026-02-22T21:00:25.887 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: starting. 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22626 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: created object 0... 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: created object 25... 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: created object 49... 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: finishing. 2026-02-22T21:00:25.888 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22663]: shutting down. 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: starting. 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: listing objects. 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: listed object 0... 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: listed object 25... 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: saw 50 objects 2026-02-22T21:00:25.899 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22665]: shutting down. 2026-02-22T21:00:26.837 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:26.837 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22664]: starting. 2026-02-22T21:00:26.837 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22664]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22626 2026-02-22T21:00:26.837 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22664]: shutting down. 2026-02-22T21:00:26.839 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:26.839 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:26.839 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:26.842 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:26.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:26.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:28.894 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: starting. 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22717 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: created object 0... 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: created object 25... 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: created object 49... 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: finishing. 2026-02-22T21:00:28.895 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22718]: shutting down. 2026-02-22T21:00:29.754 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-22T21:00:29.754 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T21:00:29.754 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T21:00:29.757 INFO:tasks.ceph.mon.a:Started 2026-02-22T21:00:29.757 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T21:00:29.757 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.811+0000 7f0fa7306640 10 monclient: get_monmap_and_config 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.811+0000 7f0fa7306640 10 monclient: build_initial_monmap 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.811+0000 7f0fa7306640 10 monclient: monmap: 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:29.815723+0000 2026-02-22T21:00:29.818 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:29.815723+0000 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 Processor -- start 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- start start 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: init 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0fa013cef0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-c con 0x7f0fa013d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0fa017e9a0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa005d510 con 0x7f0fa017e9a0 2026-02-22T21:00:29.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa008b800 con 0x7f0fa013cef0 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa008a720 con 0x7f0fa013d9d0 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): authenticate will time out at 1042.288638s 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f0fa017e9a0 0x7f0fa019ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:49584/0 (socket says 10.20.193.7:49584) 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 -- 10.20.193.7:0/1361262914 learned_addr learned my addr 10.20.193.7:0/1361262914 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 --2- 10.20.193.7:0/1361262914 >> v2:10.20.193.61:3300/0 conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): get_auth_request con 0x7f0fa013d9d0 auth_method 0 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:29.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_done global_id 114598 payload 274 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 -- 10.20.193.7:0/1361262914 >> v1:10.20.193.61:6789/0 conn(0x7f0fa013cef0 legacy=0x7f0fa013d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 -- 10.20.193.7:0/1361262914 >> v1:10.20.193.7:6789/0 conn(0x7f0fa017e9a0 legacy=0x7f0fa019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient: _finish_hunting 0 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 monclient: found mon.noname-c 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.61:3300/0 2026-02-22T21:00:29.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 -- 10.20.193.7:0/1361262914 --> v2:10.20.193.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa008aa00 con 0x7f0fa013d9d0 2026-02-22T21:00:29.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 --2- 10.20.193.7:0/1361262914 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f94004780 tx=0x7f0f9401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5b9e9348a517c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:29.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 1 -- 10.20.193.7:0/1361262914 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f940b1070 con 0x7f0fa013d9d0 2026-02-22T21:00:29.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:29.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:29.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: dump: 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: _finish_auth 0 2026-02-22T21:00:29.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 1 -- 10.20.193.7:0/1361262914 <== mon.1 v2:10.20.193.61:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f940a8050 con 0x7f0fa013d9d0 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 5 monclient: authenticate success, global_id 114598 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 1 -- 10.20.193.7:0/1361262914 <== mon.1 v2:10.20.193.61:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f940ac860 con 0x7f0fa013d9d0 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 4 set_mon_vals no callback set 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0f8ffff640 10 monclient: dump: 2026-02-22T21:00:29.831 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: shutdown 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:29.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- 10.20.193.7:0/1361262914 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013d9d0 msgr2=0x7f0fa017e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- 10.20.193.7:0/1361262914 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f94004780 tx=0x7f0f9401c4d0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- 10.20.193.7:0/1361262914 shutdown_connections 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- 10.20.193.7:0/1361262914 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- 10.20.193.7:0/1361262914 >> 10.20.193.7:0/1361262914 conn(0x7f0fa008f860 msgr2=0x7f0fa008fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- 10.20.193.7:0/1361262914 shutdown_connections 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- 10.20.193.7:0/1361262914 wait complete. 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: build_initial_monmap 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: monmap: 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:29.833 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 Processor -- start 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- start start 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: init 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T21:00:29.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013cef0 0x7f0fa018af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-b con 0x7f0fa013cef0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-c con 0x7f0fa013d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): picked mon.noname-a con 0x7f0fa017e9a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a3080 con 0x7f0fa017e9a0 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa01a2f00 con 0x7f0fa013cef0 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa01a3200 con 0x7f0fa013d9d0 2026-02-22T21:00:29.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa7306640 10 monclient(hunting): authenticate will time out at 1042.291855s 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48212/0 (socket says 10.20.193.7:48212) 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 1 -- 10.20.193.7:0/411217084 learned_addr learned my addr 10.20.193.7:0/411217084 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:50774/0 (socket says 10.20.193.7:50774) 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): get_auth_request con 0x7f0fa013d9d0 auth_method 0 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 10 monclient(hunting): get_auth_request con 0x7f0fa017e9a0 auth_method 0 2026-02-22T21:00:29.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa487a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 -- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 msgr2=0x7f0fa019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 -- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 msgr2=0x7f0fa019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.815+0000 7f0fa587c640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa587c640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 10 monclient(hunting): handle_auth_done global_id 124247 payload 824 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 -- 10.20.193.7:0/411217084 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013cef0 msgr2=0x7f0fa018af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013cef0 0x7f0fa018af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 -- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 msgr2=0x7f0fa019a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 10 monclient: _finish_hunting 0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 monclient: found mon.noname-c 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 -- 10.20.193.7:0/411217084 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa008c9c0 con 0x7f0fa013d9d0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa487a640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f9401a100 tx=0x7f0f94019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f940b1040 con 0x7f0fa013d9d0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: dump: 2026-02-22T21:00:29.838 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:29.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f940ba070 con 0x7f0fa013d9d0 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94003c50 con 0x7f0fa013d9d0 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: dump: 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:29.840 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 5 monclient: authenticate success, global_id 124247 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _renew_subs 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8f7fe640 4 set_mon_vals no callback set 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa0088270 con 0x7f0fa013d9d0 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _renew_subs 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:29.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa005c910 con 0x7f0fa013d9d0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa013c890 con 0x7f0fa013d9d0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f0f940b4070 con 0x7f0fa013d9d0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 --2- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 0x7f0f7005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(291..291 src has 64..291) ==== 3897+0+0 (secure 0 0 0) 0x7f0f940e84d0 con 0x7f0fa013d9d0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa507b640 1 --2- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 0x7f0f7005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa507b640 10 monclient: get_auth_request con 0x7f0f7003ab20 auth_method 0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0fa507b640 1 --2- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 0x7f0f7005afd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0f90002810 tx=0x7f0f90007ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f0f94016150 con 0x7f0fa013d9d0 2026-02-22T21:00:29.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:29.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.819+0000 7f0f8dffb640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:29.844 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22719]: starting. 2026-02-22T21:00:29.844 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22719]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22717 2026-02-22T21:00:29.844 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22719]: shutting down. 2026-02-22T21:00:29.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.931+0000 7f0fa7306640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:29.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.931+0000 7f0fa7306640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:29.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.931+0000 7f0fa7306640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:29.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.931+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0fa013b8f0 con 0x7f0fa013d9d0 2026-02-22T21:00:29.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0f8dffb640 1 -- 10.20.193.7:0/411217084 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f0f940b4e10 con 0x7f0fa013d9d0 2026-02-22T21:00:29.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0f8dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:29.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0f8dffb640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:29.937 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:29.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 msgr2=0x7f0f7005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 0x7f0f7005afd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0f90002810 tx=0x7f0f90007ad0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 10 monclient: shutdown 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 msgr2=0x7f0fa017e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f9401a100 tx=0x7f0f94019270 comp rx=0 tx=0).stop 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 shutdown_connections 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f0fa017e9a0 0x7f0fa019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f0fa013d9d0 0x7f0fa017e460 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> v2:10.20.193.61:6800/2336688312 conn(0x7f0f7003ab20 0x7f0f7005afd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 --2- 10.20.193.7:0/411217084 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f0fa013cef0 0x7f0fa018af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 >> 10.20.193.7:0/411217084 conn(0x7f0fa008f860 msgr2=0x7f0fa0058680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:29.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 shutdown_connections 2026-02-22T21:00:29.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:29.935+0000 7f0fa7306640 1 -- 10.20.193.7:0/411217084 wait complete. 2026-02-22T21:00:31.905 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: starting. 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22717 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: created object 0... 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: created object 25... 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: created object 49... 2026-02-22T21:00:31.906 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: finishing. 2026-02-22T21:00:31.907 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22754]: shutting down. 2026-02-22T21:00:31.916 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:31.916 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: starting. 2026-02-22T21:00:31.916 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: listing objects. 2026-02-22T21:00:31.917 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: listed object 0... 2026-02-22T21:00:31.917 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: listed object 25... 2026-02-22T21:00:31.917 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: saw 50 objects 2026-02-22T21:00:31.917 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22756]: shutting down. 2026-02-22T21:00:31.944 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:31.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:31.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:00:31.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:00:31.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:31.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:32.857 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:32.857 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22755]: starting. 2026-02-22T21:00:32.857 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22755]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22717 2026-02-22T21:00:32.857 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22755]: shutting down. 2026-02-22T21:00:32.859 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:32.859 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:32.859 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:32.861 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:32.950 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:33.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: get_monmap_and_config 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: build_initial_monmap 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: monmap: 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:33.010355+0000 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:33.010355+0000 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:33.013 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 Processor -- start 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 -- start start 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: init 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9cd413cef0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd413d9d0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd417e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd405d510 con 0x7f9cd413cef0 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd408ad70 con 0x7f9cd413d9d0 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd408b850 con 0x7f9cd417e9a0 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cdb23e640 10 monclient(hunting): authenticate will time out at 1045.483252s 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:50782/0 (socket says 10.20.193.7:50782) 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48246/0 (socket says 10.20.193.7:48246) 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 -- 10.20.193.7:0/3729435112 learned_addr learned my addr 10.20.193.7:0/3729435112 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd8fb3640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f9cd413cef0 0x7f9cd413d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:49590/0 (socket says 10.20.193.7:49590) 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 10 monclient(hunting): get_auth_request con 0x7f9cd413d9d0 auth_method 0 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): get_auth_request con 0x7f9cd417e9a0 auth_method 0 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:33.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 -- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 msgr2=0x7f9cd417e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 -- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 msgr2=0x7f9cd417e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient(hunting): handle_auth_done global_id 124268 payload 274 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 -- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 msgr2=0x7f9cd417e460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 --2- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 -- 10.20.193.7:0/3729435112 >> v1:10.20.193.7:6789/0 conn(0x7f9cd413cef0 legacy=0x7f9cd413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:33.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient: _finish_hunting 0 2026-02-22T21:00:33.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 monclient: found mon.noname-b 2026-02-22T21:00:33.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:33.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.007+0000 7f9cd97b4640 1 -- 10.20.193.7:0/3729435112 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd408a770 con 0x7f9cd417e9a0 2026-02-22T21:00:33.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd97b4640 1 --2- 10.20.193.7:0/3729435112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0004b00 tx=0x7f9cd001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c715630d809c30 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:33.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 1 -- 10.20.193.7:0/3729435112 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00b2070 con 0x7f9cd417e9a0 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: dump: 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.024 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 1 -- 10.20.193.7:0/3729435112 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd00a5800 con 0x7f9cd417e9a0 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 1 -- 10.20.193.7:0/3729435112 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00a5bf0 con 0x7f9cd417e9a0 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:33.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccb7fe640 10 monclient: dump: 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 5 monclient: authenticate success, global_id 124268 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 4 set_mon_vals no callback set 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: shutdown 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/3729435112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 msgr2=0x7f9cd419ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/3729435112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0004b00 tx=0x7f9cd001c830 comp rx=0 tx=0).stop 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/3729435112 shutdown_connections 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/3729435112 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd417e9a0 0x7f9cd419ed80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/3729435112 >> v2:10.20.193.7:3300/0 conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/3729435112 >> 10.20.193.7:0/3729435112 conn(0x7f9cd408f860 msgr2=0x7f9cd408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/3729435112 shutdown_connections 2026-02-22T21:00:33.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/3729435112 wait complete. 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: build_initial_monmap 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: monmap: 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:33.028 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 Processor -- start 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- start start 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: init 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd413cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd413d9d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 0x7f9cd412c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd417e9a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:33.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd41a1ec0 con 0x7f9cd413cef0 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd41a1d40 con 0x7f9cd417e9a0 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd41a2040 con 0x7f9cd413d9d0 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient(hunting): authenticate will time out at 1045.487032s 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:50796/0 (socket says 10.20.193.7:50796) 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 -- 10.20.193.7:0/207385270 learned_addr learned my addr 10.20.193.7:0/207385270 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 10 monclient(hunting): get_auth_request con 0x7f9cd413cef0 auth_method 0 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:33.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): get_auth_request con 0x7f9cd413d9d0 auth_method 0 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 -- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 msgr2=0x7f9cd412bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 -- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 msgr2=0x7f9cd412bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd8fb3640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:33.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient(hunting): handle_auth_done global_id 124271 payload 824 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd97b4640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 0x7f9cd412c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 -- 10.20.193.7:0/207385270 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 msgr2=0x7f9cd412c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 0x7f9cd412c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 -- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 msgr2=0x7f9cd412bf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient: _finish_hunting 0 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 monclient: found mon.noname-c 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 -- 10.20.193.7:0/207385270 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd4086620 con 0x7f9cd413d9d0 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd97b4640 10 monclient: get_auth_request con 0x7f9cd417e9a0 auth_method 0 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cd97b4640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 0x7f9cd412c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccbfff640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 0x7f9cd417e460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc004780 tx=0x7f9cbc00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc017020 con 0x7f9cd413d9d0 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: dump: 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.033 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc004230 con 0x7f9cd413d9d0 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 5 monclient: authenticate success, global_id 124271 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:33.034 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00f040 con 0x7f9cd413d9d0 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _renew_subs 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd4128470 con 0x7f9cd413d9d0 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9ccaffd640 4 set_mon_vals no callback set 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cc97fa640 10 monclient: dump: 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:33.035 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _renew_subs 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.011+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd418e5c0 con 0x7f9cd413d9d0 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cdb23e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cdb23e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cdb23e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd412a8e0 con 0x7f9cd413d9d0 2026-02-22T21:00:33.036 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9cbc012050 con 0x7f9cd413d9d0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cc97fa640 1 --2- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 0x7f9ca405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(295..295 src has 64..295) ==== 3503+0+0 (secure 0 0 0) 0x7f9cbc04e590 con 0x7f9cd413d9d0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cd8fb3640 1 --2- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 0x7f9ca405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cd8fb3640 10 monclient: get_auth_request con 0x7f9ca403ab20 auth_method 0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.015+0000 7f9cd8fb3640 1 --2- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 0x7f9ca405afd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4002770 tx=0x7f9cc4007e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.019+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f9cbc021020 con 0x7f9cd413d9d0 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.019+0000 7f9cc97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:33.037 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.019+0000 7f9cc97fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:33.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:33.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:33.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:33.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9cd40382a0 con 0x7f9cd413d9d0 2026-02-22T21:00:33.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cc97fa640 1 -- 10.20.193.7:0/207385270 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f9cbc023300 con 0x7f9cd413d9d0 2026-02-22T21:00:33.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cc97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:33.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cc97fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:33.135 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:33.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 msgr2=0x7f9ca405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:33.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 0x7f9ca405afd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4002770 tx=0x7f9cc4007e00 comp rx=0 tx=0).stop 2026-02-22T21:00:33.136 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 10 monclient: shutdown 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 msgr2=0x7f9cd417e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 0x7f9cd417e460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc004780 tx=0x7f9cbc00ecf0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 shutdown_connections 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> v2:10.20.193.61:6800/2336688312 conn(0x7f9ca403ab20 0x7f9ca405afd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f9cd417e9a0 0x7f9cd412c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f9cd413d9d0 0x7f9cd417e460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 --2- 10.20.193.7:0/207385270 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f9cd413cef0 0x7f9cd412bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 >> 10.20.193.7:0/207385270 conn(0x7f9cd408f860 msgr2=0x7f9cd405b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 shutdown_connections 2026-02-22T21:00:33.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:33.131+0000 7f9cdb23e640 1 -- 10.20.193.7:0/207385270 wait complete. 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: starting. 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22808 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: created object 0... 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: created object 25... 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: created object 49... 2026-02-22T21:00:34.889 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: finishing. 2026-02-22T21:00:34.890 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22809]: shutting down. 2026-02-22T21:00:35.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22810]: starting. 2026-02-22T21:00:35.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22810]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22808 2026-02-22T21:00:35.840 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22810]: shutting down. 2026-02-22T21:00:36.145 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: get_monmap_and_config 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: build_initial_monmap 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: monmap: 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:36.217 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:36.214539+0000 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:36.214539+0000 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 Processor -- start 2026-02-22T21:00:36.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 -- start start 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: init 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-a con 0x7ff0cc13cef0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-b con 0x7ff0cc13d800 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 0x7ff0cc13a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-c con 0x7ff0cc13a110 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7ff0cc08ad70 con 0x7ff0cc13cef0 2026-02-22T21:00:36.219 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7ff0cc05d510 con 0x7ff0cc13a110 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc08b800 con 0x7ff0cc13d800 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0d09f3640 10 monclient(hunting): authenticate will time out at 1048.687396s 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:50802/0 (socket says 10.20.193.7:50802) 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 -- 10.20.193.7:0/1898180661 learned_addr learned my addr 10.20.193.7:0/1898180661 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48272/0 (socket says 10.20.193.7:48272) 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 10 monclient(hunting): get_auth_request con 0x7ff0cc13cef0 auth_method 0 2026-02-22T21:00:36.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): get_auth_request con 0x7ff0cc13d800 auth_method 0 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 0x7ff0cc13a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 -- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 msgr2=0x7ff0cc13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 10 monclient(hunting): get_auth_request con 0x7ff0cc13a110 auth_method 0 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 -- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 msgr2=0x7ff0cc13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0ca575640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient(hunting): handle_auth_done global_id 124286 payload 274 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 -- 10.20.193.7:0/1898180661 >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 msgr2=0x7ff0cc13a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 0x7ff0cc13a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 -- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 msgr2=0x7ff0cc13d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient: _finish_hunting 0 2026-02-22T21:00:36.222 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 monclient: found mon.noname-b 2026-02-22T21:00:36.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:36.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0c9d74640 1 -- 10.20.193.7:0/1898180661 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc08a720 con 0x7ff0cc13d800 2026-02-22T21:00:36.223 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.211+0000 7ff0cad76640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 0x7ff0cc13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 --2- 10.20.193.7:0/1898180661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc053810 tx=0x7ff0b401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91eff335f8d350d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 1 -- 10.20.193.7:0/1898180661 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40b0070 con 0x7ff0cc13d800 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: dump: 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:36.229 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: _finish_auth 0 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: _check_auth_tickets 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:36.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 1 -- 10.20.193.7:0/1898180661 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b40ab600 con 0x7ff0cc13d800 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 1 -- 10.20.193.7:0/1898180661 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ab9d0 con 0x7ff0cc13d800 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 5 monclient: authenticate success, global_id 124286 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 4 set_mon_vals no callback set 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9573640 10 monclient: dump: 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:36.231 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: shutdown 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- 10.20.193.7:0/1898180661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 msgr2=0x7ff0cc139bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:36.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/1898180661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc053810 tx=0x7ff0b401c3d0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- 10.20.193.7:0/1898180661 shutdown_connections 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.61:3300/0 conn(0x7ff0cc13a110 0x7ff0cc13a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/1898180661 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc139bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/1898180661 >> v2:10.20.193.7:3300/0 conn(0x7ff0cc13cef0 0x7ff0cc13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- 10.20.193.7:0/1898180661 >> 10.20.193.7:0/1898180661 conn(0x7ff0cc08f860 msgr2=0x7ff0cc08fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- 10.20.193.7:0/1898180661 shutdown_connections 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- 10.20.193.7:0/1898180661 wait complete. 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: build_initial_monmap 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: monmap: 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:36.233 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 Processor -- start 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- start start 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: init 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:36.234 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 0x7ff0cc12ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-b con 0x7ff0cc13a110 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-a con 0x7ff0cc13cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): picked mon.noname-c con 0x7ff0cc13d800 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc088fa0 con 0x7ff0cc13cef0 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc088e20 con 0x7ff0cc13a110 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc1a0c90 con 0x7ff0cc13d800 2026-02-22T21:00:36.235 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0d09f3640 10 monclient(hunting): authenticate will time out at 1048.691579s 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:48284/0 (socket says 10.20.193.7:48284) 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 -- 10.20.193.7:0/3447154305 learned_addr learned my addr 10.20.193.7:0/3447154305 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): get_auth_request con 0x7ff0cc13d800 auth_method 0 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 10 monclient(hunting): get_auth_request con 0x7ff0cc13cef0 auth_method 0 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.236 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 0x7ff0cc12ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 -- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 msgr2=0x7ff0cc11f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 -- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 msgr2=0x7ff0cc11f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 10 monclient(hunting): get_auth_request con 0x7ff0cc13a110 auth_method 0 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:36.237 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0c9d74640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient(hunting): handle_auth_done global_id 124289 payload 824 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 -- 10.20.193.7:0/3447154305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 msgr2=0x7ff0cc12ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 0x7ff0cc12ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 -- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 msgr2=0x7ff0cc11f610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient: _finish_hunting 0 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 monclient: found mon.noname-c 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0cad76640 1 -- 10.20.193.7:0/3447154305 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc13c340 con 0x7ff0cc13d800 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.215+0000 7ff0ca575640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 0x7ff0cc12ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T21:00:36.238 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0cad76640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc007ee0 tx=0x7ff0bc00d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc01a070 con 0x7ff0cc13d800 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: dump: 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:36.239 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc00de50 con 0x7ff0cc13d800 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc004030 con 0x7ff0cc13d800 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 5 monclient: authenticate success, global_id 124289 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _renew_subs 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0c8d72640 4 set_mon_vals no callback set 2026-02-22T21:00:36.240 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc086620 con 0x7ff0cc13d800 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 10 monclient: dump: 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:36.241 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _renew_subs 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc105fb0 con 0x7ff0cc13d800 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc13d2c0 con 0x7ff0cc13d800 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7ff0bc0041d0 con 0x7ff0cc13d800 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 --2- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 0x7ff09805afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:36.242 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(298..298 src has 64..298) ==== 3503+0+0 (secure 0 0 0) 0x7ff0bc04eda0 con 0x7ff0cc13d800 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0ca575640 1 --2- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 0x7ff09805afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0ca575640 10 monclient: get_auth_request con 0x7ff09803ab10 auth_method 0 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.219+0000 7ff0ca575640 1 --2- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 0x7ff09805afc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006d80 tx=0x7ff0c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.223+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7ff0bc010070 con 0x7ff0cc13d800 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.223+0000 7ff0b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:36.243 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.223+0000 7ff0b2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff0cc05fc00 con 0x7ff0cc13d800 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0b2ffd640 1 -- 10.20.193.7:0/3447154305 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7ff0bc019170 con 0x7ff0cc13d800 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:36.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0b2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:36.336 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 msgr2=0x7ff09805afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 0x7ff09805afc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006d80 tx=0x7ff0c0008040 comp rx=0 tx=0).stop 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 10 monclient: shutdown 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 msgr2=0x7ff0cc11fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc007ee0 tx=0x7ff0bc00d4a0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 shutdown_connections 2026-02-22T21:00:36.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7ff0cc13d800 0x7ff0cc11fb50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7ff0cc13cef0 0x7ff0cc11f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> v2:10.20.193.61:6800/2336688312 conn(0x7ff09803ab10 0x7ff09805afc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 --2- 10.20.193.7:0/3447154305 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7ff0cc13a110 0x7ff0cc12ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 >> 10.20.193.7:0/3447154305 conn(0x7ff0cc08f860 msgr2=0x7ff0cc13abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 shutdown_connections 2026-02-22T21:00:36.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:36.331+0000 7ff0d09f3640 1 -- 10.20.193.7:0/3447154305 wait complete. 2026-02-22T21:00:36.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:36.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:38.075 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: starting. 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22808 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: created object 0... 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: created object 25... 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: created object 49... 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: finishing. 2026-02-22T21:00:38.076 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22845]: shutting down. 2026-02-22T21:00:38.086 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:38.086 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: starting. 2026-02-22T21:00:38.086 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: listing objects. 2026-02-22T21:00:38.086 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: listed object 0... 2026-02-22T21:00:38.087 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: listed object 25... 2026-02-22T21:00:38.087 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: saw 50 objects 2026-02-22T21:00:38.087 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22847]: shutting down. 2026-02-22T21:00:38.849 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:38.849 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22846]: starting. 2026-02-22T21:00:38.849 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22846]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22808 2026-02-22T21:00:38.849 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22846]: shutting down. 2026-02-22T21:00:38.851 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:38.851 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:38.851 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:38.854 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:39.346 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:39.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: get_monmap_and_config 2026-02-22T21:00:39.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: build_initial_monmap 2026-02-22T21:00:39.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: monmap: 2026-02-22T21:00:39.424 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:39.414734+0000 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:39.414734+0000 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:39.425 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 Processor -- start 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 -- start start 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: init 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient: _add_conns ranks=[0,3,1,2,4] 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f900c091c70 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 0x7f900c1808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-a con 0x7f900c1604e0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f900c180e00 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:39.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f900c08e6a0 con 0x7f900c091c70 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f900c08e910 con 0x7f900c180e00 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f900c08ebf0 con 0x7f900c1604e0 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f9011a68640 10 monclient(hunting): authenticate will time out at 1051.887741s 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 0x7f900c1808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900affd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f900c091c70 0x7f900c092040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:54350/0 (socket says 10.20.193.7:54350) 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900affd640 1 -- 10.20.193.7:0/963310461 learned_addr learned my addr 10.20.193.7:0/963310461 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 10 monclient(hunting): get_auth_request con 0x7f900c1604e0 auth_method 0 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 1 -- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 msgr2=0x7f900c1808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 1 -- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 msgr2=0x7f900c1808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.411+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 0x7f900c1808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 0x7f900c1808c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883781291 0 0) 0x7f900c08e910 con 0x7f900c180e00 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): my global_id is 114673 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff8003620 con 0x7f900c180e00 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.1 v1:10.20.193.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1769451835 0 0) 0x7f8ff8003620 con 0x7f900c180e00 2026-02-22T21:00:39.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 msgr2=0x7f900c1808c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 --2- 10.20.193.7:0/963310461 >> v2:10.20.193.7:3300/0 conn(0x7f900c1604e0 0x7f900c1808c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 >> v1:10.20.193.7:6789/0 conn(0x7f900c091c70 legacy=0x7f900c092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 monclient: found mon.noname-c-legacy 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.61:6789/0 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 --> v1:10.20.193.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900c08eed0 con 0x7f900c180e00 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.1 v1:10.20.193.61:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f8ffc0031e0 con 0x7f900c180e00 2026-02-22T21:00:39.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: dump: 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:39.430 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] but i'm connected to v1:10.20.193.61:6789/0, reconnecting 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 >> v1:10.20.193.61:6789/0 conn(0x7f900c180e00 legacy=0x7f900c1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8ff8003bc0 0x7f8ff8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): picked mon.c con 0x7f8ff8003bc0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 0x7f8ff8004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): picked mon.a con 0x7f8ff80048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80054d0 0x7f8ff8065b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): picked mon.b con 0x7f8ff80054d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:39.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f900c08ebf0 con 0x7f8ff80048d0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8066410 con 0x7f8ff80054d0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff8066610 con 0x7f8ff8003bc0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 0x7f8ff8004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): get_auth_request con 0x7f8ff80048d0 auth_method 0 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8ff8003bc0 0x7f8ff8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): get_auth_request con 0x7f8ff8003bc0 auth_method 0 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80054d0 0x7f8ff8065b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 10 monclient(hunting): get_auth_request con 0x7f8ff80054d0 auth_method 0 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient(hunting): handle_auth_done global_id 114673 payload 293 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 -- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8ff8003bc0 msgr2=0x7f8ff8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8ff8003bc0 0x7f8ff8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 -- 10.20.193.7:0/963310461 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80054d0 msgr2=0x7f8ff8065b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80054d0 0x7f8ff8065b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient: _finish_hunting 0 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 monclient: found mon.a 2026-02-22T21:00:39.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 -- 10.20.193.7:0/963310461 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff8003620 con 0x7f8ff80048d0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900b7fe640 1 -- 10.20.193.7:0/963310461 reap_dead start 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 5 monclient: authenticate success, global_id 114673 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f900a7fc640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 0x7f8ff8004d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097f0 tx=0x7f8ff401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273552029e61a7bd server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff400f040 con 0x7f8ff80048d0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:39.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: dump: 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff40a9610 con 0x7f8ff80048d0 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 1 -- 10.20.193.7:0/963310461 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40a9a00 con 0x7f8ff80048d0 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 4 set_mon_vals no callback set 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9009ffb640 10 monclient: dump: 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.437 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 10 monclient: shutdown 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 msgr2=0x7f8ff8004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 0x7f8ff8004d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097f0 tx=0x7f8ff401c5f0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- 10.20.193.7:0/963310461 shutdown_connections 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 --2- 10.20.193.7:0/963310461 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8ff80048d0 0x7f8ff8004d40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- 10.20.193.7:0/963310461 >> 10.20.193.7:0/963310461 conn(0x7f900c093d80 msgr2=0x7f900c090280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- 10.20.193.7:0/963310461 shutdown_connections 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- 10.20.193.7:0/963310461 wait complete. 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 10 monclient: build_initial_monmap 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 10 monclient: monmap: 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:39.439 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 Processor -- start 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 1 -- start start 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.415+0000 7f9011a68640 10 monclient: init 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80048d0 0x7f900c143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-b con 0x7f8ff80048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-a con 0x7f900c1435b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:39.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): picked mon.noname-c con 0x7f900c12fe40 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f900c13f9c0 con 0x7f900c1435b0 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f900c13fb40 con 0x7f8ff80048d0 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f900c13fcc0 con 0x7f900c12fe40 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient(hunting): authenticate will time out at 1051.892318s 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46022/0 (socket says 10.20.193.7:46022) 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34408/0 (socket says 10.20.193.7:34408) 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 -- 10.20.193.7:0/982050910 learned_addr learned my addr 10.20.193.7:0/982050910 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 10 monclient(hunting): get_auth_request con 0x7f900c1435b0 auth_method 0 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): get_auth_request con 0x7f900c12fe40 auth_method 0 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80048d0 0x7f900c143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:39.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 -- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 msgr2=0x7f900c143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 -- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 msgr2=0x7f900c143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): get_auth_request con 0x7f8ff80048d0 auth_method 0 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900a7fc640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:39.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient(hunting): handle_auth_done global_id 124304 payload 824 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 -- 10.20.193.7:0/982050910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80048d0 msgr2=0x7f900c143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80048d0 0x7f900c143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 -- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 msgr2=0x7f900c143a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 monclient: found mon.noname-c 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 -- 10.20.193.7:0/982050910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900c146d50 con 0x7f900c12fe40 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900b7fe640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f900c092b90 tx=0x7f8ffc00ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc019070 con 0x7f900c12fe40 2026-02-22T21:00:39.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: dump: 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: _finish_auth 0 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc003bd0 con 0x7f900c12fe40 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0050d0 con 0x7f900c12fe40 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f90097fa640 4 set_mon_vals no callback set 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 10 monclient: dump: 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:39.446 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 5 monclient: authenticate success, global_id 124304 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _renew_subs 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900c13de80 con 0x7f900c12fe40 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _renew_subs 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f900c1449f0 con 0x7f900c12fe40 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:39.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900c1424e0 con 0x7f900c12fe40 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8ffc005270 con 0x7f900c12fe40 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 --2- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 0x7f8fdc05afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(301..301 src has 64..301) ==== 3503+0+0 (secure 0 0 0) 0x7f8ffc04de00 con 0x7f900c12fe40 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 1 --2- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 0x7f8fdc05afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 10 monclient: get_auth_request con 0x7f8fdc03ab10 auth_method 0 2026-02-22T21:00:39.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.419+0000 7f900affd640 1 --2- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 0x7f8fdc05afc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f900c03b270 tx=0x7f9000007e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:39.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.423+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f8ffc0133e0 con 0x7f900c12fe40 2026-02-22T21:00:39.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.423+0000 7f8fe3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:39.449 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.423+0000 7f8fe3fff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:39.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.531+0000 7f9011a68640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:39.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.531+0000 7f9011a68640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:39.536 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.531+0000 7f9011a68640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:39.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.531+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f900c092890 con 0x7f900c12fe40 2026-02-22T21:00:39.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f8fe3fff640 1 -- 10.20.193.7:0/982050910 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f8ffc00bd70 con 0x7f900c12fe40 2026-02-22T21:00:39.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f8fe3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:39.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f8fe3fff640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:39.537 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":30,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:39.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 msgr2=0x7f8fdc05afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 0x7f8fdc05afc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f900c03b270 tx=0x7f9000007e60 comp rx=0 tx=0).stop 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 10 monclient: shutdown 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 msgr2=0x7f900c130270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f900c092b90 tx=0x7f8ffc00ec20 comp rx=0 tx=0).stop 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 shutdown_connections 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f900c12fe40 0x7f900c130270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f900c1435b0 0x7f900c143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8fdc03ab10 0x7f8fdc05afc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.539 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 --2- 10.20.193.7:0/982050910 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8ff80048d0 0x7f900c143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:39.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 >> 10.20.193.7:0/982050910 conn(0x7f900c093d80 msgr2=0x7f900c08b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:39.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 shutdown_connections 2026-02-22T21:00:39.540 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:39.535+0000 7f9011a68640 1 -- 10.20.193.7:0/982050910 wait complete. 2026-02-22T21:00:40.907 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: starting. 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22899 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: created object 0... 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: created object 25... 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: created object 49... 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: finishing. 2026-02-22T21:00:40.908 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22900]: shutting down. 2026-02-22T21:00:41.859 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22901]: starting. 2026-02-22T21:00:41.859 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22901]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22899 2026-02-22T21:00:41.859 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22901]: shutting down. 2026-02-22T21:00:41.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:41.972 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:42.547 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:42.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: get_monmap_and_config 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: build_initial_monmap 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: monmap: 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:42.617941+0000 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:42.617941+0000 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:42.619 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 Processor -- start 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 -- start start 2026-02-22T21:00:42.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: init 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feb9813cef0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-a con 0x7feb9813d9d0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb9819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-b con 0x7feb9817e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9805d510 con 0x7feb9813cef0 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7feb9808ad70 con 0x7feb9813d9d0 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7feb9808b850 con 0x7feb9817e9a0 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb9d3b5640 10 monclient(hunting): authenticate will time out at 1055.091083s 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb96ffd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7feb9813cef0 0x7feb9813d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:54362/0 (socket says 10.20.193.7:54362) 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb96ffd640 1 -- 10.20.193.7:0/3743894853 learned_addr learned my addr 10.20.193.7:0/3743894853 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 --2- 10.20.193.7:0/3743894853 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb9819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 1 --2- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:42.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): get_auth_request con 0x7feb9817e9a0 auth_method 0 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 10 monclient(hunting): get_auth_request con 0x7feb9813d9d0 auth_method 0 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 1 -- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 msgr2=0x7feb9817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-22T21:00:42.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 1 -- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 msgr2=0x7feb9817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 1 --2- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb967fc640 1 --2- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient(hunting): handle_auth_done global_id 124310 payload 274 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 -- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 msgr2=0x7feb9817e460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 --2- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 -- 10.20.193.7:0/3743894853 >> v1:10.20.193.7:6789/0 conn(0x7feb9813cef0 legacy=0x7feb9813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 monclient: found mon.noname-b 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.615+0000 7feb977fe640 1 -- 10.20.193.7:0/3743894853 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9808a770 con 0x7feb9817e9a0 2026-02-22T21:00:42.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 --2- 10.20.193.7:0/3743894853 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb9819ed80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb88004b00 tx=0x7feb8801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b7fd8e25ef0f6d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 1 -- 10.20.193.7:0/3743894853 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880b2070 con 0x7feb9817e9a0 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: dump: 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:42.632 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 1 -- 10.20.193.7:0/3743894853 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb880a5800 con 0x7feb9817e9a0 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 5 monclient: authenticate success, global_id 124310 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 4 set_mon_vals no callback set 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 1 -- 10.20.193.7:0/3743894853 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5bf0 con 0x7feb9817e9a0 2026-02-22T21:00:42.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb95ffb640 10 monclient: dump: 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:42.634 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: shutdown 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/3743894853 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 msgr2=0x7feb9819ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/3743894853 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb9819ed80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb88004b00 tx=0x7feb8801c830 comp rx=0 tx=0).stop 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/3743894853 shutdown_connections 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/3743894853 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb9819ed80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/3743894853 >> v2:10.20.193.7:3300/0 conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/3743894853 >> 10.20.193.7:0/3743894853 conn(0x7feb9808f860 msgr2=0x7feb9808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/3743894853 shutdown_connections 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/3743894853 wait complete. 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: build_initial_monmap 2026-02-22T21:00:42.635 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: monmap: 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.636 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 Processor -- start 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- start start 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: init 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-a con 0x7feb9813cef0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-b con 0x7feb9813d9d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb98127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.637 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): picked mon.noname-c con 0x7feb9817e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb981a1ec0 con 0x7feb9813cef0 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7feb981a1d40 con 0x7feb9813d9d0 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7feb981a2040 con 0x7feb9817e9a0 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient(hunting): authenticate will time out at 1055.095214s 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb98127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46038/0 (socket says 10.20.193.7:46038) 2026-02-22T21:00:42.638 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 -- 10.20.193.7:0/2334136606 learned_addr learned my addr 10.20.193.7:0/2334136606 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 10 monclient(hunting): get_auth_request con 0x7feb9813cef0 auth_method 0 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): get_auth_request con 0x7feb9817e9a0 auth_method 0 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 -- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 msgr2=0x7feb9810ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-22T21:00:42.639 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 -- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 msgr2=0x7feb9810ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb96ffd640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient(hunting): handle_auth_done global_id 124313 payload 824 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 -- 10.20.193.7:0/2334136606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feb9813d9d0 msgr2=0x7feb9817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 -- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 msgr2=0x7feb9810ae20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 monclient: found mon.noname-c 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:42.640 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 -- 10.20.193.7:0/2334136606 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9810c620 con 0x7feb9817e9a0 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb977fe640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb98127c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb8801a460 tx=0x7feb880195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880b2040 con 0x7feb9817e9a0 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: dump: 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:42.641 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb880bb070 con 0x7feb9817e9a0 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5db0 con 0x7feb9817e9a0 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:42.642 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb777fe640 10 monclient: dump: 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb957fa640 4 set_mon_vals no callback set 2026-02-22T21:00:42.643 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 5 monclient: authenticate success, global_id 124313 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _renew_subs 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9810b7b0 con 0x7feb9817e9a0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _renew_subs 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.619+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9810bd80 con 0x7feb9817e9a0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb9d3b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb9d3b5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb9d3b5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7feb880b5070 con 0x7feb9817e9a0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb980382a0 con 0x7feb9817e9a0 2026-02-22T21:00:42.644 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb777fe640 1 --2- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 0x7feb6405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(304..304 src has 64..304) ==== 3503+0+0 (secure 0 0 0) 0x7feb880e8af0 con 0x7feb9817e9a0 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb96ffd640 1 --2- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 0x7feb6405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb96ffd640 10 monclient: get_auth_request con 0x7feb6403ab10 auth_method 0 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.623+0000 7feb96ffd640 1 --2- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 0x7feb6405afc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feb8c002770 tx=0x7feb8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.627+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7feb88016540 con 0x7feb9817e9a0 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.627+0000 7feb777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:42.645 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.627+0000 7feb777fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:42.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb9d3b5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:42.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb9d3b5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:42.740 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb9d3b5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:42.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb9805c540 con 0x7feb9817e9a0 2026-02-22T21:00:42.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb777fe640 1 -- 10.20.193.7:0/2334136606 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7feb880a9690 con 0x7feb9817e9a0 2026-02-22T21:00:42.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:42.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.735+0000 7feb777fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:42.741 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":33,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 msgr2=0x7feb6405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 0x7feb6405afc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feb8c002770 tx=0x7feb8c009040 comp rx=0 tx=0).stop 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 10 monclient: shutdown 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 msgr2=0x7feb98127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb98127c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb8801a460 tx=0x7feb880195d0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 shutdown_connections 2026-02-22T21:00:42.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7feb9817e9a0 0x7feb98127c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> v2:10.20.193.61:6800/2336688312 conn(0x7feb6403ab10 0x7feb6405afc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7feb9813d9d0 0x7feb9817e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 --2- 10.20.193.7:0/2334136606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7feb9813cef0 0x7feb9810ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 >> 10.20.193.7:0/2334136606 conn(0x7feb9808f860 msgr2=0x7feb9805cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 shutdown_connections 2026-02-22T21:00:42.744 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:42.739+0000 7feb9d3b5640 1 -- 10.20.193.7:0/2334136606 wait complete. 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: starting. 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22899 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: created object 0... 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: created object 25... 2026-02-22T21:00:43.886 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: created object 49... 2026-02-22T21:00:43.887 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: finishing. 2026-02-22T21:00:43.887 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[22936]: shutting down. 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: starting. 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: listing objects. 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: listed object 0... 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: listed object 25... 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: saw 50 objects 2026-02-22T21:00:43.897 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[22938]: shutting down. 2026-02-22T21:00:44.838 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:44.839 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22937]: starting. 2026-02-22T21:00:44.839 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22937]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22899 2026-02-22T21:00:44.839 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[22937]: shutting down. 2026-02-22T21:00:44.841 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:44.841 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:44.841 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:44.844 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-22T21:00:45.751 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:45.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: get_monmap_and_config 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: build_initial_monmap 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: monmap: 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:45.821191+0000 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:45.821191+0000 2026-02-22T21:00:45.822 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 Processor -- start 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 -- start start 2026-02-22T21:00:45.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: init 2026-02-22T21:00:45.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-b con 0x7f271413f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2714055a70 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-a con 0x7f27140565b0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2714091820 con 0x7f2714055a70 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:45.834 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f271413f110 con 0x7f27140565b0 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f2714087300 con 0x7f271413f780 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27199c3640 10 monclient(hunting): authenticate will time out at 1058.294382s 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:34444/0 (socket says 10.20.193.7:34444) 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 -- 10.20.193.7:0/3885118357 learned_addr learned my addr 10.20.193.7:0/3885118357 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): get_auth_request con 0x7f271413f780 auth_method 0 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:45.835 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 1 --2- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 10 monclient(hunting): get_auth_request con 0x7f27140565b0 auth_method 0 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 1 -- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 msgr2=0x7f27141a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-22T21:00:45.836 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 1 -- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 msgr2=0x7f27141a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 1 --2- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27191c2640 1 --2- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient(hunting): handle_auth_done global_id 124322 payload 274 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 -- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 msgr2=0x7f27141a1450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 --2- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 -- 10.20.193.7:0/3885118357 >> v1:10.20.193.7:6789/0 conn(0x7f2714055a70 legacy=0x7f2714055ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient: _finish_hunting 0 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 monclient: found mon.noname-b 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:45.837 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.819+0000 7f27189c1640 1 -- 10.20.193.7:0/3885118357 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2714091b00 con 0x7f271413f780 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27189c1640 1 --2- 10.20.193.7:0/3885118357 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27040090a0 tx=0x7f270401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a4baaa052398f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 1 -- 10.20.193.7:0/3885118357 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27040aa680 con 0x7f271413f780 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: dump: 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.838 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 1 -- 10.20.193.7:0/3885118357 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040af070 con 0x7f271413f780 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 5 monclient: authenticate success, global_id 124322 2026-02-22T21:00:45.839 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 1 -- 10.20.193.7:0/3885118357 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27040aaa40 con 0x7f271413f780 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270b7fe640 10 monclient: dump: 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:45.840 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 4 set_mon_vals no callback set 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: shutdown 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:45.841 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/3885118357 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 msgr2=0x7f271413fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- 10.20.193.7:0/3885118357 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27040090a0 tx=0x7f270401c500 comp rx=0 tx=0).stop 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/3885118357 shutdown_connections 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- 10.20.193.7:0/3885118357 >> v2:10.20.193.7:3300/0 conn(0x7f27140565b0 0x7f27141a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- 10.20.193.7:0/3885118357 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271413fb50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/3885118357 >> 10.20.193.7:0/3885118357 conn(0x7f27140906f0 msgr2=0x7f2714090af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/3885118357 shutdown_connections 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/3885118357 wait complete. 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: build_initial_monmap 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: monmap: 2026-02-22T21:00:45.842 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 Processor -- start 2026-02-22T21:00:45.843 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- start start 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: init 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2714055a70 0x7f271412c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-b con 0x7f2714055a70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-a con 0x7f27140565b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271412d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): picked mon.noname-c con 0x7f271413f780 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27141a4540 con 0x7f27140565b0 2026-02-22T21:00:45.844 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f27141a43c0 con 0x7f2714055a70 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f27141a46c0 con 0x7f271413f780 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient(hunting): authenticate will time out at 1058.298430s 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:46070/0 (socket says 10.20.193.7:46070) 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 -- 10.20.193.7:0/2948905632 learned_addr learned my addr 10.20.193.7:0/2948905632 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 10 monclient(hunting): get_auth_request con 0x7f27140565b0 auth_method 0 2026-02-22T21:00:45.845 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271412d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): get_auth_request con 0x7f271413f780 auth_method 0 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 -- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 msgr2=0x7f271412cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 -- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 msgr2=0x7f271412cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:45.846 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270bfff640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient(hunting): handle_auth_done global_id 124325 payload 824 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 -- 10.20.193.7:0/2948905632 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2714055a70 msgr2=0x7f271412c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2714055a70 0x7f271412c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 -- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 msgr2=0x7f271412cea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.847 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient: _finish_hunting 0 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 monclient: found mon.noname-c 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 -- 10.20.193.7:0/2948905632 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27141303b0 con 0x7f271413f780 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27191c2640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271412d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2710004b00 tx=0x7f271000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271000edd0 con 0x7f271413f780 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: dump: 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:45.848 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2710003a90 con 0x7f271413f780 2026-02-22T21:00:45.849 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2710004020 con 0x7f271413f780 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 10 monclient: dump: 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:45.850 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f270affd640 4 set_mon_vals no callback set 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 5 monclient: authenticate success, global_id 124325 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _renew_subs 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2714130690 con 0x7f271413f780 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _renew_subs 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f271408a9e0 con 0x7f271413f780 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:45.851 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271413fb50 con 0x7f271413f780 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f27100041c0 con 0x7f271413f780 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 --2- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 0x7f26e405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.823+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(307..307 src has 64..307) ==== 3503+0+0 (secure 0 0 0) 0x7f271004e840 con 0x7f271413f780 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27189c1640 1 --2- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 0x7f26e405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27189c1640 10 monclient: get_auth_request con 0x7f26e403ab20 auth_method 0 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27189c1640 1 --2- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 0x7f26e405afd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2704004780 tx=0x7f2704004820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f2710022060 con 0x7f271413f780 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:45.852 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.827+0000 7f27097fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:45.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:45.942 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f271412e330 con 0x7f271413f780 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27097fa640 1 -- 10.20.193.7:0/2948905632 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f271000bb10 con 0x7f271413f780 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27097fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27097fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:45.943 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":36,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 msgr2=0x7f26e405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 0x7f26e405afd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2704004780 tx=0x7f2704004820 comp rx=0 tx=0).stop 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 10 monclient: shutdown 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 msgr2=0x7f271412d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271412d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2710004b00 tx=0x7f271000e4b0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 shutdown_connections 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f271413f780 0x7f271412d3e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f27140565b0 0x7f271412cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.945 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> v2:10.20.193.61:6800/2336688312 conn(0x7f26e403ab20 0x7f26e405afd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 --2- 10.20.193.7:0/2948905632 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f2714055a70 0x7f271412c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:45.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 >> 10.20.193.7:0/2948905632 conn(0x7f27140906f0 msgr2=0x7f271408f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:45.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 shutdown_connections 2026-02-22T21:00:45.946 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:45.939+0000 7f27199c3640 1 -- 10.20.193.7:0/2948905632 wait complete. 2026-02-22T21:00:46.925 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: starting. 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22990 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: created object 0... 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: created object 25... 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: created object 49... 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: finishing. 2026-02-22T21:00:46.926 INFO:teuthology.orchestra.run.trial061.stdout:process_1_[22991]: shutting down. 2026-02-22T21:00:46.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:46.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:47.876 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22992]: starting. 2026-02-22T21:00:47.876 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22992]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22990 2026-02-22T21:00:47.876 INFO:teuthology.orchestra.run.trial061.stdout:process_2_[22992]: shutting down. 2026-02-22T21:00:48.954 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:49.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: get_monmap_and_config 2026-02-22T21:00:49.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: build_initial_monmap 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: monmap: 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:49.013296+0000 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:49.013296+0000 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:49.014 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:49.015 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:49.015 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 Processor -- start 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 -- start start 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: init 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd3d8056910 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:49.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-b con 0x7fd3d8057750 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3d81809c0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d808c0c0 con 0x7fd3d81809c0 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d808c300 con 0x7fd3d8056910 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d8057b50 con 0x7fd3d8057750 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3dc82c640 10 monclient(hunting): authenticate will time out at 1061.486525s 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51152/0 (socket says 10.20.193.7:51152) 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d7577640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd3d81809c0 0x7fd3d81a0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53306/0 (socket says 10.20.193.7:53306) 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 -- 10.20.193.7:0/1079471397 learned_addr learned my addr 10.20.193.7:0/1079471397 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): get_auth_request con 0x7fd3d8057750 auth_method 0 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:49.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient(hunting): handle_auth_done global_id 124343 payload 274 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 -- 10.20.193.7:0/1079471397 >> v1:10.20.193.61:6789/0 conn(0x7fd3d8056910 legacy=0x7fd3d8057040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 -- 10.20.193.7:0/1079471397 >> v1:10.20.193.7:6789/0 conn(0x7fd3d81809c0 legacy=0x7fd3d81a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient: _finish_hunting 0 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 monclient: found mon.noname-b 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.011+0000 7fd3d6575640 1 -- 10.20.193.7:0/1079471397 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d808d820 con 0x7fd3d8057750 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 --2- 10.20.193.7:0/1079471397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009910 tx=0x7fd3c001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cff3b9d9d703e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 1 -- 10.20.193.7:0/1079471397 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00ab650 con 0x7fd3d8057750 2026-02-22T21:00:49.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: dump: 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: _finish_auth 0 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: _check_auth_tickets 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:49.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 1 -- 10.20.193.7:0/1079471397 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c00b0070 con 0x7fd3d8057750 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 1 -- 10.20.193.7:0/1079471397 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00aba10 con 0x7fd3d8057750 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5d74640 10 monclient: dump: 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 5 monclient: authenticate success, global_id 124343 2026-02-22T21:00:49.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 4 set_mon_vals no callback set 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: shutdown 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/1079471397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 msgr2=0x7fd3d8180480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/1079471397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009910 tx=0x7fd3c001c540 comp rx=0 tx=0).stop 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/1079471397 shutdown_connections 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/1079471397 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8057750 0x7fd3d8180480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/1079471397 >> 10.20.193.7:0/1079471397 conn(0x7fd3d808dfc0 msgr2=0x7fd3d808e390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/1079471397 shutdown_connections 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/1079471397 wait complete. 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: build_initial_monmap 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: monmap: 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:49.026 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 Processor -- start 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- start start 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: init 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-c con 0x7fd3d8056910 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-a con 0x7fd3d8057750 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3d81809c0 0x7fd3d8121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:49.027 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): picked mon.noname-b con 0x7fd3d81809c0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d805dfd0 con 0x7fd3d8057750 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d81a5110 con 0x7fd3d81809c0 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d81a4f90 con 0x7fd3d8056910 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient(hunting): authenticate will time out at 1061.490678s 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51160/0 (socket says 10.20.193.7:51160) 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 -- 10.20.193.7:0/995770262 learned_addr learned my addr 10.20.193.7:0/995770262 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): get_auth_request con 0x7fd3d8056910 auth_method 0 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 10 monclient(hunting): get_auth_request con 0x7fd3d8057750 auth_method 0 2026-02-22T21:00:49.028 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 -- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 msgr2=0x7fd3d8121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 -- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 msgr2=0x7fd3d8121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6575640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d7577640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3d81809c0 0x7fd3d8121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d7577640 10 monclient(hunting): get_auth_request con 0x7fd3d81809c0 auth_method 0 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d7577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d7577640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d7577640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient(hunting): handle_auth_done global_id 124346 payload 824 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 -- 10.20.193.7:0/995770262 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3d81809c0 msgr2=0x7fd3d8121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3d81809c0 0x7fd3d8121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.029 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 -- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 msgr2=0x7fd3d8121440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient: _finish_hunting 0 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 monclient: found mon.noname-c 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 -- 10.20.193.7:0/995770262 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d80904b0 con 0x7fd3d8056910 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d6d76640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00c520 tx=0x7fd3cc00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc017070 con 0x7fd3d8056910 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: dump: 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:49.030 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc006ad0 con 0x7fd3d8056910 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc007030 con 0x7fd3d8056910 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 5 monclient: authenticate success, global_id 124346 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _renew_subs 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d8125060 con 0x7fd3d8056910 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3d5573640 4 set_mon_vals no callback set 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 10 monclient: dump: 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:49.031 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _renew_subs 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d8123e20 con 0x7fd3d8056910 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d8090de0 con 0x7fd3d8056910 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd3cc005080 con 0x7fd3d8056910 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 --2- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 0x7fd3a405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.015+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(311..311 src has 64..311) ==== 3897+0+0 (secure 0 0 0) 0x7fd3cc04de40 con 0x7fd3d8056910 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3d6575640 1 --2- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 0x7fd3a405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3d6575640 10 monclient: get_auth_request con 0x7fd3a403ab20 auth_method 0 2026-02-22T21:00:49.032 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3d6575640 1 --2- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 0x7fd3a405afd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0002410 tx=0x7fd3c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:49.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fd3cc0144a0 con 0x7fd3d8056910 2026-02-22T21:00:49.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:49.033 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.019+0000 7fd3b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:49.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:49.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:49.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:49.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd3d8125710 con 0x7fd3d8056910 2026-02-22T21:00:49.137 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3b77fe640 1 -- 10.20.193.7:0/995770262 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7fd3cc04cbf0 con 0x7fd3d8056910 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":39,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 msgr2=0x7fd3a405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 0x7fd3a405afd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0002410 tx=0x7fd3c00a7000 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 10 monclient: shutdown 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 msgr2=0x7fd3d8120f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00c520 tx=0x7fd3cc00c9e0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 shutdown_connections 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd3a403ab20 0x7fd3a405afd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd3d81809c0 0x7fd3d8121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd3d8057750 0x7fd3d8121440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 --2- 10.20.193.7:0/995770262 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd3d8056910 0x7fd3d8120f00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 >> 10.20.193.7:0/995770262 conn(0x7fd3d808dfc0 msgr2=0x7fd3d808a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 shutdown_connections 2026-02-22T21:00:49.138 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:49.135+0000 7fd3dc82c640 1 -- 10.20.193.7:0/995770262 wait complete. 2026-02-22T21:00:49.935 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:49.935 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: starting. 2026-02-22T21:00:49.935 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: creating pool ceph_test_rados_delete_pools_parallel.trial061-22990 2026-02-22T21:00:49.935 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: created object 0... 2026-02-22T21:00:49.935 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: created object 25... 2026-02-22T21:00:49.936 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: created object 49... 2026-02-22T21:00:49.936 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: finishing. 2026-02-22T21:00:49.936 INFO:teuthology.orchestra.run.trial061.stdout:process_3_[23027]: shutting down. 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: starting. 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: listing objects. 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: listed object 0... 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: listed object 25... 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: saw 50 objects 2026-02-22T21:00:49.946 INFO:teuthology.orchestra.run.trial061.stdout:process_5_[23029]: shutting down. 2026-02-22T21:00:50.890 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:50.891 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[23028]: starting. 2026-02-22T21:00:50.891 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[23028]: deleting pool ceph_test_rados_delete_pools_parallel.trial061-22990 2026-02-22T21:00:50.891 INFO:teuthology.orchestra.run.trial061.stdout:process_4_[23028]: shutting down. 2026-02-22T21:00:50.892 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:50.892 INFO:teuthology.orchestra.run.trial061.stdout:******************************* 2026-02-22T21:00:50.893 INFO:teuthology.orchestra.run.trial061.stdout:******* SUCCESS ********** 2026-02-22T21:00:50.895 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-22T21:00:50.909 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-22T21:00:51.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:51.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:52.148 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: get_monmap_and_config 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: build_initial_monmap 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: monmap: 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:52.218 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:52.218438+0000 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:52.218438+0000 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:52.219 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 Processor -- start 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 -- start start 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: init 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f75d413cef0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f75d413d9d0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 0x7f75d419ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-b con 0x7f75d417fb80 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:52.220 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d405d510 con 0x7f75d413d9d0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d408b800 con 0x7f75d413cef0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f75d408a720 con 0x7f75d417fb80 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75db09b640 10 monclient(hunting): authenticate will time out at 1064.691698s 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75cbfff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f75d413d9d0 0x7f75d417e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53308/0 (socket says 10.20.193.7:53308) 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75cbfff640 1 -- 10.20.193.7:0/1281996861 learned_addr learned my addr 10.20.193.7:0/1281996861 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 1 --2- 10.20.193.7:0/1281996861 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 0x7f75d419ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): get_auth_request con 0x7f75d417fb80 auth_method 0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.215+0000 7f75d9611640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient(hunting): handle_auth_done global_id 124349 payload 274 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 -- 10.20.193.7:0/1281996861 >> v1:10.20.193.61:6789/0 conn(0x7f75d413cef0 legacy=0x7f75d413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 -- 10.20.193.7:0/1281996861 >> v1:10.20.193.7:6789/0 conn(0x7f75d413d9d0 legacy=0x7f75d417e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient: _finish_hunting 0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 monclient: found mon.noname-b 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.221 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 -- 10.20.193.7:0/1281996861 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d408aa00 con 0x7f75d417fb80 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 --2- 10.20.193.7:0/1281996861 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 0x7f75d419ff60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75d408f260 tx=0x7f75d001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09b98692bfb924a server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 1 -- 10.20.193.7:0/1281996861 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00b2070 con 0x7f75d417fb80 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: dump: 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:52.225 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 1 -- 10.20.193.7:0/1281996861 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d00a5820 con 0x7f75d417fb80 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 5 monclient: authenticate success, global_id 124349 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 1 -- 10.20.193.7:0/1281996861 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00a5c10 con 0x7f75d417fb80 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 4 set_mon_vals no callback set 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cb7fe640 10 monclient: dump: 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: shutdown 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/1281996861 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 msgr2=0x7f75d419ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.226 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 --2- 10.20.193.7:0/1281996861 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 0x7f75d419ff60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75d408f260 tx=0x7f75d001c850 comp rx=0 tx=0).stop 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/1281996861 shutdown_connections 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 --2- 10.20.193.7:0/1281996861 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d417fb80 0x7f75d419ff60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/1281996861 >> 10.20.193.7:0/1281996861 conn(0x7f75d408f860 msgr2=0x7f75d408fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/1281996861 shutdown_connections 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/1281996861 wait complete. 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: build_initial_monmap 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: monmap: 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 Processor -- start 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- start start 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: init 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:52.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-c con 0x7f75d413cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f75d413d9d0 0x7f75d412d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-b con 0x7f75d413d9d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): picked mon.noname-a con 0x7f75d417fb80 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f75d41a30a0 con 0x7f75d417fb80 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f75d41a2f20 con 0x7f75d413d9d0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f75d41a3220 con 0x7f75d413cef0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient(hunting): authenticate will time out at 1064.695388s 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51182/0 (socket says 10.20.193.7:51182) 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 -- 10.20.193.7:0/3645816462 learned_addr learned my addr 10.20.193.7:0/3645816462 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): get_auth_request con 0x7f75d413cef0 auth_method 0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient(hunting): get_auth_request con 0x7f75d417fb80 auth_method 0 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:52.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 -- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 msgr2=0x7f75d4126df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 -- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 msgr2=0x7f75d4126df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cbfff640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f75d413d9d0 0x7f75d412d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d9611640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cbfff640 10 monclient(hunting): get_auth_request con 0x7f75d413d9d0 auth_method 0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient(hunting): handle_auth_done global_id 124352 payload 824 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 -- 10.20.193.7:0/3645816462 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f75d413d9d0 msgr2=0x7f75d412d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f75d413d9d0 0x7f75d412d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 -- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 msgr2=0x7f75d4126df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient: _finish_hunting 0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 monclient: found mon.noname-c 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 -- 10.20.193.7:0/3645816462 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d4088390 con 0x7f75d413cef0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75d8e10640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c520 tx=0x7f75c400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:52.229 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4017070 con 0x7f75d413cef0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: dump: 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4006ad0 con 0x7f75d413cef0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007030 con 0x7f75d413cef0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75c97fa640 10 monclient: dump: 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:52.230 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75caffd640 4 set_mon_vals no callback set 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 5 monclient: authenticate success, global_id 124352 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _renew_subs 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d41287c0 con 0x7f75d413cef0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _renew_subs 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.219+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d412a280 con 0x7f75d413cef0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75db09b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75db09b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75db09b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f75c4005080 con 0x7f75d413cef0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d413d2c0 con 0x7f75d413cef0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 1 --2- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 0x7f75a405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(313..313 src has 64..313) ==== 3503+0+0 (secure 0 0 0) 0x7f75c404dcb0 con 0x7f75d413cef0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75cbfff640 1 --2- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 0x7f75a405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:52.231 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75cbfff640 10 monclient: get_auth_request con 0x7f75a403ab20 auth_method 0 2026-02-22T21:00:52.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75cbfff640 1 --2- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 0x7f75a405afd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f75d412a150 tx=0x7f75bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:52.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f75c40144a0 con 0x7f75d413cef0 2026-02-22T21:00:52.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:52.232 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.223+0000 7f75c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:52.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:52.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:52.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:52.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f75d405fc00 con 0x7f75d413cef0 2026-02-22T21:00:52.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75c97fa640 1 -- 10.20.193.7:0/3645816462 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1606 (secure 0 0 0) 0x7f75c404cbf0 con 0x7f75d413cef0 2026-02-22T21:00:52.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:52.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:52.339 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":42,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 msgr2=0x7f75a405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 0x7f75a405afd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f75d412a150 tx=0x7f75bc009040 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 10 monclient: shutdown 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 msgr2=0x7f75d412d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c520 tx=0x7f75c400c9e0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 shutdown_connections 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f75d417fb80 0x7f75d4126df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> v2:10.20.193.61:6800/2336688312 conn(0x7f75a403ab20 0x7f75a405afd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f75d413d9d0 0x7f75d412d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 --2- 10.20.193.7:0/3645816462 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f75d413cef0 0x7f75d412d3e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 >> 10.20.193.7:0/3645816462 conn(0x7f75d408f860 msgr2=0x7f75d4087c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 shutdown_connections 2026-02-22T21:00:52.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:52.335+0000 7f75db09b640 1 -- 10.20.193.7:0/3645816462 wait complete. 2026-02-22T21:00:55.349 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: get_monmap_and_config 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: monmap: 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:55.415039+0000 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:55.415039+0000 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:55.415 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.416 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 Processor -- start 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 -- start start 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: init 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1e2813cef0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-c con 0x7f1e2813d9d0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-b con 0x7f1e2817e9a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2805d510 con 0x7f1e2813cef0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f1e2808ad70 con 0x7f1e2813d9d0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2808b850 con 0x7f1e2817e9a0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.411+0000 7f1e2ce14640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): authenticate will time out at 1067.888011s 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51210/0 (socket says 10.20.193.7:51210) 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 -- 10.20.193.7:0/1526890598 learned_addr learned my addr 10.20.193.7:0/1526890598 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): get_auth_request con 0x7f1e2817e9a0 auth_method 0 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.417 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 1 --2- 10.20.193.7:0/1526890598 >> v2:10.20.193.61:3300/0 conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): get_auth_request con 0x7f1e2813d9d0 auth_method 0 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_done global_id 124355 payload 274 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 -- 10.20.193.7:0/1526890598 >> v2:10.20.193.61:3300/0 conn(0x7f1e2813d9d0 msgr2=0x7f1e2817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- 10.20.193.7:0/1526890598 >> v2:10.20.193.61:3300/0 conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 -- 10.20.193.7:0/1526890598 >> v1:10.20.193.61:6789/0 conn(0x7f1e2813cef0 legacy=0x7f1e2813d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 monclient: found mon.noname-b 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.418 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 -- 10.20.193.7:0/1526890598 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2808a770 con 0x7f1e2817e9a0 2026-02-22T21:00:55.421 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- 10.20.193.7:0/1526890598 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e2808bf00 tx=0x7f1e1801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556da7d44e959f27 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 1 -- 10.20.193.7:0/1526890598 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180b2070 con 0x7f1e2817e9a0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: dump: 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 1 -- 10.20.193.7:0/1526890598 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e180a5800 con 0x7f1e2817e9a0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 1 -- 10.20.193.7:0/1526890598 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180a5bf0 con 0x7f1e2817e9a0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.422 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25573640 10 monclient: dump: 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 5 monclient: authenticate success, global_id 124355 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 4 set_mon_vals no callback set 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: shutdown 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/1526890598 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 msgr2=0x7f1e2819ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/1526890598 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e2808bf00 tx=0x7f1e1801c8b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/1526890598 shutdown_connections 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/1526890598 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2817e9a0 0x7f1e2819ed80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/1526890598 >> v2:10.20.193.61:3300/0 conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/1526890598 >> 10.20.193.7:0/1526890598 conn(0x7f1e2808f860 msgr2=0x7f1e2808fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/1526890598 shutdown_connections 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/1526890598 wait complete. 2026-02-22T21:00:55.423 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: monmap: 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 Processor -- start 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- start start 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: init 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-c con 0x7f1e2813cef0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-b con 0x7f1e2813d9d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 0x7f1e28127940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): picked mon.noname-a con 0x7f1e2817e9a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281a1ec0 con 0x7f1e2817e9a0 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281a1d40 con 0x7f1e2813d9d0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f1e281a2040 con 0x7f1e2813cef0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient(hunting): authenticate will time out at 1067.890846s 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51222/0 (socket says 10.20.193.7:51222) 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 -- 10.20.193.7:0/4276801713 learned_addr learned my addr 10.20.193.7:0/4276801713 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): get_auth_request con 0x7f1e2813cef0 auth_method 0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 0x7f1e28127940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): get_auth_request con 0x7f1e2817e9a0 auth_method 0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): get_auth_request con 0x7f1e2813d9d0 auth_method 0 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e25d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient(hunting): handle_auth_done global_id 124358 payload 824 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 -- 10.20.193.7:0/4276801713 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1e2813d9d0 msgr2=0x7f1e2817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 -- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 msgr2=0x7f1e28127940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 0x7f1e28127940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 monclient: found mon.noname-c 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 -- 10.20.193.7:0/4276801713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2810c2b0 con 0x7f1e2813cef0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26d76640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 0x7f1e28127940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e26575640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c520 tx=0x7f1e1c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c017070 con 0x7f1e2813cef0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: dump: 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.426 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c006ad0 con 0x7f1e2813cef0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 5 monclient: authenticate success, global_id 124358 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _renew_subs 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2810b440 con 0x7f1e2813cef0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c007030 con 0x7f1e2813cef0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 10 monclient: dump: 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.427 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e24d72640 4 set_mon_vals no callback set 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _renew_subs 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e28109870 con 0x7f1e2813cef0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f1e1c0071d0 con 0x7f1e2813cef0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e280382a0 con 0x7f1e2813cef0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.415+0000 7f1e0effd640 1 --2- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 0x7f1df405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f1e1c04ddf0 con 0x7f1e2813cef0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e25d74640 1 --2- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 0x7f1df405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e25d74640 10 monclient: get_auth_request con 0x7f1df403ab10 auth_method 0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e25d74640 1 --2- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 0x7f1df405afc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1e2812a910 tx=0x7f1e10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f1e1c01a360 con 0x7f1e2813cef0 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.428 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.419+0000 7f1e0effd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e2ce14640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e2ce14640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e2ce14640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1e2805fc00 con 0x7f1e2813cef0 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e0effd640 1 -- 10.20.193.7:0/4276801713 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f1e1c04ae20 con 0x7f1e2813cef0 2026-02-22T21:00:55.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.527+0000 7f1e0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e0effd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 msgr2=0x7f1df405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 0x7f1df405afc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1e2812a910 tx=0x7f1e10008040 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 10 monclient: shutdown 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 msgr2=0x7f1e2810aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c520 tx=0x7f1e1c00c9e0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 shutdown_connections 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f1e2817e9a0 0x7f1e28127940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> v2:10.20.193.61:6800/2336688312 conn(0x7f1df403ab10 0x7f1df405afc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f1e2813d9d0 0x7f1e2817e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 --2- 10.20.193.7:0/4276801713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f1e2813cef0 0x7f1e2810aab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 >> 10.20.193.7:0/4276801713 conn(0x7f1e2808f860 msgr2=0x7f1e28058630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 shutdown_connections 2026-02-22T21:00:55.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.531+0000 7f1e2ce14640 1 -- 10.20.193.7:0/4276801713 wait complete. 2026-02-22T21:00:55.541 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T21:00:55.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-22T21:00:55.541 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: get_monmap_and_config 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: monmap: 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:55.609918+0000 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:55.609918+0000 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:55.610 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 Processor -- start 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 -- start start 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: init 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient: _add_conns ranks=[3,2,4,0,1] 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf0808b590 0x7fbf08139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-a con 0x7fbf0808b590 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-b con 0x7fbf0813a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fbf0813d530 0x7fbf0813d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-c con 0x7fbf0813d530 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0808ab40 con 0x7fbf0808b590 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fbf08089920 con 0x7fbf0813d530 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0808a860 con 0x7fbf0813a4d0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf0cd94640 10 monclient(hunting): authenticate will time out at 1068.083195s 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbf0808b590 0x7fbf08139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51234/0 (socket says 10.20.193.7:51234) 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 -- 10.20.193.7:0/3280918671 learned_addr learned my addr 10.20.193.7:0/3280918671 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): get_auth_request con 0x7fbf0813a4d0 auth_method 0 2026-02-22T21:00:55.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): get_auth_request con 0x7fbf0808b590 auth_method 0 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06d76640 1 --2- 10.20.193.7:0/3280918671 >> v2:10.20.193.61:3300/0 conn(0x7fbf0813d530 0x7fbf0813d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06d76640 10 monclient(hunting): get_auth_request con 0x7fbf0813d530 auth_method 0 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf06d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient(hunting): handle_auth_done global_id 124361 payload 274 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 -- 10.20.193.7:0/3280918671 >> v2:10.20.193.61:3300/0 conn(0x7fbf0813d530 msgr2=0x7fbf0813d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3280918671 >> v2:10.20.193.61:3300/0 conn(0x7fbf0813d530 0x7fbf0813d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 -- 10.20.193.7:0/3280918671 >> v2:10.20.193.7:3300/0 conn(0x7fbf0808b590 msgr2=0x7fbf08139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3280918671 >> v2:10.20.193.7:3300/0 conn(0x7fbf0808b590 0x7fbf08139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 monclient: found mon.noname-b 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.607+0000 7fbf05d74640 1 -- 10.20.193.7:0/3280918671 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf08089170 con 0x7fbf0813a4d0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3280918671 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf080573b0 tx=0x7fbef001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c40b4b0c72c3364 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 1 -- 10.20.193.7:0/3280918671 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b1070 con 0x7fbf0813a4d0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: dump: 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 1 -- 10.20.193.7:0/3280918671 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef00ac450 con 0x7fbf0813a4d0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 1 -- 10.20.193.7:0/3280918671 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00ac820 con 0x7fbf0813a4d0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05573640 10 monclient: dump: 2026-02-22T21:00:55.616 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 5 monclient: authenticate success, global_id 124361 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 4 set_mon_vals no callback set 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: shutdown 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3280918671 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 msgr2=0x7fbf0813cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3280918671 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf080573b0 tx=0x7fbef001c4e0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3280918671 shutdown_connections 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3280918671 >> v2:10.20.193.61:3300/0 conn(0x7fbf0813d530 0x7fbf0813d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3280918671 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf0813cff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3280918671 >> v2:10.20.193.7:3300/0 conn(0x7fbf0808b590 0x7fbf08139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3280918671 >> 10.20.193.7:0/3280918671 conn(0x7fbf0808faa0 msgr2=0x7fbf0808bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3280918671 shutdown_connections 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3280918671 wait complete. 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: monmap: 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:55.617 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 Processor -- start 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- start start 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: init 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf0808b590 0x7fbf080869d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-a con 0x7fbf0808b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf08086f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-c con 0x7fbf0813a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf0813d530 0x7fbf08087450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): picked mon.noname-b con 0x7fbf0813d530 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf081a0f30 con 0x7fbf0808b590 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbf081a0db0 con 0x7fbf0813d530 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbf081a10b0 con 0x7fbf0813a4d0 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): authenticate will time out at 1068.086727s 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf0808b590 0x7fbf080869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf08086f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf0808b590 0x7fbf080869d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57316/0 (socket says 10.20.193.7:57316) 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 -- 10.20.193.7:0/3117743919 learned_addr learned my addr 10.20.193.7:0/3117743919 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): get_auth_request con 0x7fbf0808b590 auth_method 0 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): get_auth_request con 0x7fbf0813a4d0 auth_method 0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient(hunting): handle_auth_done global_id 124364 payload 824 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf0813d530 msgr2=0x7fbf08087450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbf0813d530 0x7fbf08087450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf0808b590 msgr2=0x7fbf080869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf0808b590 0x7fbf080869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 monclient: found mon.noname-c 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0808e9d0 con 0x7fbf0813a4d0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf05d74640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf08086f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf080573b0 tx=0x7fbef0019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b9020 con 0x7fbf0813a4d0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: dump: 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.619 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef00acd90 con 0x7fbf0813a4d0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 5 monclient: authenticate success, global_id 124364 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _renew_subs 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0810bd00 con 0x7fbf0813a4d0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b1040 con 0x7fbf0813a4d0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 10 monclient: dump: 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf04d72640 4 set_mon_vals no callback set 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _renew_subs 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0810ba20 con 0x7fbf0813a4d0 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 0x7fbf080588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0808e480 con 0x7fbf08087990 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 0x7fbf080588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient: get_auth_request con 0x7fbf08087990 auth_method 0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 10 monclient(hunting): handle_auth_done global_id 134106 payload 824 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf080382a0 con 0x7fbf08087990 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbf06575640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 0x7fbf080588d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009430 tx=0x7fbefc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.611+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbef00b4070 con 0x7fbf0813a4d0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 --2- 10.20.193.7:0/3117743919 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbed403aad0 0x7fbed405af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fbef00e72d0 con 0x7fbf0813a4d0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc019070 con 0x7fbf08087990 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: dump: 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fbefc004030 con 0x7fbf08087990 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:55.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 msgr2=0x7fbf080588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 0x7fbf080588d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009430 tx=0x7fbefc00f610 comp rx=0 tx=0).stop 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 msgr2=0x7fbf080588d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08087990 0x7fbf080588d0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009430 tx=0x7fbefc00f610 comp rx=0 tx=0).stop 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06d76640 1 --2- 10.20.193.7:0/3117743919 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbed403aad0 0x7fbed405af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06d76640 10 monclient: get_auth_request con 0x7fbed403aad0 auth_method 0 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06d76640 1 --2- 10.20.193.7:0/3117743919 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbed403aad0 0x7fbed405af80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009540 tx=0x7fbef8009450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf0cd94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 0x7fbf08059210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf0cd94640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810abb0 con 0x7fbf08058e10 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 0x7fbf08059210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient: get_auth_request con 0x7fbf08058e10 auth_method 0 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 10 monclient(hunting): handle_auth_done global_id 134109 payload 824 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 1 -- 10.20.193.7:0/3117743919 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf0813cf70 con 0x7fbf08058e10 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbf06575640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 0x7fbf08059210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbefc002410 tx=0x7fbefc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc019040 con 0x7fbf08058e10 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.615+0000 7fbeeeffd640 10 monclient: dump: 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 <== mon.0 v2:10.20.193.7:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4715 (secure 0 0 0) 0x7fbefc01e450 con 0x7fbf08058e10 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 msgr2=0x7fbf08059210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 0x7fbf08059210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbefc002410 tx=0x7fbefc0047b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 msgr2=0x7fbf08059210 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbeeeffd640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbf08058e10 0x7fbf08059210 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbefc002410 tx=0x7fbefc0047b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "state": "leader", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 72, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 25819, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.624 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T21:00:55.625 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.626 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.627 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.628 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbed403aad0 msgr2=0x7fbed405af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3117743919 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbed403aad0 0x7fbed405af80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009540 tx=0x7fbef8009450 comp rx=0 tx=0).stop 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 10 monclient: shutdown 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 msgr2=0x7fbf08086f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 --2- 10.20.193.7:0/3117743919 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbf0813a4d0 0x7fbf08086f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf080573b0 tx=0x7fbef0019280 comp rx=0 tx=0).stop 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf06d76640 1 -- 10.20.193.7:0/3117743919 reap_dead start 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf06d76640 1 -- 10.20.193.7:0/3117743919 reap_dead start 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 shutdown_connections 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 >> 10.20.193.7:0/3117743919 conn(0x7fbf0808faa0 msgr2=0x7fbf0808d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 shutdown_connections 2026-02-22T21:00:55.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.619+0000 7fbf0cd94640 1 -- 10.20.193.7:0/3117743919 wait complete. 2026-02-22T21:00:55.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T21:00:55.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-22T21:00:55.630 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: get_monmap_and_config 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: monmap: 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:55.698800+0000 2026-02-22T21:00:55.699 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:55.698800+0000 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 Processor -- start 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 -- start start 2026-02-22T21:00:55.700 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: init 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient: _add_conns ranks=[1,4,3,0,2] 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd44408c7a0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd444090b70 0x7fd4441806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-c con 0x7fd444090b70 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:55.709 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd444090f70 0x7fd4441a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-a con 0x7fd444090f70 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44408d840 con 0x7fd44408c7a0 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd44408db20 con 0x7fd444090f70 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440851e0 con 0x7fd444090b70 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44be48640 10 monclient(hunting): authenticate will time out at 1068.171877s 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.695+0000 7fd44a3be640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd444090f70 0x7fd4441a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd444090f70 0x7fd4441a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57348/0 (socket says 10.20.193.7:57348) 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/3927567762 learned_addr learned my addr 10.20.193.7:0/3927567762 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 1 --1- >> v1:10.20.193.61:6789/0 conn(0x7fd44408c7a0 0x7fd444090460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.61:6789/0 says I am v1:10.20.193.7:54302/0 (socket says 10.20.193.7:54302) 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): get_auth_request con 0x7fd444090f70 auth_method 0 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.710 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 1 --2- 10.20.193.7:0/3927567762 >> v2:10.20.193.61:3300/0 conn(0x7fd444090b70 0x7fd4441806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): get_auth_request con 0x7fd444090b70 auth_method 0 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_done global_id 134112 payload 274 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/3927567762 >> v2:10.20.193.61:3300/0 conn(0x7fd444090b70 msgr2=0x7fd4441806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- 10.20.193.7:0/3927567762 >> v2:10.20.193.61:3300/0 conn(0x7fd444090b70 0x7fd4441806e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/3927567762 >> v1:10.20.193.61:6789/0 conn(0x7fd44408c7a0 legacy=0x7fd444090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.711 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 monclient: found mon.noname-a 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/3927567762 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44408ed90 con 0x7fd444090f70 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- 10.20.193.7:0/3927567762 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd444090f70 0x7fd4441a0c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd444084f60 tx=0x7fd44001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df2251510fa1fae server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 1 -- 10.20.193.7:0/3927567762 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400b2070 con 0x7fd444090f70 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: dump: 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.712 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 1 -- 10.20.193.7:0/3927567762 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4400a5880 con 0x7fd444090f70 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 1 -- 10.20.193.7:0/3927567762 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400a5c70 con 0x7fd444090f70 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 5 monclient: authenticate success, global_id 134112 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 4 set_mon_vals no callback set 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:55.713 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd448bbb640 10 monclient: dump: 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: shutdown 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/3927567762 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd444090f70 msgr2=0x7fd4441a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.714 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- 10.20.193.7:0/3927567762 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd444090f70 0x7fd4441a0c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd444084f60 tx=0x7fd44001c8b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/3927567762 shutdown_connections 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- 10.20.193.7:0/3927567762 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd444090f70 0x7fd4441a0c30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- 10.20.193.7:0/3927567762 >> v2:10.20.193.61:3300/0 conn(0x7fd444090b70 0x7fd4441806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/3927567762 >> 10.20.193.7:0/3927567762 conn(0x7fd44408e050 msgr2=0x7fd44408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/3927567762 shutdown_connections 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/3927567762 wait complete. 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: monmap: 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:55.715 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 Processor -- start 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- start start 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: init 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd44408c7a0 0x7fd4441d6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-a con 0x7fd44408c7a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd444090b70 0x7fd4441d6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-b con 0x7fd444090b70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 0x7fd44405a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): picked mon.noname-c con 0x7fd444090f70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441a3d20 con 0x7fd44408c7a0 2026-02-22T21:00:55.716 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441a3ba0 con 0x7fd444090b70 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd4441a3ea0 con 0x7fd444090f70 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient(hunting): authenticate will time out at 1068.175232s 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd44408c7a0 0x7fd4441d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 0x7fd44405a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 0x7fd44405a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51246/0 (socket says 10.20.193.7:51246) 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 learned_addr learned my addr 10.20.193.7:0/2060721711 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): get_auth_request con 0x7fd444090f70 auth_method 0 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd44408c7a0 0x7fd4441d6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57360/0 (socket says 10.20.193.7:57360) 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): get_auth_request con 0x7fd44408c7a0 auth_method 0 2026-02-22T21:00:55.717 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd444090b70 0x7fd4441d6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): get_auth_request con 0x7fd444090b70 auth_method 0 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4493bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient(hunting): handle_auth_done global_id 124367 payload 824 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd444090b70 msgr2=0x7fd4441d6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.718 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd444090b70 0x7fd4441d6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd44408c7a0 msgr2=0x7fd4441d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd44408c7a0 0x7fd4441d6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 monclient: found mon.noname-c 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd444084550 con 0x7fd444090f70 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44a3be640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 0x7fd44405a150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd44001c8f0 tx=0x7fd440019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400bc020 con 0x7fd444090f70 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: dump: 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.719 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440004040 con 0x7fd444090f70 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400b2040 con 0x7fd444090f70 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd4327fc640 10 monclient: dump: 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.720 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 5 monclient: authenticate success, global_id 124367 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd433fff640 4 set_mon_vals no callback set 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _renew_subs 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44405d9e0 con 0x7fd444090f70 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _renew_subs 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.699+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44408b4f0 con 0x7fd444090f70 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd44be48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd44be48640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 0x7fd44405aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd444088740 con 0x7fd44405a690 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd4400b5070 con 0x7fd444090f70 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 0x7fd44405aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.721 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient: get_auth_request con 0x7fd44405a690 auth_method 0 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 --2- 10.20.193.7:0/2060721711 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd41403ab20 0x7fd41405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 10 monclient(hunting): handle_auth_done global_id 124370 payload 824 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fd4400e92f0 con 0x7fd444090f70 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd44405df80 con 0x7fd44405a690 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd449bbd640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 0x7fd44405aa90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd434003130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4493bc640 1 --2- 10.20.193.7:0/2060721711 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd41403ab20 0x7fd41405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400f5e0 con 0x7fd44405a690 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 10 monclient: dump: 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.722 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4493bc640 10 monclient: get_auth_request con 0x7fd41403ab20 auth_method 0 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fd434018070 con 0x7fd44405a690 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 msgr2=0x7fd44405aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 0x7fd44405aa90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd434003130 comp rx=0 tx=0).stop 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 msgr2=0x7fd44405aa90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4327fc640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405a690 0x7fd44405aa90 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd434003130 comp rx=0 tx=0).stop 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd4493bc640 1 --2- 10.20.193.7:0/2060721711 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd41403ab20 0x7fd41405afd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd44408a8c0 tx=0x7fd438008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.703+0000 7fd44be48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 0x7fd44419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.723 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd44405fc70 con 0x7fd44405afd0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 0x7fd44419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient: get_auth_request con 0x7fd44405afd0 auth_method 0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 10 monclient(hunting): handle_auth_done global_id 124373 payload 824 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 1 -- 10.20.193.7:0/2060721711 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd44405b3d0 con 0x7fd44405afd0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd449bbd640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 0x7fd44419d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd4340026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400fc20 con 0x7fd44405afd0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 10 monclient: dump: 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.724 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 <== mon.2 v2:10.20.193.7:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4880 (secure 0 0 0) 0x7fd43400fc20 con 0x7fd44405afd0 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 msgr2=0x7fd44419d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 0x7fd44419d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd4340026e0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 msgr2=0x7fd44419d260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd4327fc640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd44405afd0 0x7fd44419d260 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd434002810 tx=0x7fd4340026e0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.725 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 72, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 72902, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.726 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.727 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.728 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.729 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.730 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.731 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.732 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:55.733 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "num": 2 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T21:00:55.734 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:55.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd41403ab20 msgr2=0x7fd41405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 --2- 10.20.193.7:0/2060721711 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd41403ab20 0x7fd41405afd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd44408a8c0 tx=0x7fd438008040 comp rx=0 tx=0).stop 2026-02-22T21:00:55.735 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 10 monclient: shutdown 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 msgr2=0x7fd44405a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 --2- 10.20.193.7:0/2060721711 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd444090f70 0x7fd44405a150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd44001c8f0 tx=0x7fd440019650 comp rx=0 tx=0).stop 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 reap_dead start 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44a3be640 1 -- 10.20.193.7:0/2060721711 reap_dead start 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 shutdown_connections 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 >> 10.20.193.7:0/2060721711 conn(0x7fd44408e050 msgr2=0x7fd4440854c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 shutdown_connections 2026-02-22T21:00:55.736 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.707+0000 7fd44be48640 1 -- 10.20.193.7:0/2060721711 wait complete. 2026-02-22T21:00:55.736 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T21:00:55.736 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-22T21:00:55.736 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.791+0000 7fc97bbbd640 10 monclient: get_monmap_and_config 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.791+0000 7fc97bbbd640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.791+0000 7fc97bbbd640 10 monclient: monmap: 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:55.795820+0000 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:55.795820+0000 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.796 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 Processor -- start 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- start start 2026-02-22T21:00:55.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: init 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc97408b590 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc97413a6a0 0x7fc97417e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-c con 0x7fc97413a6a0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fc97417e8b0 0x7fc97419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-a con 0x7fc97417e8b0 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc974089920 con 0x7fc97408b590 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fc97413aad0 con 0x7fc97417e8b0 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc97408ab40 con 0x7fc97413a6a0 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient(hunting): authenticate will time out at 1068.268880s 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979932640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc97408b590 0x7fc974139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53316/0 (socket says 10.20.193.7:53316) 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979932640 1 -- 10.20.193.7:0/1511977042 learned_addr learned my addr 10.20.193.7:0/1511977042 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 --2- 10.20.193.7:0/1511977042 >> v2:10.20.193.7:3300/0 conn(0x7fc97417e8b0 0x7fc97419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): get_auth_request con 0x7fc97417e8b0 auth_method 0 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 1 --2- 10.20.193.7:0/1511977042 >> v2:10.20.193.61:3300/0 conn(0x7fc97413a6a0 0x7fc97417e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): get_auth_request con 0x7fc97413a6a0 auth_method 0 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient(hunting): handle_auth_done global_id 134118 payload 274 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 -- 10.20.193.7:0/1511977042 >> v2:10.20.193.61:3300/0 conn(0x7fc97413a6a0 msgr2=0x7fc97417e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 --2- 10.20.193.7:0/1511977042 >> v2:10.20.193.61:3300/0 conn(0x7fc97413a6a0 0x7fc97417e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 -- 10.20.193.7:0/1511977042 >> v1:10.20.193.7:6789/0 conn(0x7fc97408b590 legacy=0x7fc974139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 monclient: found mon.noname-a 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 -- 10.20.193.7:0/1511977042 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97408a860 con 0x7fc97417e8b0 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97a133640 1 --2- 10.20.193.7:0/1511977042 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97417e8b0 0x7fc97419ec90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc97408a350 tx=0x7fc97001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b325f092332b964 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 1 -- 10.20.193.7:0/1511977042 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700b2070 con 0x7fc97417e8b0 2026-02-22T21:00:55.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: dump: 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 1 -- 10.20.193.7:0/1511977042 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9700a58d0 con 0x7fc97417e8b0 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 1 -- 10.20.193.7:0/1511977042 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700a5cc0 con 0x7fc97417e8b0 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc978930640 10 monclient: dump: 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 5 monclient: authenticate success, global_id 134118 2026-02-22T21:00:55.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 4 set_mon_vals no callback set 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: shutdown 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1511977042 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97417e8b0 msgr2=0x7fc97419ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1511977042 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97417e8b0 0x7fc97419ec90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc97408a350 tx=0x7fc97001c7f0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1511977042 shutdown_connections 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1511977042 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97417e8b0 0x7fc97419ec90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1511977042 >> v2:10.20.193.61:3300/0 conn(0x7fc97413a6a0 0x7fc97417e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1511977042 >> 10.20.193.7:0/1511977042 conn(0x7fc97408faa0 msgr2=0x7fc97408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1511977042 shutdown_connections 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1511977042 wait complete. 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 10 monclient: monmap: 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:55.809 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.795+0000 7fc97bbbd640 1 Processor -- start 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- start start 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: init 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 0x7fc974109dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-a con 0x7fc97408b590 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97413a6a0 0x7fc974126c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-b con 0x7fc97413a6a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:55.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc97417e8b0 0x7fc9741390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): picked mon.noname-c con 0x7fc97417e8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741a1de0 con 0x7fc97408b590 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741a1c60 con 0x7fc97413a6a0 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc9741a1f60 con 0x7fc97417e8b0 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): authenticate will time out at 1068.272452s 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 0x7fc974109dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc97417e8b0 0x7fc9741390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 0x7fc974109dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57382/0 (socket says 10.20.193.7:57382) 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 -- 10.20.193.7:0/1329205096 learned_addr learned my addr 10.20.193.7:0/1329205096 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): get_auth_request con 0x7fc97408b590 auth_method 0 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): get_auth_request con 0x7fc97417e8b0 auth_method 0 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97413a6a0 0x7fc974126c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): get_auth_request con 0x7fc97413a6a0 auth_method 0 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient(hunting): handle_auth_done global_id 134124 payload 824 2026-02-22T21:00:55.812 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc97417e8b0 msgr2=0x7fc9741390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc97417e8b0 0x7fc9741390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97413a6a0 msgr2=0x7fc974126c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97413a6a0 0x7fc974126c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 monclient: found mon.noname-a 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97410b5d0 con 0x7fc97408b590 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97413a6a0 0x7fc974126c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979932640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 0x7fc974109dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc96400c700 tx=0x7fc96400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964017070 con 0x7fc97408b590 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: dump: 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.813 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc964005bd0 con 0x7fc97408b590 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964007070 con 0x7fc97408b590 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 5 monclient: authenticate success, global_id 134124 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _renew_subs 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97410a760 con 0x7fc97408b590 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc963fff640 4 set_mon_vals no callback set 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:55.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: dump: 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _renew_subs 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc974108c80 con 0x7fc97408b590 2026-02-22T21:00:55.816 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 0x7fc974129cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc9740382a0 con 0x7fc974139630 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 0x7fc974129cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient: get_auth_request con 0x7fc974139630 auth_method 0 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc964007210 con 0x7fc97408b590 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 10 monclient(hunting): handle_auth_done global_id 114763 payload 824 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc974139f90 con 0x7fc974139630 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 --2- 10.20.193.7:0/1329205096 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc94403ab10 0x7fc94405afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fc96404dd90 con 0x7fc97408b590 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 0x7fc974129cd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc968004780 tx=0x7fc968011c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 1 --2- 10.20.193.7:0/1329205096 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc94403ab10 0x7fc94405afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96800fc40 con 0x7fc974139630 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: dump: 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 10 monclient: get_auth_request con 0x7fc94403ab10 auth_method 0 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (secure 0 0 0) 0x7fc968011e80 con 0x7fc974139630 2026-02-22T21:00:55.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 msgr2=0x7fc974129cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 0x7fc974129cd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc968004780 tx=0x7fc968011c90 comp rx=0 tx=0).stop 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 msgr2=0x7fc974129cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc9627fc640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc974139630 0x7fc974129cd0 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc968004780 tx=0x7fc968011c90 comp rx=0 tx=0).stop 2026-02-22T21:00:55.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.799+0000 7fc97a133640 1 --2- 10.20.193.7:0/1329205096 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc94403ab10 0x7fc94405afc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc97001a420 tx=0x7fc9700a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-22T21:00:55.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 0x7fc97412a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc97412ab50 con 0x7fc97412a210 2026-02-22T21:00:55.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 0x7fc97412a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient: get_auth_request con 0x7fc97412a210 auth_method 0 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 10 monclient(hunting): handle_auth_done global_id 114766 payload 824 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 1 -- 10.20.193.7:0/1329205096 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc97410b1c0 con 0x7fc97412a210 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc979131640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 0x7fc97412a610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc968019000 tx=0x7fc9680047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.1 v2:10.20.193.61:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968015460 con 0x7fc97412a210 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 10 monclient: dump: 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.821 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 <== mon.1 v2:10.20.193.61:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5048 (secure 0 0 0) 0x7fc968015460 con 0x7fc97412a210 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 msgr2=0x7fc97412a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 0x7fc97412a610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc968019000 tx=0x7fc9680047b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 msgr2=0x7fc97412a610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc9627fc640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc97412a210 0x7fc97412a610 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc968019000 tx=0x7fc9680047b0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:55.822 INFO:teuthology.orchestra.run.trial007.stdout: "state": "peon", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "election_epoch": 72, 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "uptime": 116986, 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "quorum": [ 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: 0, 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: 1, 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: 2 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_age": 0, 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "required_con": "2453899407728394244", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "required_mon": [ 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.823 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_con": "4544132024016699391", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "quorum_mon": [ 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.824 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "outside_quorum": [], 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "extra_probe_peers": [], 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "sync_provider": [], 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "monmap": { 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "epoch": 1, 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "fsid": "ec79d088-5ee7-4a8c-8cac-a194b076cc72", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "modified": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "created": "2026-02-22T20:51:48.190293Z", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release": 20, 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "min_mon_release_name": "tentacle", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "election_strategy": 1, 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "disallowed_leaders": "", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false, 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "tiebreaker_mon": "", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "removed_ranks": "", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "features": { 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "persistent": [ 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "kraken", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "luminous", 2026-02-22T21:00:55.825 INFO:teuthology.orchestra.run.trial007.stdout: "mimic", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "osdmap-prune", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "nautilus", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "octopus", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "pacific", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "elector-pinging", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "quincy", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "reef", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "squid", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "tentacle", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "nvmeof_beacon_diff" 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "optional": [] 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "mons": [ 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 0, 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "name": "a", 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.826 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3300", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6789/0", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 1, 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "name": "b", 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.827 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:3300", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.61:6789/0", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "rank": 2, 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "name": "c", 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "public_addrs": { 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "addrvec": [ 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.828 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v2", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:3301", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "type": "v1", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "nonce": 0 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "public_addr": "10.20.193.7:6790/0", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "priority": 0, 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "weight": 0, 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "crush_location": "{}" 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "feature_map": { 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "mon": [ 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:55.829 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "osd": [ 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "num": 3 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "client": [ 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "num": 5 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: ], 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "mgr": [ 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: { 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "features": "0x3f0ffffffffdffff", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "release": "squid", 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "num": 1 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: } 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: ] 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: }, 2026-02-22T21:00:55.830 INFO:teuthology.orchestra.run.trial007.stdout: "stretch_mode": false 2026-02-22T21:00:55.831 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:55.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc94403ab10 msgr2=0x7fc94405afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1329205096 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc94403ab10 0x7fc94405afc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc97001a420 tx=0x7fc9700a7070 comp rx=0 tx=0).stop 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 10 monclient: shutdown 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 msgr2=0x7fc974109dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 --2- 10.20.193.7:0/1329205096 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc97408b590 0x7fc974109dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc96400c700 tx=0x7fc96400cbc0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97a133640 1 -- 10.20.193.7:0/1329205096 reap_dead start 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97a133640 1 -- 10.20.193.7:0/1329205096 reap_dead start 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 shutdown_connections 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 >> 10.20.193.7:0/1329205096 conn(0x7fc97408faa0 msgr2=0x7fc97408e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 shutdown_connections 2026-02-22T21:00:55.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.803+0000 7fc97bbbd640 1 -- 10.20.193.7:0/1329205096 wait complete. 2026-02-22T21:00:55.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-22T21:00:55.832 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-22T21:00:55.832 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-22T21:00:55.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: get_monmap_and_config 2026-02-22T21:00:55.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: monmap: 2026-02-22T21:00:55.893 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.893 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:55.893698+0000 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:55.893698+0000 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 Processor -- start 2026-02-22T21:00:55.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 -- start start 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: init 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f223c08b590 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f223c13a6a0 0x7f223c17e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-c con 0x7f223c13a6a0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-b con 0x7f223c17e8b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223c089920 con 0x7f223c08b590 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f223c13aad0 con 0x7f223c13a6a0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f223c08ab40 con 0x7f223c17e8b0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2242e1f640 10 monclient(hunting): authenticate will time out at 1068.366603s 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51280/0 (socket says 10.20.193.7:51280) 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 -- 10.20.193.7:0/2682054009 learned_addr learned my addr 10.20.193.7:0/2682054009 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): get_auth_request con 0x7f223c17e8b0 auth_method 0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 1 --2- 10.20.193.7:0/2682054009 >> v2:10.20.193.61:3300/0 conn(0x7f223c13a6a0 0x7f223c17e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): get_auth_request con 0x7f223c13a6a0 auth_method 0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient(hunting): handle_auth_done global_id 124379 payload 274 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 -- 10.20.193.7:0/2682054009 >> v2:10.20.193.61:3300/0 conn(0x7f223c13a6a0 msgr2=0x7f223c17e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 --2- 10.20.193.7:0/2682054009 >> v2:10.20.193.61:3300/0 conn(0x7f223c13a6a0 0x7f223c17e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 -- 10.20.193.7:0/2682054009 >> v1:10.20.193.61:6789/0 conn(0x7f223c08b590 legacy=0x7f223c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 monclient: found mon.noname-b 2026-02-22T21:00:55.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.891+0000 7f2241395640 1 -- 10.20.193.7:0/2682054009 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c08a860 con 0x7f223c17e8b0 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 1 --2- 10.20.193.7:0/2682054009 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2238009580 tx=0x7f223801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e706e9b951a9071 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 1 -- 10.20.193.7:0/2682054009 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380b2070 con 0x7f223c17e8b0 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: dump: 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.896 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 1 -- 10.20.193.7:0/2682054009 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22380a5950 con 0x7f223c17e8b0 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 1 -- 10.20.193.7:0/2682054009 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380a5d40 con 0x7f223c17e8b0 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 5 monclient: authenticate success, global_id 124379 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 4 set_mon_vals no callback set 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22337fe640 10 monclient: dump: 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: shutdown 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/2682054009 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 msgr2=0x7f223c19ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- 10.20.193.7:0/2682054009 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2238009580 tx=0x7f223801c8f0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/2682054009 shutdown_connections 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- 10.20.193.7:0/2682054009 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c17e8b0 0x7f223c19ec90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- 10.20.193.7:0/2682054009 >> v2:10.20.193.61:3300/0 conn(0x7f223c13a6a0 0x7f223c17e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/2682054009 >> 10.20.193.7:0/2682054009 conn(0x7f223c08faa0 msgr2=0x7f223c08bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/2682054009 shutdown_connections 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/2682054009 wait complete. 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: build_initial_monmap 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: monmap: 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 Processor -- start 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- start start 2026-02-22T21:00:55.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: init 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-c con 0x7f223c08b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f223c13a6a0 0x7f223c193f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-a con 0x7f223c13a6a0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f223c17e8b0 0x7f223c138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): picked mon.noname-b con 0x7f223c17e8b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1a1ed0 con 0x7f223c13a6a0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f223c1a1d50 con 0x7f223c17e8b0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f223c1a2050 con 0x7f223c08b590 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient(hunting): authenticate will time out at 1068.370501s 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51288/0 (socket says 10.20.193.7:51288) 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 -- 10.20.193.7:0/946798584 learned_addr learned my addr 10.20.193.7:0/946798584 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): get_auth_request con 0x7f223c08b590 auth_method 0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f223c13a6a0 0x7f223c193f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): get_auth_request con 0x7f223c13a6a0 auth_method 0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f223c17e8b0 0x7f223c138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 10 monclient(hunting): get_auth_request con 0x7f223c17e8b0 auth_method 0 2026-02-22T21:00:55.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2241395640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient(hunting): handle_auth_done global_id 124382 payload 824 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 -- 10.20.193.7:0/946798584 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f223c17e8b0 msgr2=0x7f223c138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f223c17e8b0 0x7f223c138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 -- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f223c13a6a0 msgr2=0x7f223c193f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f223c13a6a0 0x7f223c193f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient: _finish_hunting 0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 monclient: found mon.noname-c 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 -- 10.20.193.7:0/946798584 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223c194460 con 0x7f223c08b590 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2240b94640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c520 tx=0x7f222c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c017070 con 0x7f223c08b590 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: dump: 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c006ad0 con 0x7f223c08b590 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c007030 con 0x7f223c08b590 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 5 monclient: authenticate success, global_id 124382 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _renew_subs 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2232ffd640 4 set_mon_vals no callback set 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223c12b9b0 con 0x7f223c08b590 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:55.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 10 monclient: dump: 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _renew_subs 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f223c129650 con 0x7f223c08b590 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f222c0071d0 con 0x7f223c08b590 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223c0382a0 con 0x7f223c08b590 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 --2- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 0x7f220c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f222c04de50 con 0x7f223c08b590 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 1 --2- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 0x7f220c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.895+0000 7f2233fff640 10 monclient: get_auth_request con 0x7f220c03ab20 auth_method 0 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.899+0000 7f2233fff640 1 --2- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 0x7f220c05afd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f223c12b000 tx=0x7f2224009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:55.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.899+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f223c194460 con 0x7f223c08b590 2026-02-22T21:00:55.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.899+0000 7f22317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:55.904 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:55.899+0000 7f22317fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:56.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.011+0000 7f2242e1f640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-22T21:00:56.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.011+0000 7f2242e1f640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-22T21:00:56.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.011+0000 7f2242e1f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:56.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.011+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f223c139f90 con 0x7f223c08b590 2026-02-22T21:00:56.016 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.016 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=9,logm=58} crc {auth=4253090148,config=3140514009,health=138231836,kv=497144887,logm=4243349225}) 2026-02-22T21:00:56.017 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=13,kv=9,logm=59} crc {auth=1526765672,config=3140514009,health=2080176976,kv=3619945143,logm=2096059191}) 2026-02-22T21:00:56.017 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.017 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=9,logm=58} crc {auth=4253090148,config=3140514009,health=138231836,kv=497144887,logm=4243349225}) 2026-02-22T21:00:56.017 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=1,health=11,kv=10,logm=58} crc {auth=512719771,config=1228700967,health=790187719,kv=3991984195,logm=3117669856}) 2026-02-22T21:00:56.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f22317fa640 1 -- 10.20.193.7:0/946798584 <== mon.2 v2:10.20.193.7:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f222c01a360 con 0x7f223c08b590 2026-02-22T21:00:56.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f22317fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-22T21:00:56.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f22317fa640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562803890}) 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1534946667}) 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562803890}) 2026-02-22T21:00:56.018 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2289919067}) 2026-02-22T21:00:56.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 msgr2=0x7f220c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:56.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 0x7f220c05afd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f223c12b000 tx=0x7f2224009290 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 10 monclient: shutdown 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 msgr2=0x7f223c193790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c520 tx=0x7f222c00c9e0 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 shutdown_connections 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> v2:10.20.193.61:6800/2336688312 conn(0x7f220c03ab20 0x7f220c05afd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f223c17e8b0 0x7f223c138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f223c13a6a0 0x7f223c193f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 --2- 10.20.193.7:0/946798584 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f223c08b590 0x7f223c193790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 >> 10.20.193.7:0/946798584 conn(0x7f223c08faa0 msgr2=0x7f223c0869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 shutdown_connections 2026-02-22T21:00:56.020 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:56.015+0000 7f2242e1f640 1 -- 10.20.193.7:0/946798584 wait complete. 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=674977584}) 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1467301325}) 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=674977584}) 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2622122285}) 2026-02-22T21:00:56.026 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1919912585}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=307330621}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1919912585}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2879029034}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=289657409}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4100234336}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=289657409}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=216338697}) 2026-02-22T21:00:56.027 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711441186}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1629493496}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711441186}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.015+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=279703963}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=662476574}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=638547766}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=662476574}) 2026-02-22T21:00:56.028 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3418818626}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3125155542}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=973437502}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3125155542}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=269899528}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3503340271}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1273706233}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3503340271}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2078285950}) 2026-02-22T21:00:56.029 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=202140917}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=271589406}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=202140917}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1848391167}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243444660}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3243744779}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243444660}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=77659837}) 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.030 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2331901730}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=415524263}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2331901730}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3509887138}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=650958997}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1375490971}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.019+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=650958997}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1492446589}) 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.031 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4046653071}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2250469133}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4046653071}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=340046205}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2876937793}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3202475268}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2876937793}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4169636660}) 2026-02-22T21:00:56.032 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.033 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048740247}) 2026-02-22T21:00:56.033 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1602465321}) 2026-02-22T21:00:56.033 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.033 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048740247}) 2026-02-22T21:00:56.033 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=740254466}) 2026-02-22T21:00:56.034 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-22T21:00:56.040 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.040 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251016386}) 2026-02-22T21:00:56.040 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1920561934}) 2026-02-22T21:00:56.040 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.040 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251016386}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1292799344}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1160307293}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=603704627}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1160307293}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=163849823}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1608206194}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2922969569}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.023+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1608206194}) 2026-02-22T21:00:56.041 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=575511799}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736671602}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=406348243}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736671602}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1683533055}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4053424328}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2590944073}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4053424328}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1247789132}) 2026-02-22T21:00:56.042 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970758691}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2711650021}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2970758691}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1175383396}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162711327}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3269778934}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162711327}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2546859901}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2275668046}) 2026-02-22T21:00:56.043 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2715948984}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2275668046}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.027+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2852223745}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=20} crc {logm=718496294,mdsmap=1256979633,mgr=2003615622,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1386629056,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=284821089,osd_snap=4133920409,osdmap=3284356400}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=22} crc {logm=145473355,mdsmap=1256979633,mgr=2003615621,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=52041890,mon_config_key=2504319980,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=284821089,osd_snap=4133920409,osdmap=2217365171}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=20} crc {logm=718496294,mdsmap=1256979633,mgr=2003615622,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=1386629056,mon_config_key=2474627766,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=284821089,osd_snap=4133920409,osdmap=3284356400}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=227425425,mdsmap=1256979633,mgr=837930825,mgr_command_descs=2703170560,mgr_metadata=266755361,mgrstat=3456461460,mon_config_key=1023171130,monmap=3984337193,nvmeofgw=3360707892,osd_metadata=2266821947,osd_pg_creating=284821089,osd_snap=4133920410,osdmap=1844133276}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1262944101}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1268790634}) 2026-02-22T21:00:56.044 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1262944101}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3332776638}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=222477704}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1345687867}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=222477704}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1938386152}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1626667044}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4078605820}) 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.045 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1626667044}) 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.031+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2421891493}) 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3882103267}) 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=3603244423}) 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=3882103267}) 2026-02-22T21:00:56.046 INFO:tasks.ceph.mon.a.trial007.stderr:2026-02-22T21:00:56.039+0000 7f59df361640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=60} crc {osdmap=2236740266}) 2026-02-22T21:00:56.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:00:56.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:00:57.035 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-22T21:00:57.035 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-22T21:00:57.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: get_monmap_and_config 2026-02-22T21:00:57.114 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: monmap: 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:57.105851+0000 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:57.105851+0000 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:57.115 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 Processor -- start 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 -- start start 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: init 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f795413f290 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.116 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): picked mon.noname-b con 0x7f795413fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7954180d00 0x7f79541a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): picked mon.noname-a con 0x7f7954180d00 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795408fd70 con 0x7f795413f290 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f795408e1f0 con 0x7f7954180d00 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f795408ec90 con 0x7f795413fd70 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f795a595640 10 monclient(hunting): authenticate will time out at 1069.578732s 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f7954180d00 0x7f79541a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.117 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51298/0 (socket says 10.20.193.7:51298) 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 -- 10.20.193.7:0/1314703274 learned_addr learned my addr 10.20.193.7:0/1314703274 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): get_auth_request con 0x7f795413fd70 auth_method 0 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): get_auth_request con 0x7f7954180d00 auth_method 0 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.118 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient(hunting): handle_auth_done global_id 124385 payload 274 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 -- 10.20.193.7:0/1314703274 >> v2:10.20.193.7:3300/0 conn(0x7f7954180d00 msgr2=0x7f79541a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 --2- 10.20.193.7:0/1314703274 >> v2:10.20.193.7:3300/0 conn(0x7f7954180d00 0x7f79541a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 -- 10.20.193.7:0/1314703274 >> v1:10.20.193.61:6789/0 conn(0x7f795413f290 legacy=0x7f795413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 monclient: found mon.noname-b 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.119 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.103+0000 7f79537fe640 1 -- 10.20.193.7:0/1314703274 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7954092bc0 con 0x7f795413fd70 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- 10.20.193.7:0/1314703274 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f795408e370 tx=0x7f794401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2fe51b5e1568567 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 1 -- 10.20.193.7:0/1314703274 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79440aa430 con 0x7f795413fd70 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: dump: 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.120 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 1 -- 10.20.193.7:0/1314703274 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79440af070 con 0x7f795413fd70 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.121 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 1 -- 10.20.193.7:0/1314703274 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79440aa7f0 con 0x7f795413fd70 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7952ffd640 10 monclient: dump: 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.122 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 5 monclient: authenticate success, global_id 124385 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 4 set_mon_vals no callback set 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: shutdown 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/1314703274 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 msgr2=0x7f79541807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- 10.20.193.7:0/1314703274 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f795408e370 tx=0x7f794401c4d0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.123 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/1314703274 shutdown_connections 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- 10.20.193.7:0/1314703274 >> v2:10.20.193.7:3300/0 conn(0x7f7954180d00 0x7f79541a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- 10.20.193.7:0/1314703274 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/1314703274 >> 10.20.193.7:0/1314703274 conn(0x7f7954093df0 msgr2=0x7f79540902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/1314703274 shutdown_connections 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/1314703274 wait complete. 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: monmap: 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:57.124 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 Processor -- start 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- start start 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: init 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:57.125 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 0x7f79541893b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): picked mon.noname-b con 0x7f795413f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): picked mon.noname-a con 0x7f795413fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7954180d00 0x7f79541898f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): picked mon.noname-c con 0x7f7954180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79541a3fc0 con 0x7f795413fd70 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f79541a3e40 con 0x7f795413f290 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f79541a4140 con 0x7f7954180d00 2026-02-22T21:00:57.126 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient(hunting): authenticate will time out at 1069.582456s 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57400/0 (socket says 10.20.193.7:57400) 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 -- 10.20.193.7:0/3023663681 learned_addr learned my addr 10.20.193.7:0/3023663681 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): get_auth_request con 0x7f795413fd70 auth_method 0 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7954180d00 0x7f79541898f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.127 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): get_auth_request con 0x7f7954180d00 auth_method 0 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7958b0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient(hunting): handle_auth_done global_id 134133 payload 824 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7953fff640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 0x7f79541893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 -- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7954180d00 msgr2=0x7f79541898f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7954180d00 0x7f79541898f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.128 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 -- 10.20.193.7:0/3023663681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 msgr2=0x7f79541893b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 0x7f79541893b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 -- 10.20.193.7:0/3023663681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795419dff0 con 0x7f795413fd70 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7953fff640 10 monclient: get_auth_request con 0x7f795413f290 auth_method 0 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7953fff640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 0x7f79541893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79537fe640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79440ac040 tx=0x7f794401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79440aae60 con 0x7f795413fd70 2026-02-22T21:00:57.129 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: dump: 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.130 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7944004220 con 0x7f795413fd70 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944003710 con 0x7f795413fd70 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 10 monclient: dump: 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.131 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f79527fc640 4 set_mon_vals no callback set 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 5 monclient: authenticate success, global_id 134133 2026-02-22T21:00:57.132 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _renew_subs 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795413eea0 con 0x7f795413fd70 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _renew_subs 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795408a9e0 con 0x7f795413fd70 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795413f660 con 0x7f795413fd70 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f79440a9070 con 0x7f795413fd70 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 --2- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 0x7f792405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.133 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f79440e8a40 con 0x7f795413fd70 2026-02-22T21:00:57.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.107+0000 7f7953fff640 1 --2- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 0x7f792405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.111+0000 7f7953fff640 10 monclient: get_auth_request con 0x7f792403ab20 auth_method 0 2026-02-22T21:00:57.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.111+0000 7f7953fff640 1 --2- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 0x7f792405afd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7940002810 tx=0x7f7940009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.111+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f7944016210 con 0x7f795413fd70 2026-02-22T21:00:57.134 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.111+0000 7f7950ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.135 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.111+0000 7f7950ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:57.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f795a595640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-22T21:00:57.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f795a595640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:57.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f795a595640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.227 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f795405fb50 con 0x7f795413fd70 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f7950ff9640 1 -- 10.20.193.7:0/3023663681 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1611 (secure 0 0 0) 0x7f79440a6290 con 0x7f795413fd70 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f7950ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.223+0000 7f7950ff9640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","modified":"2026-02-22T20:51:48.190293Z","created":"2026-02-22T20:51:48.190293Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3300","nonce":0},{"type":"v1","addr":"10.20.193.7:6789","nonce":0}]},"addr":"10.20.193.7:6789/0","public_addr":"10.20.193.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:3300","nonce":0},{"type":"v1","addr":"10.20.193.61:6789","nonce":0}]},"addr":"10.20.193.61:6789/0","public_addr":"10.20.193.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:3301","nonce":0},{"type":"v1","addr":"10.20.193.7:6790","nonce":0}]},"addr":"10.20.193.7:6790/0","public_addr":"10.20.193.7:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 msgr2=0x7f792405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 0x7f792405afd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7940002810 tx=0x7f7940009040 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 10 monclient: shutdown 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 msgr2=0x7f79541807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79440ac040 tx=0x7f794401ad10 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 shutdown_connections 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f7954180d00 0x7f79541898f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f795413fd70 0x7f79541807c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> v2:10.20.193.61:6800/2336688312 conn(0x7f792403ab20 0x7f792405afd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 --2- 10.20.193.7:0/3023663681 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f795413f290 0x7f79541893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 >> 10.20.193.7:0/3023663681 conn(0x7f7954093df0 msgr2=0x7f795413d550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 shutdown_connections 2026-02-22T21:00:57.228 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.227+0000 7f795a595640 1 -- 10.20.193.7:0/3023663681 wait complete. 2026-02-22T21:00:57.237 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-22T21:00:57.238 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T21:00:57.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T21:00:57.249 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 10 monclient: get_monmap_and_config 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 10 monclient: monmap: 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:57.307291+0000 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:57.307291+0000 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:57.307 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:57.308 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:57.308 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:57.308 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 1 Processor -- start 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 1 -- start start 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.303+0000 7fef3a66b640 10 monclient: init 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fef3413f290 0x7fef3413f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-c con 0x7fef3413f290 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fef3413fba0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:57.310 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fef3413c680 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3408fd70 con 0x7fef3413c680 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef34092bc0 con 0x7fef3413fba0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fef3408e1f0 con 0x7fef3413f290 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): authenticate will time out at 1069.780179s 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fef3413c680 0x7fef341a17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53326/0 (socket says 10.20.193.7:53326) 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 -- 10.20.193.7:0/785006769 learned_addr learned my addr 10.20.193.7:0/785006769 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- 10.20.193.7:0/785006769 >> v2:10.20.193.61:3300/0 conn(0x7fef3413f290 0x7fef3413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request con 0x7fef3413f290 auth_method 0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133147080 0 0) 0x7fef28002ca0 con 0x7fef3413c680 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _negotiate 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): my global_id is 134136 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef18003620 con 0x7fef3413c680 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.1 v1:10.20.193.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219223265 0 0) 0x7fef34092bc0 con 0x7fef3413fba0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _negotiate 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): my global_id is 114775 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> v1:10.20.193.61:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef28002ca0 con 0x7fef3413fba0 2026-02-22T21:00:57.311 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1083072664 0 0) 0x7fef18003620 con 0x7fef3413c680 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 >> v2:10.20.193.61:3300/0 conn(0x7fef3413f290 msgr2=0x7fef3413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 --2- 10.20.193.7:0/785006769 >> v2:10.20.193.61:3300/0 conn(0x7fef3413f290 0x7fef3413f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 >> v1:10.20.193.61:6789/0 conn(0x7fef3413fba0 legacy=0x7fef3413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 monclient: found mon.noname-a-legacy 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3408e6d0 con 0x7fef3413c680 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fef280033b0 con 0x7fef3413c680 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: dump: 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T21:00:57.312 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 >> v1:10.20.193.7:6789/0 conn(0x7fef3413c680 legacy=0x7fef341a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 0x7fef180051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): picked mon.a con 0x7fef18004dd0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef180038a0 0x7fef18003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): picked mon.b con 0x7fef180038a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef18004420 0x7fef18065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): picked mon.c con 0x7fef18004420 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef3408e1f0 con 0x7fef18004dd0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fef18066350 con 0x7fef180038a0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fef18066550 con 0x7fef18004420 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 0x7fef180051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request con 0x7fef18004dd0 auth_method 0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef18004420 0x7fef18065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): get_auth_request con 0x7fef18004420 auth_method 0 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:57.313 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef180038a0 0x7fef18003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): get_auth_request con 0x7fef180038a0 auth_method 0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_done global_id 134136 payload 293 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 -- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef18004420 msgr2=0x7fef18065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef18004420 0x7fef18065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 -- 10.20.193.7:0/785006769 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef180038a0 msgr2=0x7fef18003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef180038a0 0x7fef18003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 monclient: found mon.a 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 -- 10.20.193.7:0/785006769 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18003620 con 0x7fef18004dd0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 -- 10.20.193.7:0/785006769 reap_dead start 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 5 monclient: authenticate success, global_id 134136 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 0x7fef180051a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef20009af0 tx=0x7fef2001cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1494f88a2e3f0e4d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200b2070 con 0x7fef18004dd0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: dump: 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.314 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200a5600 con 0x7fef18004dd0 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 1 -- 10.20.193.7:0/785006769 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200096f0 con 0x7fef18004dd0 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef32ffd640 10 monclient: dump: 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 4 set_mon_vals no callback set 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: shutdown 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 msgr2=0x7fef180051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.315 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 0x7fef180051a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef20009af0 tx=0x7fef2001cb10 comp rx=0 tx=0).stop 2026-02-22T21:00:57.316 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- 10.20.193.7:0/785006769 shutdown_connections 2026-02-22T21:00:57.316 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- 10.20.193.7:0/785006769 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef18004dd0 0x7fef180051a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.316 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- 10.20.193.7:0/785006769 >> 10.20.193.7:0/785006769 conn(0x7fef34093df0 msgr2=0x7fef340902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.316 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- 10.20.193.7:0/785006769 shutdown_connections 2026-02-22T21:00:57.316 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- 10.20.193.7:0/785006769 wait complete. 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: monmap: 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 Processor -- start 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- start start 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: init 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef18004dd0 0x7fef341da090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-b con 0x7fef18004dd0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef3413b210 0x7fef3413b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-a con 0x7fef3413b210 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): picked mon.noname-c con 0x7fef34129e50 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fef3413c0f0 con 0x7fef3413b210 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fef3413bf70 con 0x7fef18004dd0 2026-02-22T21:00:57.318 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fef3413c270 con 0x7fef34129e50 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef3a66b640 10 monclient(hunting): authenticate will time out at 1069.783674s 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef3413b210 0x7fef3413b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef18004dd0 0x7fef341da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51332/0 (socket says 10.20.193.7:51332) 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 1 -- 10.20.193.7:0/453637800 learned_addr learned my addr 10.20.193.7:0/453637800 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): get_auth_request con 0x7fef34129e50 auth_method 0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): get_auth_request con 0x7fef3413b210 auth_method 0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request con 0x7fef18004dd0 auth_method 0 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef38be1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.307+0000 7fef33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 10 monclient(hunting): handle_auth_done global_id 124391 payload 824 2026-02-22T21:00:57.319 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 -- 10.20.193.7:0/453637800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef18004dd0 msgr2=0x7fef341da090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef18004dd0 0x7fef341da090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 -- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef3413b210 msgr2=0x7fef3413b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef3413b210 0x7fef3413b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 monclient: found mon.noname-c 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 -- 10.20.193.7:0/453637800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3412daf0 con 0x7fef34129e50 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef38be1640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef3408f440 tx=0x7fef2800ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28019070 con 0x7fef34129e50 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: dump: 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef28007380 con 0x7fef34129e50 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 5 monclient: authenticate success, global_id 124391 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _renew_subs 2026-02-22T21:00:57.320 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3413d390 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28007750 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef327fc640 4 set_mon_vals no callback set 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 10 monclient: dump: 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _renew_subs 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3412b790 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fef280078f0 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34142fc0 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 --2- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 0x7fef0405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fef2804e560 con 0x7fef34129e50 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef33fff640 1 --2- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 0x7fef0405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef33fff640 10 monclient: get_auth_request con 0x7fef0403ab20 auth_method 0 2026-02-22T21:00:57.321 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.311+0000 7fef33fff640 1 --2- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 0x7fef0405afd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef20002410 tx=0x7fef200047b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.315+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fef3408fd70 con 0x7fef34129e50 2026-02-22T21:00:57.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.315+0000 7fef30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.322 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.315+0000 7fef30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:57.396 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef3413bbc0 con 0x7fef0403ab20 2026-02-22T21:00:57.397 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef30ff9640 1 -- 10.20.193.7:0/453637800 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34086 (secure 0 0 0) 0x7fef3413bbc0 con 0x7fef0403ab20 2026-02-22T21:00:57.398 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:00:57.399 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T21:00:57.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 msgr2=0x7fef0405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 0x7fef0405afd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef20002410 tx=0x7fef200047b0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.399 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 10 monclient: shutdown 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 msgr2=0x7fef3412a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef3408f440 tx=0x7fef2800ad70 comp rx=0 tx=0).stop 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 shutdown_connections 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fef34129e50 0x7fef3412a2a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fef3413b210 0x7fef3413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fef0403ab20 0x7fef0405afd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 --2- 10.20.193.7:0/453637800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fef18004dd0 0x7fef341da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 >> 10.20.193.7:0/453637800 conn(0x7fef34093df0 msgr2=0x7fef34055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 shutdown_connections 2026-02-22T21:00:57.400 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.395+0000 7fef3a66b640 1 -- 10.20.193.7:0/453637800 wait complete. 2026-02-22T21:00:57.408 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":578,"stamp":"2026-02-22T21:00:55.971341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":176280,"kb_used_data":14520,"kb_used_omap":1199,"kb_used_meta":160464,"kb_avail":566054760,"statfs":{"total":579820584960,"available":579640074240,"internally_reserved":0,"allocated":14868480,"data_stored":7596886,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":1228230,"internal_metadata":164315706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.092000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887799+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T21:00:50.887799+0000","last_peered":"2026-02-22T21:00:50.887799+0000","last_clean":"2026-02-22T21:00:50.887799+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T21:00:50.887799+0000","last_undegraded":"2026-02-22T21:00:50.887799+0000","last_fullsized":"2026-02-22T21:00:50.887799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.889446+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T21:00:50.889446+0000","last_peered":"2026-02-22T21:00:50.889446+0000","last_clean":"2026-02-22T21:00:50.889446+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T21:00:50.889446+0000","last_undegraded":"2026-02-22T21:00:50.889446+0000","last_fullsized":"2026-02-22T21:00:50.889446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887547+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T21:00:50.887547+0000","last_peered":"2026-02-22T21:00:50.887547+0000","last_clean":"2026-02-22T21:00:50.887547+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T21:00:50.887547+0000","last_undegraded":"2026-02-22T21:00:50.887547+0000","last_fullsized":"2026-02-22T21:00:50.887547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887796+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T21:00:50.887796+0000","last_peered":"2026-02-22T21:00:50.887796+0000","last_clean":"2026-02-22T21:00:50.887796+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T21:00:50.887796+0000","last_undegraded":"2026-02-22T21:00:50.887796+0000","last_fullsized":"2026-02-22T21:00:50.887796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":595,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887965+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T21:00:50.887965+0000","last_peered":"2026-02-22T21:00:50.887965+0000","last_clean":"2026-02-22T21:00:50.887965+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T21:00:50.887965+0000","last_undegraded":"2026-02-22T21:00:50.887965+0000","last_fullsized":"2026-02-22T21:00:50.887965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":606,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888343+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T21:00:50.888343+0000","last_peered":"2026-02-22T21:00:50.888343+0000","last_clean":"2026-02-22T21:00:50.888343+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T21:00:50.888343+0000","last_undegraded":"2026-02-22T21:00:50.888343+0000","last_fullsized":"2026-02-22T21:00:50.888343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887403+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T21:00:50.887403+0000","last_peered":"2026-02-22T21:00:50.887403+0000","last_clean":"2026-02-22T21:00:50.887403+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T21:00:50.887403+0000","last_undegraded":"2026-02-22T21:00:50.887403+0000","last_fullsized":"2026-02-22T21:00:50.887403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":594,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888085+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T21:00:50.888085+0000","last_peered":"2026-02-22T21:00:50.888085+0000","last_clean":"2026-02-22T21:00:50.888085+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T21:00:50.888085+0000","last_undegraded":"2026-02-22T21:00:50.888085+0000","last_fullsized":"2026-02-22T21:00:50.888085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":744,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887677+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T21:00:50.887677+0000","last_peered":"2026-02-22T21:00:50.887677+0000","last_clean":"2026-02-22T21:00:50.887677+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T21:00:50.887677+0000","last_undegraded":"2026-02-22T21:00:50.887677+0000","last_fullsized":"2026-02-22T21:00:50.887677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640364,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":196,"kb_used_meta":26747,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":200908,"internal_metadata":27389748},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640363,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":202,"kb_used_meta":26741,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":207417,"internal_metadata":27383239},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640364,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":211322,"internal_metadata":27379334},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640363,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210022,"internal_metadata":27380634},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640363,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":203,"kb_used_meta":26740,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208720,"internal_metadata":27381936},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640363,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":189841,"internal_metadata":27400815},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:00:57.410 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.475+0000 7faf8536e640 10 monclient: get_monmap_and_config 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.475+0000 7faf8536e640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.475+0000 7faf8536e640 10 monclient: monmap: 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:57.479671+0000 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:57.479671+0000 2026-02-22T21:00:57.479 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:57.480 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 Processor -- start 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- start start 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: init 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: _add_conns ranks=[4,2,3,1,0] 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7faf8008b590 0x7faf80139f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-c con 0x7faf8008b590 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-b con 0x7faf8013a4d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7faf8013d530 0x7faf8013d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-a con 0x7faf8013d530 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7faf8008ab40 con 0x7faf8013d530 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7faf80089920 con 0x7faf8008b590 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faf8008a860 con 0x7faf8013a4d0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient(hunting): authenticate will time out at 1069.952578s 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7faf8013d530 0x7faf8013d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7faf8013d530 0x7faf8013d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57416/0 (socket says 10.20.193.7:57416) 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 -- 10.20.193.7:0/3574065247 learned_addr learned my addr 10.20.193.7:0/3574065247 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51348/0 (socket says 10.20.193.7:51348) 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): get_auth_request con 0x7faf8013d530 auth_method 0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): get_auth_request con 0x7faf8013a4d0 auth_method 0 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.481 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7effd640 1 --2- 10.20.193.7:0/3574065247 >> v2:10.20.193.61:3300/0 conn(0x7faf8008b590 0x7faf80139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7effd640 10 monclient(hunting): get_auth_request con 0x7faf8008b590 auth_method 0 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_done global_id 134142 payload 274 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 -- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 msgr2=0x7faf8013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 -- 10.20.193.7:0/3574065247 >> v2:10.20.193.61:3300/0 conn(0x7faf8008b590 msgr2=0x7faf80139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 --2- 10.20.193.7:0/3574065247 >> v2:10.20.193.61:3300/0 conn(0x7faf8008b590 0x7faf80139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 -- 10.20.193.7:0/3574065247 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf80089170 con 0x7faf8013d530 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7e7fc640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:57.482 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7f7fe640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf8013d9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf8008ce20 tx=0x7faf7001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782e7bc886c924fa server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 1 -- 10.20.193.7:0/3574065247 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700b2070 con 0x7faf8013d530 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: dump: 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 1 -- 10.20.193.7:0/3574065247 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf700a57c0 con 0x7faf8013d530 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 1 -- 10.20.193.7:0/3574065247 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700a5bb0 con 0x7faf8013d530 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf7dffb640 10 monclient: dump: 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 5 monclient: authenticate success, global_id 134142 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 4 set_mon_vals no callback set 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: shutdown 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 msgr2=0x7faf8013d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.483 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf8013d9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf8008ce20 tx=0x7faf7001c940 comp rx=0 tx=0).stop 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- 10.20.193.7:0/3574065247 shutdown_connections 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf8013d9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- 10.20.193.7:0/3574065247 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8013a4d0 0x7faf8013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- 10.20.193.7:0/3574065247 >> v2:10.20.193.61:3300/0 conn(0x7faf8008b590 0x7faf80139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- 10.20.193.7:0/3574065247 >> 10.20.193.7:0/3574065247 conn(0x7faf8008faa0 msgr2=0x7faf8008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- 10.20.193.7:0/3574065247 shutdown_connections 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- 10.20.193.7:0/3574065247 wait complete. 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: monmap: 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:57.484 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 Processor -- start 2026-02-22T21:00:57.485 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 -- start start 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: init 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.479+0000 7faf8536e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-c con 0x7faf8008b590 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faf8013a4d0 0x7faf80121bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-b con 0x7faf8013a4d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf80139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): picked mon.noname-a con 0x7faf8013d530 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf801a0db0 con 0x7faf8013d530 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7faf8013aab0 con 0x7faf8013a4d0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7faf801a0f30 con 0x7faf8008b590 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient(hunting): authenticate will time out at 1069.956040s 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51350/0 (socket says 10.20.193.7:51350) 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 -- 10.20.193.7:0/2660066630 learned_addr learned my addr 10.20.193.7:0/2660066630 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): get_auth_request con 0x7faf8008b590 auth_method 0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf80139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): get_auth_request con 0x7faf8013d530 auth_method 0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faf8013a4d0 0x7faf80121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 10 monclient(hunting): get_auth_request con 0x7faf8013a4d0 auth_method 0 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient(hunting): handle_auth_done global_id 124397 payload 824 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 -- 10.20.193.7:0/2660066630 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faf8013a4d0 msgr2=0x7faf80121bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.486 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faf8013a4d0 0x7faf80121bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 -- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 msgr2=0x7faf80139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf80139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 monclient: found mon.noname-c 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 -- 10.20.193.7:0/2660066630 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf80121070 con 0x7faf8008b590 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7f7fe640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf80139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7effd640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf7400e770 tx=0x7faf7400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74017070 con 0x7faf8008b590 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: dump: 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7400c8d0 con 0x7faf8008b590 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 5 monclient: authenticate success, global_id 124397 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400f040 con 0x7faf8008b590 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 10 monclient: dump: 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7d7fa640 4 set_mon_vals no callback set 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _renew_subs 2026-02-22T21:00:57.487 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf80129140 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _renew_subs 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf801066f0 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf80139f90 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7faf74012050 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 --2- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 0x7faf4c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7faf7404e410 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 1 --2- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 0x7faf4c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 10 monclient: get_auth_request con 0x7faf4c03ab20 auth_method 0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.483+0000 7faf7e7fc640 1 --2- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 0x7faf4c05afd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faf801221e0 tx=0x7faf68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.487+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7faf7400a0d0 con 0x7faf8008b590 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.487+0000 7faf5f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.488 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.487+0000 7faf5f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:57.570 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.567+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf80106b60 con 0x7faf4c03ab20 2026-02-22T21:00:57.571 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.567+0000 7faf5f7fe640 1 -- 10.20.193.7:0/2660066630 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34086 (secure 0 0 0) 0x7faf68011970 con 0x7faf4c03ab20 2026-02-22T21:00:57.572 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:00:57.573 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T21:00:57.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 msgr2=0x7faf4c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 0x7faf4c05afd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faf801221e0 tx=0x7faf68008040 comp rx=0 tx=0).stop 2026-02-22T21:00:57.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 10 monclient: shutdown 2026-02-22T21:00:57.573 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 msgr2=0x7faf80128b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf7400e770 tx=0x7faf7400ec30 comp rx=0 tx=0).stop 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 shutdown_connections 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7faf8013d530 0x7faf80139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> v2:10.20.193.61:6800/2336688312 conn(0x7faf4c03ab20 0x7faf4c05afd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7faf8013a4d0 0x7faf80121bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 --2- 10.20.193.7:0/2660066630 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7faf8008b590 0x7faf80128b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 >> 10.20.193.7:0/2660066630 conn(0x7faf8008faa0 msgr2=0x7faf8013b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 shutdown_connections 2026-02-22T21:00:57.574 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.571+0000 7faf8536e640 1 -- 10.20.193.7:0/2660066630 wait complete. 2026-02-22T21:00:57.582 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":578,"stamp":"2026-02-22T21:00:55.971341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":176280,"kb_used_data":14520,"kb_used_omap":1199,"kb_used_meta":160464,"kb_avail":566054760,"statfs":{"total":579820584960,"available":579640074240,"internally_reserved":0,"allocated":14868480,"data_stored":7596886,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":1228230,"internal_metadata":164315706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.092000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887799+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T21:00:50.887799+0000","last_peered":"2026-02-22T21:00:50.887799+0000","last_clean":"2026-02-22T21:00:50.887799+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T21:00:50.887799+0000","last_undegraded":"2026-02-22T21:00:50.887799+0000","last_fullsized":"2026-02-22T21:00:50.887799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.889446+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T21:00:50.889446+0000","last_peered":"2026-02-22T21:00:50.889446+0000","last_clean":"2026-02-22T21:00:50.889446+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T21:00:50.889446+0000","last_undegraded":"2026-02-22T21:00:50.889446+0000","last_fullsized":"2026-02-22T21:00:50.889446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887547+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T21:00:50.887547+0000","last_peered":"2026-02-22T21:00:50.887547+0000","last_clean":"2026-02-22T21:00:50.887547+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T21:00:50.887547+0000","last_undegraded":"2026-02-22T21:00:50.887547+0000","last_fullsized":"2026-02-22T21:00:50.887547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887796+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T21:00:50.887796+0000","last_peered":"2026-02-22T21:00:50.887796+0000","last_clean":"2026-02-22T21:00:50.887796+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T21:00:50.887796+0000","last_undegraded":"2026-02-22T21:00:50.887796+0000","last_fullsized":"2026-02-22T21:00:50.887796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":595,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887965+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T21:00:50.887965+0000","last_peered":"2026-02-22T21:00:50.887965+0000","last_clean":"2026-02-22T21:00:50.887965+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T21:00:50.887965+0000","last_undegraded":"2026-02-22T21:00:50.887965+0000","last_fullsized":"2026-02-22T21:00:50.887965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":606,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888343+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T21:00:50.888343+0000","last_peered":"2026-02-22T21:00:50.888343+0000","last_clean":"2026-02-22T21:00:50.888343+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T21:00:50.888343+0000","last_undegraded":"2026-02-22T21:00:50.888343+0000","last_fullsized":"2026-02-22T21:00:50.888343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887403+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T21:00:50.887403+0000","last_peered":"2026-02-22T21:00:50.887403+0000","last_clean":"2026-02-22T21:00:50.887403+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T21:00:50.887403+0000","last_undegraded":"2026-02-22T21:00:50.887403+0000","last_fullsized":"2026-02-22T21:00:50.887403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":594,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888085+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T21:00:50.888085+0000","last_peered":"2026-02-22T21:00:50.888085+0000","last_clean":"2026-02-22T21:00:50.888085+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T21:00:50.888085+0000","last_undegraded":"2026-02-22T21:00:50.888085+0000","last_fullsized":"2026-02-22T21:00:50.888085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":744,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887677+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T21:00:50.887677+0000","last_peered":"2026-02-22T21:00:50.887677+0000","last_clean":"2026-02-22T21:00:50.887677+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T21:00:50.887677+0000","last_undegraded":"2026-02-22T21:00:50.887677+0000","last_fullsized":"2026-02-22T21:00:50.887677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640364,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":196,"kb_used_meta":26747,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":200908,"internal_metadata":27389748},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640363,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":202,"kb_used_meta":26741,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":207417,"internal_metadata":27383239},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640364,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":211322,"internal_metadata":27379334},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640363,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210022,"internal_metadata":27380634},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640363,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":203,"kb_used_meta":26740,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208720,"internal_metadata":27381936},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640363,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":189841,"internal_metadata":27400815},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:00:57.583 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T21:00:57.584 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:00:57.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: get_monmap_and_config 2026-02-22T21:00:57.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: monmap: 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:57.653376+0000 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:57.653376+0000 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.673 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.674 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 Processor -- start 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 -- start start 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: init 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient: _add_conns ranks=[0,3,4,2,1] 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f904c13f290 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:57.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-a con 0x7f904c13fd70 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f904c180d00 0x7f904c1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-c con 0x7f904c180d00 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904c08fd70 con 0x7f904c13f290 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f904c08e1f0 con 0x7f904c13fd70 2026-02-22T21:00:57.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f904c08ec90 con 0x7f904c180d00 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9052ff0640 10 monclient(hunting): authenticate will time out at 1070.126427s 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9050d65640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f904c13f290 0x7f904c13f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53342/0 (socket says 10.20.193.7:53342) 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57434/0 (socket says 10.20.193.7:57434) 2026-02-22T21:00:57.677 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9050d65640 1 -- 10.20.193.7:0/3960657585 learned_addr learned my addr 10.20.193.7:0/3960657585 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:57.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): get_auth_request con 0x7f904c13fd70 auth_method 0 2026-02-22T21:00:57.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.678 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 1 --2- 10.20.193.7:0/3960657585 >> v2:10.20.193.61:3300/0 conn(0x7f904c180d00 0x7f904c1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): get_auth_request con 0x7f904c180d00 auth_method 0 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.679 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient(hunting): handle_auth_done global_id 134148 payload 274 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 -- 10.20.193.7:0/3960657585 >> v2:10.20.193.61:3300/0 conn(0x7f904c180d00 msgr2=0x7f904c1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 --2- 10.20.193.7:0/3960657585 >> v2:10.20.193.61:3300/0 conn(0x7f904c180d00 0x7f904c1a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 -- 10.20.193.7:0/3960657585 >> v1:10.20.193.7:6789/0 conn(0x7f904c13f290 legacy=0x7f904c13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.680 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f9043fff640 1 -- 10.20.193.7:0/3960657585 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c092bc0 con 0x7f904c13fd70 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f90437fe640 1 -- 10.20.193.7:0/3960657585 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278354381 0 0) 0x7f903c002920 con 0x7f904c13f290 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.651+0000 7f90437fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:00:57.681 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 1 --2- 10.20.193.7:0/3960657585 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c13fd70 0x7f904c1807c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f904c1401b0 tx=0x7f903401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3cce0ed1080ca3 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 1 -- 10.20.193.7:0/3960657585 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340ab660 con 0x7f904c13fd70 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: dump: 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.682 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.683 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 1 -- 10.20.193.7:0/3960657585 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340b0070 con 0x7f904c13fd70 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 1 -- 10.20.193.7:0/3960657585 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340aba20 con 0x7f904c13fd70 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 5 monclient: authenticate success, global_id 134148 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 4 set_mon_vals no callback set 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90437fe640 10 monclient: dump: 2026-02-22T21:00:57.684 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.685 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: shutdown 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/3960657585 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c13fd70 msgr2=0x7f904c1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- 10.20.193.7:0/3960657585 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c13fd70 0x7f904c1807c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f904c1401b0 tx=0x7f903401c460 comp rx=0 tx=0).stop 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/3960657585 shutdown_connections 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- 10.20.193.7:0/3960657585 >> v2:10.20.193.61:3300/0 conn(0x7f904c180d00 0x7f904c1a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- 10.20.193.7:0/3960657585 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/3960657585 >> 10.20.193.7:0/3960657585 conn(0x7f904c093df0 msgr2=0x7f904c0902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.686 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/3960657585 shutdown_connections 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/3960657585 wait complete. 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: monmap: 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.687 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 Processor -- start 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- start start 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: init 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T21:00:57.688 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f904c13f290 0x7f904c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-b con 0x7f904c13f290 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-c con 0x7f904c13fd70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): picked mon.noname-a con 0x7f904c180d00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f904c1a3fc0 con 0x7f904c180d00 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.689 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f904c1a3e40 con 0x7f904c13f290 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f904c1a4140 con 0x7f904c13fd70 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient(hunting): authenticate will time out at 1070.130515s 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:57448/0 (socket says 10.20.193.7:57448) 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 -- 10.20.193.7:0/2901918792 learned_addr learned my addr 10.20.193.7:0/2901918792 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.690 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): get_auth_request con 0x7f904c180d00 auth_method 0 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): get_auth_request con 0x7f904c13fd70 auth_method 0 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.691 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9050d65640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f904c13f290 0x7f904c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9050d65640 10 monclient(hunting): get_auth_request con 0x7f904c13f290 auth_method 0 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9050d65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9050d65640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9050d65640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.692 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9043fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient(hunting): handle_auth_done global_id 134154 payload 824 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 -- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f904c13fd70 msgr2=0x7f904c1807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 -- 10.20.193.7:0/2901918792 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f904c13f290 msgr2=0x7f904c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f904c13f290 0x7f904c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 -- 10.20.193.7:0/2901918792 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c10d660 con 0x7f904c180d00 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9051566640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9048009cf0 tx=0x7f904800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.693 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048018030 con 0x7f904c180d00 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: dump: 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.694 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904800ccd0 con 0x7f904c180d00 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048003c90 con 0x7f904c180d00 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 10 monclient: dump: 2026-02-22T21:00:57.695 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 5 monclient: authenticate success, global_id 134154 2026-02-22T21:00:57.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _renew_subs 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9042ffd640 4 set_mon_vals no callback set 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c10c7f0 con 0x7f904c180d00 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _renew_subs 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c10d0a0 con 0x7f904c180d00 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c10d2a0 con 0x7f904c180d00 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f9048025060 con 0x7f904c180d00 2026-02-22T21:00:57.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 --2- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 0x7f901c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.655+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f904804f040 con 0x7f904c180d00 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f9050d65640 1 --2- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 0x7f901c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f9050d65640 10 monclient: get_auth_request con 0x7f901c03ab20 auth_method 0 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f9050d65640 1 --2- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 0x7f901c05afd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f903c002770 tx=0x7f903c007ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f904c10d2a0 con 0x7f904c180d00 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f90417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.698 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.659+0000 7f90417fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:57.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f904c05fb70 con 0x7f901c03ab20 2026-02-22T21:00:57.741 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f90417fa640 1 -- 10.20.193.7:0/2901918792 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34086 (secure 0 0 0) 0x7f904c05fb70 con 0x7f901c03ab20 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 msgr2=0x7f901c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 0x7f901c05afd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f903c002770 tx=0x7f903c007ab0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 10 monclient: shutdown 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 msgr2=0x7f904c128ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9048009cf0 tx=0x7f904800c490 comp rx=0 tx=0).stop 2026-02-22T21:00:57.742 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 shutdown_connections 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f904c180d00 0x7f904c128ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f904c13fd70 0x7f904c1807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> v2:10.20.193.61:6800/2336688312 conn(0x7f901c03ab20 0x7f901c05afd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 --2- 10.20.193.7:0/2901918792 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f904c13f290 0x7f904c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 >> 10.20.193.7:0/2901918792 conn(0x7f904c093df0 msgr2=0x7f904c13d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 shutdown_connections 2026-02-22T21:00:57.743 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.739+0000 7f9052ff0640 1 -- 10.20.193.7:0/2901918792 wait complete. 2026-02-22T21:00:57.751 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":578,"stamp":"2026-02-22T21:00:55.971341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":176280,"kb_used_data":14520,"kb_used_omap":1199,"kb_used_meta":160464,"kb_avail":566054760,"statfs":{"total":579820584960,"available":579640074240,"internally_reserved":0,"allocated":14868480,"data_stored":7596886,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":1228230,"internal_metadata":164315706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.092000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887799+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T21:00:50.887799+0000","last_peered":"2026-02-22T21:00:50.887799+0000","last_clean":"2026-02-22T21:00:50.887799+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T21:00:50.887799+0000","last_undegraded":"2026-02-22T21:00:50.887799+0000","last_fullsized":"2026-02-22T21:00:50.887799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.889446+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T21:00:50.889446+0000","last_peered":"2026-02-22T21:00:50.889446+0000","last_clean":"2026-02-22T21:00:50.889446+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T21:00:50.889446+0000","last_undegraded":"2026-02-22T21:00:50.889446+0000","last_fullsized":"2026-02-22T21:00:50.889446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887547+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T21:00:50.887547+0000","last_peered":"2026-02-22T21:00:50.887547+0000","last_clean":"2026-02-22T21:00:50.887547+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T21:00:50.887547+0000","last_undegraded":"2026-02-22T21:00:50.887547+0000","last_fullsized":"2026-02-22T21:00:50.887547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":604,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887796+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T21:00:50.887796+0000","last_peered":"2026-02-22T21:00:50.887796+0000","last_clean":"2026-02-22T21:00:50.887796+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T21:00:50.887796+0000","last_undegraded":"2026-02-22T21:00:50.887796+0000","last_fullsized":"2026-02-22T21:00:50.887796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":595,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887965+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T21:00:50.887965+0000","last_peered":"2026-02-22T21:00:50.887965+0000","last_clean":"2026-02-22T21:00:50.887965+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T21:00:50.887965+0000","last_undegraded":"2026-02-22T21:00:50.887965+0000","last_fullsized":"2026-02-22T21:00:50.887965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":606,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888343+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T21:00:50.888343+0000","last_peered":"2026-02-22T21:00:50.888343+0000","last_clean":"2026-02-22T21:00:50.888343+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T21:00:50.888343+0000","last_undegraded":"2026-02-22T21:00:50.888343+0000","last_fullsized":"2026-02-22T21:00:50.888343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":609,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887403+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T21:00:50.887403+0000","last_peered":"2026-02-22T21:00:50.887403+0000","last_clean":"2026-02-22T21:00:50.887403+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T21:00:50.887403+0000","last_undegraded":"2026-02-22T21:00:50.887403+0000","last_fullsized":"2026-02-22T21:00:50.887403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":594,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.888085+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T21:00:50.888085+0000","last_peered":"2026-02-22T21:00:50.888085+0000","last_clean":"2026-02-22T21:00:50.888085+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T21:00:50.888085+0000","last_undegraded":"2026-02-22T21:00:50.888085+0000","last_fullsized":"2026-02-22T21:00:50.888085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":744,"reported_epoch":313,"state":"active+clean","last_fresh":"2026-02-22T21:00:50.887677+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T21:00:50.887677+0000","last_peered":"2026-02-22T21:00:50.887677+0000","last_clean":"2026-02-22T21:00:50.887677+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T21:00:50.887677+0000","last_undegraded":"2026-02-22T21:00:50.887677+0000","last_fullsized":"2026-02-22T21:00:50.887677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640364,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":196,"kb_used_meta":26747,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":200908,"internal_metadata":27389748},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640363,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":202,"kb_used_meta":26741,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":207417,"internal_metadata":27383239},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640364,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":211322,"internal_metadata":27379334},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640363,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29360,"kb_used_data":2400,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94342480,"statfs":{"total":96636764160,"available":96606699520,"internally_reserved":0,"allocated":2457600,"data_stored":1069352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210022,"internal_metadata":27380634},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640363,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29364,"kb_used_data":2404,"kb_used_omap":203,"kb_used_meta":26740,"kb_avail":94342476,"statfs":{"total":96636764160,"available":96606695424,"internally_reserved":0,"allocated":2461696,"data_stored":1069371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208720,"internal_metadata":27381936},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640363,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29416,"kb_used_data":2456,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94342424,"statfs":{"total":96636764160,"available":96606642176,"internally_reserved":0,"allocated":2514944,"data_stored":1659720,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":189841,"internal_metadata":27400815},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:00:57.752 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: get_monmap_and_config 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: monmap: 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:57.813049+0000 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:57.813049+0000 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.813 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:57.814 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 Processor -- start 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 -- start start 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: init 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f60c013f290 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:57.817 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-c con 0x7f60c013fd70 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f60c0180d00 0x7f60c01a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-a con 0x7f60c0180d00 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c008fd70 con 0x7f60c013f290 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f60c008e1f0 con 0x7f60c0180d00 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f60c008ec90 con 0x7f60c013fd70 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c7ae4640 10 monclient(hunting): authenticate will time out at 1070.285993s 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5859640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f60c013f290 0x7f60c013f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:53352/0 (socket says 10.20.193.7:53352) 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5859640 1 -- 10.20.193.7:0/2508951260 learned_addr learned my addr 10.20.193.7:0/2508951260 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 --2- 10.20.193.7:0/2508951260 >> v2:10.20.193.7:3300/0 conn(0x7f60c0180d00 0x7f60c01a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): get_auth_request con 0x7f60c0180d00 auth_method 0 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.818 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5058640 1 --2- 10.20.193.7:0/2508951260 >> v2:10.20.193.61:3300/0 conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5058640 10 monclient(hunting): get_auth_request con 0x7f60c013fd70 auth_method 0 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5058640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5058640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c5058640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.819 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient(hunting): handle_auth_done global_id 134157 payload 274 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 -- 10.20.193.7:0/2508951260 >> v2:10.20.193.61:3300/0 conn(0x7f60c013fd70 msgr2=0x7f60c01807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 --2- 10.20.193.7:0/2508951260 >> v2:10.20.193.61:3300/0 conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 -- 10.20.193.7:0/2508951260 >> v1:10.20.193.7:6789/0 conn(0x7f60c013f290 legacy=0x7f60c013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.811+0000 7f60c605a640 1 -- 10.20.193.7:0/2508951260 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c0092bc0 con 0x7f60c0180d00 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c605a640 1 --2- 10.20.193.7:0/2508951260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c0180d00 0x7f60c01a10e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60c0092f70 tx=0x7f60bc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ddb80ed34747c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 1 -- 10.20.193.7:0/2508951260 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b2070 con 0x7f60c0180d00 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: dump: 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.820 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 1 -- 10.20.193.7:0/2508951260 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc0a5910 con 0x7f60c0180d00 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 5 monclient: authenticate success, global_id 134157 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 1 -- 10.20.193.7:0/2508951260 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0a5d00 con 0x7f60c0180d00 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 4 set_mon_vals no callback set 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.821 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c4857640 10 monclient: dump: 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: shutdown 2026-02-22T21:00:57.822 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/2508951260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c0180d00 msgr2=0x7f60c01a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/2508951260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c0180d00 0x7f60c01a10e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60c0092f70 tx=0x7f60bc01c850 comp rx=0 tx=0).stop 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/2508951260 shutdown_connections 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/2508951260 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c0180d00 0x7f60c01a10e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/2508951260 >> v2:10.20.193.61:3300/0 conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/2508951260 >> 10.20.193.7:0/2508951260 conn(0x7f60c0093df0 msgr2=0x7f60c00902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/2508951260 shutdown_connections 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/2508951260 wait complete. 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: build_initial_monmap 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: monmap: 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:57.823 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 Processor -- start 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- start start 2026-02-22T21:00:57.824 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: init 2026-02-22T21:00:57.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:57.827 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 0x7f60c012bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-c con 0x7f60c013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-a con 0x7f60c013fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f60c0180d00 0x7f60c012c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): picked mon.noname-b con 0x7f60c0180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60c01a4050 con 0x7f60c013fd70 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f60c0090da0 con 0x7f60c0180d00 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f60c01a41d0 con 0x7f60c013f290 2026-02-22T21:00:57.828 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient(hunting): authenticate will time out at 1070.290114s 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 0x7f60c012bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 0x7f60c012bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:51374/0 (socket says 10.20.193.7:51374) 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 1 -- 10.20.193.7:0/3495848606 learned_addr learned my addr 10.20.193.7:0/3495848606 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): get_auth_request con 0x7f60c013f290 auth_method 0 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): get_auth_request con 0x7f60c013fd70 auth_method 0 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.829 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient(hunting): handle_auth_done global_id 134163 payload 824 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 -- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 msgr2=0x7f60c012bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 0x7f60c012bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 -- 10.20.193.7:0/3495848606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f60c0180d00 msgr2=0x7f60c012c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f60c0180d00 0x7f60c012c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient: _finish_hunting 0 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 monclient: found mon.noname-a 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 -- 10.20.193.7:0/3495848606 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c013ead0 con 0x7f60c013fd70 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5058640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 0x7f60c01807c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60b400e7e0 tx=0x7f60b400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4017070 con 0x7f60c013fd70 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:57.830 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: dump: 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b400c6d0 con 0x7f60c013fd70 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b400f040 con 0x7f60c013fd70 2026-02-22T21:00:57.831 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 10 monclient: dump: 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60affff640 4 set_mon_vals no callback set 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 5 monclient: authenticate success, global_id 134163 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _renew_subs 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c008a9e0 con 0x7f60c013fd70 2026-02-22T21:00:57.832 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _renew_subs 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c012ca60 con 0x7f60c013fd70 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c013f660 con 0x7f60c013fd70 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f60b4012050 con 0x7f60c013fd70 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 --2- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 0x7f609005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f60b404e320 con 0x7f60c013fd70 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 1 --2- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 0x7f609005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.815+0000 7f60c5859640 10 monclient: get_auth_request con 0x7f609003ab20 auth_method 0 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.819+0000 7f60c5859640 1 --2- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 0x7f609005afd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60b0002770 tx=0x7f60b00029b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.819+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f60b4015db0 con 0x7f60c013fd70 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.819+0000 7f60ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:57.833 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.819+0000 7f60ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60c005fb70 con 0x7f60c013fd70 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60ae7fc640 1 -- 10.20.193.7:0/3495848606 <== mon.0 v2:10.20.193.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v314) ==== 74+0+10870 (secure 0 0 0) 0x7f60b404d2a0 con 0x7f60c013fd70 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60ae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:00:57.905 INFO:teuthology.orchestra.run.trial007.stdout:{"epoch":314,"fsid":"ec79d088-5ee7-4a8c-8cac-a194b076cc72","created":"2026-02-22T20:52:01.151000+0000","modified":"2026-02-22T21:00:53.830479+0000","last_up_change":"2026-02-22T20:52:06.185700+0000","last_in_change":"2026-02-22T20:52:02.319702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T20:52:07.953655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T20:52:10.131782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9fd6863-f28a-4c0f-befd-40a634c44bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6800","nonce":2743492886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6801","nonce":2743492886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6805","nonce":2743492886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6803","nonce":2743492886}]},"public_addr":"10.20.193.7:6800/2743492886","cluster_addr":"10.20.193.7:6801/2743492886","heartbeat_back_addr":"10.20.193.7:6805/2743492886","heartbeat_front_addr":"10.20.193.7:6803/2743492886","state":["exists","up"]},{"osd":1,"uuid":"a57b05b8-207a-47ab-a248-c9deb6dea261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6802","nonce":2057498835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6804","nonce":2057498835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6807","nonce":2057498835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6806","nonce":2057498835}]},"public_addr":"10.20.193.7:6802/2057498835","cluster_addr":"10.20.193.7:6804/2057498835","heartbeat_back_addr":"10.20.193.7:6807/2057498835","heartbeat_front_addr":"10.20.193.7:6806/2057498835","state":["exists","up"]},{"osd":2,"uuid":"1e035cce-ceb4-4867-bd15-6b83dc07e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6808","nonce":1121527665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6809","nonce":1121527665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6811","nonce":1121527665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.7:6810","nonce":1121527665}]},"public_addr":"10.20.193.7:6808/1121527665","cluster_addr":"10.20.193.7:6809/1121527665","heartbeat_back_addr":"10.20.193.7:6811/1121527665","heartbeat_front_addr":"10.20.193.7:6810/1121527665","state":["exists","up"]},{"osd":3,"uuid":"49157d62-16e1-4563-9c5d-95d0bde3e8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":3528802164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":3528802164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":3528802164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":3528802164}]},"public_addr":"10.20.193.61:6802/3528802164","cluster_addr":"10.20.193.61:6804/3528802164","heartbeat_back_addr":"10.20.193.61:6808/3528802164","heartbeat_front_addr":"10.20.193.61:6806/3528802164","state":["exists","up"]},{"osd":4,"uuid":"85daa601-dea8-4ae4-96a9-e63025b59fa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6801","nonce":461213399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6803","nonce":461213399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6807","nonce":461213399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6805","nonce":461213399}]},"public_addr":"10.20.193.61:6801/461213399","cluster_addr":"10.20.193.61:6803/461213399","heartbeat_back_addr":"10.20.193.61:6807/461213399","heartbeat_front_addr":"10.20.193.61:6805/461213399","state":["exists","up"]},{"osd":5,"uuid":"1b76906c-4806-416b-a8e1-e379d468ee76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":311,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6809","nonce":837853154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":837853154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":837853154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6811","nonce":837853154}]},"public_addr":"10.20.193.61:6809/837853154","cluster_addr":"10.20.193.61:6810/837853154","heartbeat_back_addr":"10.20.193.61:6812/837853154","heartbeat_front_addr":"10.20.193.61:6811/837853154","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.785843+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.800858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.896444+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.844928+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.826603+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T20:52:04.793535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 msgr2=0x7f609005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 0x7f609005afd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f60b0002770 tx=0x7f60b00029b0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 10 monclient: shutdown 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 msgr2=0x7f60c01807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 0x7f60c01807c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60b400e7e0 tx=0x7f60b400eca0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 shutdown_connections 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> v2:10.20.193.61:6800/2336688312 conn(0x7f609003ab20 0x7f609005afd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f60c0180d00 0x7f60c012c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f60c013fd70 0x7f60c01807c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 --2- 10.20.193.7:0/3495848606 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f60c013f290 0x7f60c012bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 >> 10.20.193.7:0/3495848606 conn(0x7f60c0093df0 msgr2=0x7f60c0055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 shutdown_connections 2026-02-22T21:00:57.906 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:57.903+0000 7f60c7ae4640 1 -- 10.20.193.7:0/3495848606 wait complete. 2026-02-22T21:00:58.916 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T21:00:58.916 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:00:58.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.975+0000 7fad8ec11640 10 monclient: get_monmap_and_config 2026-02-22T21:00:58.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.975+0000 7fad8ec11640 10 monclient: build_initial_monmap 2026-02-22T21:00:58.996 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.975+0000 7fad8ec11640 10 monclient: monmap: 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:58.979455+0000 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:58.979455+0000 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:58.997 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 Processor -- start 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- start start 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: init 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-b con 0x7fad8813f6b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fad8813ffc0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:58.998 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fad8808a640 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8808f230 con 0x7fad8808a640 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8808b270 con 0x7fad8813ffc0 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fad8805bab0 con 0x7fad8813f6b0 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): authenticate will time out at 1071.452348s 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fad8808a640 0x7fad8808aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57158/0 (socket says 10.20.193.7:57158) 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47246/0 (socket says 10.20.193.7:47246) 2026-02-22T21:00:58.999 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 1 -- 10.20.193.7:0/2792501250 learned_addr learned my addr 10.20.193.7:0/2792501250 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): get_auth_request con 0x7fad8813f6b0 auth_method 0 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 1 -- 10.20.193.7:0/2792501250 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264368741 0 0) 0x7fad8808f230 con 0x7fad8808a640 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_done global_id 124406 payload 274 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 -- 10.20.193.7:0/2792501250 >> v1:10.20.193.61:6789/0 conn(0x7fad8813ffc0 legacy=0x7fad88089f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 -- 10.20.193.7:0/2792501250 >> v1:10.20.193.7:6789/0 conn(0x7fad8808a640 legacy=0x7fad8808aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.000 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 monclient: found mon.noname-b 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 -- 10.20.193.7:0/2792501250 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8808bda0 con 0x7fad8813f6b0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 --2- 10.20.193.7:0/2792501250 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad78009840 tx=0x7fad7801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911e11d7d5d510d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 1 -- 10.20.193.7:0/2792501250 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780b0070 con 0x7fad8813f6b0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: dump: 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.001 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.002 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 1 -- 10.20.193.7:0/2792501250 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad780ab600 con 0x7fad8813f6b0 2026-02-22T21:00:59.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 1 -- 10.20.193.7:0/2792501250 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780ab9d0 con 0x7fad8813f6b0 2026-02-22T21:00:59.003 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad7f7fe640 10 monclient: dump: 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.004 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 5 monclient: authenticate success, global_id 124406 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 4 set_mon_vals no callback set 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: shutdown 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.005 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- 10.20.193.7:0/2792501250 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 msgr2=0x7fad8813fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- 10.20.193.7:0/2792501250 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad78009840 tx=0x7fad7801c460 comp rx=0 tx=0).stop 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- 10.20.193.7:0/2792501250 shutdown_connections 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- 10.20.193.7:0/2792501250 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8813f6b0 0x7fad8813fa80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- 10.20.193.7:0/2792501250 >> 10.20.193.7:0/2792501250 conn(0x7fad8808ff90 msgr2=0x7fad8808c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- 10.20.193.7:0/2792501250 shutdown_connections 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- 10.20.193.7:0/2792501250 wait complete. 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: monmap: 2026-02-22T21:00:59.006 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 Processor -- start 2026-02-22T21:00:59.007 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- start start 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: init 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8808a640 0x7fad8813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-c con 0x7fad8808a640 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fad8813f6b0 0x7fad88139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-b con 0x7fad8813f6b0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fad8813ffc0 0x7fad8813a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): picked mon.noname-a con 0x7fad8813ffc0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad881a58e0 con 0x7fad8813ffc0 2026-02-22T21:00:59.008 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fad881a5760 con 0x7fad8813f6b0 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fad881a5a60 con 0x7fad8808a640 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8ec11640 10 monclient(hunting): authenticate will time out at 1071.455806s 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8808a640 0x7fad8813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fad8813ffc0 0x7fad8813a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8808a640 0x7fad8813eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47256/0 (socket says 10.20.193.7:47256) 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 1 -- 10.20.193.7:0/911874151 learned_addr learned my addr 10.20.193.7:0/911874151 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): get_auth_request con 0x7fad8808a640 auth_method 0 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.009 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): get_auth_request con 0x7fad8813ffc0 auth_method 0 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8c986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.979+0000 7fad8d187640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.010 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 10 monclient(hunting): handle_auth_done global_id 134169 payload 824 2026-02-22T21:00:59.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 -- 10.20.193.7:0/911874151 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8808a640 msgr2=0x7fad8813eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 --2- 10.20.193.7:0/911874151 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fad8808a640 0x7fad8813eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 -- 10.20.193.7:0/911874151 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fad8813f6b0 msgr2=0x7fad88139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 --2- 10.20.193.7:0/911874151 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fad8813f6b0 0x7fad88139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.011 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 -- 10.20.193.7:0/911874151 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad880888e0 con 0x7fad8813ffc0 2026-02-22T21:00:59.012 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8d187640 1 --2- 10.20.193.7:0/911874151 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fad8813ffc0 0x7fad8813a4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad84002750 tx=0x7fad8400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84018070 con 0x7fad8813ffc0 2026-02-22T21:00:59.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.013 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: dump: 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.014 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8400ac00 con 0x7fad8813ffc0 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 5 monclient: authenticate success, global_id 134169 2026-02-22T21:00:59.015 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 10 monclient: _renew_subs 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad88086720 con 0x7fad8813ffc0 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad840070d0 con 0x7fad8813ffc0 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: dump: 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.016 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7effd640 4 set_mon_vals no callback set 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 10 monclient: _renew_subs 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8813d9c0 con 0x7fad8813ffc0 2026-02-22T21:00:59.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad8813fa80 con 0x7fad8813ffc0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fad84007270 con 0x7fad8813ffc0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.61:6800/2336688312 conn(0x7fad5803ab20 0x7fad5805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fad8404e680 con 0x7fad8813ffc0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.7:6800/2743492886 conn(0x7fad5805e660 0x7fad5807ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 --> v2:10.20.193.7:6800/2743492886 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad84013e50 con 0x7fad5805e660 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7fad84055050 con 0x7fad8813ffc0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8c986640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.61:6800/2336688312 conn(0x7fad5803ab20 0x7fad5805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8c986640 10 monclient: get_auth_request con 0x7fad5803ab20 auth_method 0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7ffff640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.7:6800/2743492886 conn(0x7fad5805e660 0x7fad5807ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7ffff640 10 monclient: get_auth_request con 0x7fad5805e660 auth_method 0 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7ffff640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.7:6800/2743492886 conn(0x7fad5805e660 0x7fad5807ea70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad8c986640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.61:6800/2336688312 conn(0x7fad5803ab20 0x7fad5805afd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad78019070 tx=0x7fad78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.983+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== osd.0 v2:10.20.193.7:6800/2743492886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fad84013e50 con 0x7fad5805e660 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 --> v2:10.20.193.7:6800/2743492886 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad8813dd60 con 0x7fad5805e660 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad7d7fa640 1 -- 10.20.193.7:0/911874151 <== osd.0 v2:10.20.193.7:6800/2743492886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad8813dd60 con 0x7fad5805e660 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:59.019 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:00:59.020 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:59.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 >> v2:10.20.193.7:6800/2743492886 conn(0x7fad5805e660 msgr2=0x7fad5807ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.7:6800/2743492886 conn(0x7fad5805e660 0x7fad5807ea70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 >> v2:10.20.193.61:6800/2336688312 conn(0x7fad5803ab20 msgr2=0x7fad5805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 --2- 10.20.193.7:0/911874151 >> v2:10.20.193.61:6800/2336688312 conn(0x7fad5803ab20 0x7fad5805afd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad78019070 tx=0x7fad78008040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 10 monclient: shutdown 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fad8813ffc0 msgr2=0x7fad8813a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 --2- 10.20.193.7:0/911874151 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fad8813ffc0 0x7fad8813a4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad84002750 tx=0x7fad8400cf70 comp rx=0 tx=0).stop 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8d187640 1 -- 10.20.193.7:0/911874151 reap_dead start 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 shutdown_connections 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 >> 10.20.193.7:0/911874151 conn(0x7fad8808ff90 msgr2=0x7fad88087840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 shutdown_connections 2026-02-22T21:00:59.022 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:58.991+0000 7fad8ec11640 1 -- 10.20.193.7:0/911874151 wait complete. 2026-02-22T21:00:59.023 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T21:00:59.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: monmap: 2026-02-22T21:00:59.088 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.088 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.083999+0000 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.083999+0000 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.089 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 Processor -- start 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- start start 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: init 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: _add_conns ranks=[4,3,1,0,2] 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f99b0090460 0x7f99b0090830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-c con 0x7f99b0090460 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f99b0090d70 0x7f99b013f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-a con 0x7f99b0090d70 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f99b013fbf0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:59.090 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b0056050 con 0x7f99b013fbf0 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f99b0055c30 con 0x7f99b0090d70 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f99b008ef50 con 0x7f99b0090460 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient(hunting): authenticate will time out at 1071.556917s 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f99b0090d70 0x7f99b013f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f99b0090d70 0x7f99b013f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48216/0 (socket says 10.20.193.7:48216) 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 -- 10.20.193.7:0/1225045531 learned_addr learned my addr 10.20.193.7:0/1225045531 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): get_auth_request con 0x7f99b0090d70 auth_method 0 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.091 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 1 --2- 10.20.193.7:0/1225045531 >> v2:10.20.193.61:3300/0 conn(0x7f99b0090460 0x7f99b0090830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): get_auth_request con 0x7f99b0090460 auth_method 0 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.092 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient(hunting): handle_auth_done global_id 134172 payload 274 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 -- 10.20.193.7:0/1225045531 >> v2:10.20.193.61:3300/0 conn(0x7f99b0090460 msgr2=0x7f99b0090830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 --2- 10.20.193.7:0/1225045531 >> v2:10.20.193.61:3300/0 conn(0x7f99b0090460 0x7f99b0090830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 -- 10.20.193.7:0/1225045531 >> v1:10.20.193.61:6789/0 conn(0x7f99b013fbf0 legacy=0x7f99b01a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 -- 10.20.193.7:0/1225045531 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b008d040 con 0x7f99b0090d70 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99aeffd640 1 --2- 10.20.193.7:0/1225045531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b0090d70 0x7f99b013f6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99b0059800 tx=0x7f99a001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccda188ed1a1b63 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 1 -- 10.20.193.7:0/1225045531 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00a6040 con 0x7f99b0090d70 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.093 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: dump: 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.094 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 1 -- 10.20.193.7:0/1225045531 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a00af070 con 0x7f99b0090d70 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 1 -- 10.20.193.7:0/1225045531 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00aa860 con 0x7f99b0090d70 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 5 monclient: authenticate success, global_id 134172 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 4 set_mon_vals no callback set 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99ae7fc640 10 monclient: dump: 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.095 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 10 monclient: shutdown 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- 10.20.193.7:0/1225045531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b0090d70 msgr2=0x7f99b013f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 --2- 10.20.193.7:0/1225045531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b0090d70 0x7f99b013f6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99b0059800 tx=0x7f99a001c4e0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- 10.20.193.7:0/1225045531 shutdown_connections 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 --2- 10.20.193.7:0/1225045531 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b0090d70 0x7f99b013f6b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 --2- 10.20.193.7:0/1225045531 >> v2:10.20.193.61:3300/0 conn(0x7f99b0090460 0x7f99b0090830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- 10.20.193.7:0/1225045531 >> 10.20.193.7:0/1225045531 conn(0x7f99b008e050 msgr2=0x7f99b008e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.096 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- 10.20.193.7:0/1225045531 shutdown_connections 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.083+0000 7f99b5d21640 1 -- 10.20.193.7:0/1225045531 wait complete. 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: monmap: 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.097 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 Processor -- start 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- start start 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: init 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.101 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-c con 0x7f99b0090460 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f99b0090d70 0x7f99b0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-b con 0x7f99b0090d70 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b013fbf0 0x7f99b007bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): picked mon.noname-a con 0x7f99b013fbf0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f99b0140400 con 0x7f99b013fbf0 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f99b008c320 con 0x7f99b0090d70 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f99b0091190 con 0x7f99b0090460 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient(hunting): authenticate will time out at 1071.561141s 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.102 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47272/0 (socket says 10.20.193.7:47272) 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 -- 10.20.193.7:0/3481519038 learned_addr learned my addr 10.20.193.7:0/3481519038 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): get_auth_request con 0x7f99b0090460 auth_method 0 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b013fbf0 0x7f99b007bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): get_auth_request con 0x7f99b013fbf0 auth_method 0 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f99b0090d70 0x7f99b0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 10 monclient(hunting): get_auth_request con 0x7f99b0090d70 auth_method 0 2026-02-22T21:00:59.103 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient(hunting): handle_auth_done global_id 124412 payload 824 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 -- 10.20.193.7:0/3481519038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f99b0090d70 msgr2=0x7f99b0151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f99b0090d70 0x7f99b0151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 -- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b013fbf0 msgr2=0x7f99b007bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b013fbf0 0x7f99b007bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 monclient: found mon.noname-c 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 -- 10.20.193.7:0/3481519038 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b0088740 con 0x7f99b0090460 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99af7fe640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f999c006b80 tx=0x7f999c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c017070 con 0x7f99b0090460 2026-02-22T21:00:59.104 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: dump: 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c00c8e0 con 0x7f99b0090460 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.105 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c00ccb0 con 0x7f99b0090460 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 10 monclient: dump: 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99adffb640 4 set_mon_vals no callback set 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 5 monclient: authenticate success, global_id 124412 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _renew_subs 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b00881c0 con 0x7f99b0090460 2026-02-22T21:00:59.106 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _renew_subs 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b007f500 con 0x7f99b0090460 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b0090830 con 0x7f99b0090460 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f999c013470 con 0x7f99b0090460 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 --2- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 0x7f998005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f999c04ed90 con 0x7f99b0090460 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 1 --2- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 0x7f998005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 10 monclient: get_auth_request con 0x7f998003ab20 auth_method 0 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.087+0000 7f99aeffd640 1 --2- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 0x7f998005afd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f99a001c520 tx=0x7f99a00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.091+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f99b0088740 con 0x7f99b0090460 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.091+0000 7f998bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.107 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.091+0000 7f998bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:59.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f99b005fc00 con 0x7f998003ab20 2026-02-22T21:00:59.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f998bfff640 1 -- 10.20.193.7:0/3481519038 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f99b005fc00 con 0x7f998003ab20 2026-02-22T21:00:59.174 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 msgr2=0x7f998005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 0x7f998005afd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f99a001c520 tx=0x7f99a00a7000 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 10 monclient: shutdown 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 msgr2=0x7f99b0150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f999c006b80 tx=0x7f999c00ed40 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 shutdown_connections 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f99b013fbf0 0x7f99b007bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> v2:10.20.193.61:6800/2336688312 conn(0x7f998003ab20 0x7f998005afd0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f99b0090d70 0x7f99b0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 --2- 10.20.193.7:0/3481519038 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f99b0090460 0x7f99b0150dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 >> 10.20.193.7:0/3481519038 conn(0x7f99b008e050 msgr2=0x7f99b0085780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 shutdown_connections 2026-02-22T21:00:59.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.171+0000 7f99b5d21640 1 -- 10.20.193.7:0/3481519038 wait complete. 2026-02-22T21:00:59.184 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T21:00:59.184 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: monmap: 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.252853+0000 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.252853+0000 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.253 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 Processor -- start 2026-02-22T21:00:59.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 -- start start 2026-02-22T21:00:59.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: init 2026-02-22T21:00:59.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.254 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb3808e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-b con 0x7fbb38085170 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb3808e980 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-a con 0x7fbb3808ed90 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb380855e0 con 0x7fbb3808e980 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3808b4a0 con 0x7fbb3808ed90 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3808be00 con 0x7fbb38085170 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb3de8e640 10 monclient(hunting): authenticate will time out at 1071.726105s 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb3808e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb36ffd640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fbb3808e980 0x7fbb3817c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57162/0 (socket says 10.20.193.7:57162) 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48234/0 (socket says 10.20.193.7:48234) 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb36ffd640 1 -- 10.20.193.7:0/3110138828 learned_addr learned my addr 10.20.193.7:0/3110138828 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): get_auth_request con 0x7fbb38085170 auth_method 0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): get_auth_request con 0x7fbb3808ed90 auth_method 0 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.255 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient(hunting): handle_auth_done global_id 124415 payload 274 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 -- 10.20.193.7:0/3110138828 >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 msgr2=0x7fbb3819ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 --2- 10.20.193.7:0/3110138828 >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 -- 10.20.193.7:0/3110138828 >> v1:10.20.193.7:6789/0 conn(0x7fbb3808e980 legacy=0x7fbb3817c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 monclient: found mon.noname-b 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb377fe640 1 -- 10.20.193.7:0/3110138828 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb380844b0 con 0x7fbb38085170 2026-02-22T21:00:59.256 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.251+0000 7fbb37fff640 1 --2- 10.20.193.7:0/3110138828 >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 1 --2- 10.20.193.7:0/3110138828 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb3808e440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb24004780 tx=0x7fbb24025100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3526ccec3814fbaf server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 1 -- 10.20.193.7:0/3110138828 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240b9070 con 0x7fbb38085170 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: dump: 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.257 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 1 -- 10.20.193.7:0/3110138828 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb240b4600 con 0x7fbb38085170 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 1 -- 10.20.193.7:0/3110138828 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240b49d0 con 0x7fbb38085170 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb367fc640 10 monclient: dump: 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 5 monclient: authenticate success, global_id 124415 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 4 set_mon_vals no callback set 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: shutdown 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/3110138828 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 msgr2=0x7fbb3808e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/3110138828 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb3808e440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb24004780 tx=0x7fbb24025100 comp rx=0 tx=0).stop 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/3110138828 shutdown_connections 2026-02-22T21:00:59.258 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/3110138828 >> v2:10.20.193.7:3300/0 conn(0x7fbb3808ed90 0x7fbb3819ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/3110138828 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb3808e440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/3110138828 >> 10.20.193.7:0/3110138828 conn(0x7fbb3808ff90 msgr2=0x7fbb3808c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/3110138828 shutdown_connections 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/3110138828 wait complete. 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: monmap: 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.259 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 Processor -- start 2026-02-22T21:00:59.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- start start 2026-02-22T21:00:59.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: init 2026-02-22T21:00:59.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.261 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb381d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-c con 0x7fbb38085170 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 0x7fbb381d5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-a con 0x7fbb3808e980 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbb3808ed90 0x7fbb381d5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): picked mon.noname-b con 0x7fbb3808ed90 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3808a740 con 0x7fbb3808e980 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3808b790 con 0x7fbb3808ed90 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3808a8c0 con 0x7fbb38085170 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient(hunting): authenticate will time out at 1071.730355s 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 0x7fbb381d5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 0x7fbb381d5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48244/0 (socket says 10.20.193.7:48244) 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 -- 10.20.193.7:0/241673249 learned_addr learned my addr 10.20.193.7:0/241673249 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): get_auth_request con 0x7fbb3808e980 auth_method 0 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.262 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb381d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): get_auth_request con 0x7fbb38085170 auth_method 0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb37fff640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbb3808ed90 0x7fbb381d5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient(hunting): handle_auth_done global_id 134184 payload 824 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 -- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 msgr2=0x7fbb381d54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fbb38085170 0x7fbb381d54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 -- 10.20.193.7:0/241673249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbb3808ed90 msgr2=0x7fbb381d5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fbb3808ed90 0x7fbb381d5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 -- 10.20.193.7:0/241673249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb38086720 con 0x7fbb3808e980 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb36ffd640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 0x7fbb381d5a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb280036c0 tx=0x7fbb2800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28018070 con 0x7fbb3808e980 2026-02-22T21:00:59.263 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: dump: 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb28005de0 con 0x7fbb3808e980 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28004b00 con 0x7fbb3808e980 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: dump: 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.264 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 5 monclient: authenticate success, global_id 134184 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb35ffb640 4 set_mon_vals no callback set 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _renew_subs 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb38083040 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _renew_subs 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3805cbe0 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb3805d250 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fbb28004ca0 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbb0803ab20 0x7fbb0805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fbb2804d9b0 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.7:6802/2057498835 conn(0x7fbb0805e5f0 0x7fbb0807ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 --> v2:10.20.193.7:6802/2057498835 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb0807f070 con 0x7fbb0805e5f0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7fbb280522a0 con 0x7fbb3808e980 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb13fff640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbb0803ab20 0x7fbb0805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb377fe640 10 monclient: get_auth_request con 0x7fbb0803ab20 auth_method 0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb37fff640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.7:6802/2057498835 conn(0x7fbb0805e5f0 0x7fbb0807ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb37fff640 10 monclient: get_auth_request con 0x7fbb0805e5f0 auth_method 0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.255+0000 7fbb37fff640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.7:6802/2057498835 conn(0x7fbb0805e5f0 0x7fbb0807ea00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.265 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.259+0000 7fbb377fe640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbb0803ab20 0x7fbb0805afd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbb24002410 tx=0x7fbb24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.259+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== osd.1 v2:10.20.193.7:6802/2057498835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fbb0807f070 con 0x7fbb0805e5f0 2026-02-22T21:00:59.266 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 --> v2:10.20.193.7:6802/2057498835 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb38078aa0 con 0x7fbb0805e5f0 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb13fff640 1 -- 10.20.193.7:0/241673249 <== osd.1 v2:10.20.193.7:6802/2057498835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb38078aa0 con 0x7fbb0805e5f0 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 >> v2:10.20.193.7:6802/2057498835 conn(0x7fbb0805e5f0 msgr2=0x7fbb0807ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.267 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.7:6802/2057498835 conn(0x7fbb0805e5f0 0x7fbb0807ea00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbb0803ab20 msgr2=0x7fbb0805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/241673249 >> v2:10.20.193.61:6800/2336688312 conn(0x7fbb0803ab20 0x7fbb0805afd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbb24002410 tx=0x7fbb24008040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 10 monclient: shutdown 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 msgr2=0x7fbb381d5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 --2- 10.20.193.7:0/241673249 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fbb3808e980 0x7fbb381d5a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb280036c0 tx=0x7fbb2800c960 comp rx=0 tx=0).stop 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb37fff640 1 -- 10.20.193.7:0/241673249 reap_dead start 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 shutdown_connections 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 >> 10.20.193.7:0/241673249 conn(0x7fbb3808ff90 msgr2=0x7fbb3819b240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 shutdown_connections 2026-02-22T21:00:59.268 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.263+0000 7fbb3de8e640 1 -- 10.20.193.7:0/241673249 wait complete. 2026-02-22T21:00:59.276 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.331+0000 7f4049920640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.331+0000 7f4049920640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.331+0000 7f4049920640 10 monclient: monmap: 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.335455+0000 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.335455+0000 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.335 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 Processor -- start 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- start start 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: init 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2026-02-22T21:00:59.336 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 0x7f404413bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-a con 0x7f404408ff00 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f404413c4f0 0x7f4044038f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-c con 0x7f404413c4f0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-b con 0x7f4044039460 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f404408ea60 con 0x7f404408ff00 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f404408ed40 con 0x7f404413c4f0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f404408f020 con 0x7f4044039460 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): authenticate will time out at 1071.808416s 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 0x7f404413bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47280/0 (socket says 10.20.193.7:47280) 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 0x7f404413bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48248/0 (socket says 10.20.193.7:48248) 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 -- 10.20.193.7:0/147369350 learned_addr learned my addr 10.20.193.7:0/147369350 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): get_auth_request con 0x7f4044039460 auth_method 0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): get_auth_request con 0x7f404408ff00 auth_method 0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40427fc640 1 --2- 10.20.193.7:0/147369350 >> v2:10.20.193.61:3300/0 conn(0x7f404413c4f0 0x7f4044038f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40427fc640 10 monclient(hunting): get_auth_request con 0x7f404413c4f0 auth_method 0 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient(hunting): handle_auth_done global_id 124421 payload 274 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 -- 10.20.193.7:0/147369350 >> v2:10.20.193.61:3300/0 conn(0x7f404413c4f0 msgr2=0x7f4044038f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 --2- 10.20.193.7:0/147369350 >> v2:10.20.193.61:3300/0 conn(0x7f404413c4f0 0x7f4044038f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.337 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 -- 10.20.193.7:0/147369350 >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 msgr2=0x7f404413bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 --2- 10.20.193.7:0/147369350 >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 0x7f404413bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 monclient: found mon.noname-b 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 -- 10.20.193.7:0/147369350 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404408dce0 con 0x7f4044039460 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f40437fe640 1 --2- 10.20.193.7:0/147369350 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4044060450 tx=0x7f403401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7aa1d850465c10 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 1 -- 10.20.193.7:0/147369350 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340b2070 con 0x7f4044039460 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: dump: 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.338 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 1 -- 10.20.193.7:0/147369350 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40340a5840 con 0x7f4044039460 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 1 -- 10.20.193.7:0/147369350 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340a5c30 con 0x7f4044039460 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 5 monclient: authenticate success, global_id 124421 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 4 set_mon_vals no callback set 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4041ffb640 10 monclient: dump: 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: shutdown 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- 10.20.193.7:0/147369350 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 msgr2=0x7f4044039880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- 10.20.193.7:0/147369350 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4044060450 tx=0x7f403401c8b0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- 10.20.193.7:0/147369350 shutdown_connections 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- 10.20.193.7:0/147369350 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f4044039880 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- 10.20.193.7:0/147369350 >> v2:10.20.193.61:3300/0 conn(0x7f404413c4f0 0x7f4044038f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- 10.20.193.7:0/147369350 >> v2:10.20.193.7:3300/0 conn(0x7f404408ff00 0x7f404413bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- 10.20.193.7:0/147369350 >> 10.20.193.7:0/147369350 conn(0x7f404408cf40 msgr2=0x7f404408d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- 10.20.193.7:0/147369350 shutdown_connections 2026-02-22T21:00:59.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- 10.20.193.7:0/147369350 wait complete. 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: monmap: 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.340 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 Processor -- start 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- start start 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: init 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-c con 0x7f4044039460 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f404408ff00 0x7f4044120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-a con 0x7f404408ff00 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f404413c4f0 0x7f4044126130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): picked mon.noname-b con 0x7f404413c4f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40441a2eb0 con 0x7f404408ff00 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f404413cb40 con 0x7f404413c4f0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f40441a3030 con 0x7f4044039460 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.335+0000 7f4049920640 10 monclient(hunting): authenticate will time out at 1071.811975s 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f404408ff00 0x7f4044120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47296/0 (socket says 10.20.193.7:47296) 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 -- 10.20.193.7:0/1454301652 learned_addr learned my addr 10.20.193.7:0/1454301652 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): get_auth_request con 0x7f4044039460 auth_method 0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): get_auth_request con 0x7f404408ff00 auth_method 0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40437fe640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f404413c4f0 0x7f4044126130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40437fe640 10 monclient(hunting): get_auth_request con 0x7f404413c4f0 auth_method 0 2026-02-22T21:00:59.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40437fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient(hunting): handle_auth_done global_id 124424 payload 824 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 -- 10.20.193.7:0/1454301652 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f404413c4f0 msgr2=0x7f4044126130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f404413c4f0 0x7f4044126130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 -- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f404408ff00 msgr2=0x7f4044120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f404408ff00 0x7f4044120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 monclient: found mon.noname-c 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 -- 10.20.193.7:0/1454301652 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40440875c0 con 0x7f4044039460 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4042ffd640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4038009430 tx=0x7f403800ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038017070 con 0x7f4044039460 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: dump: 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403800c940 con 0x7f4044039460 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403800cd30 con 0x7f4044039460 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 5 monclient: authenticate success, global_id 124424 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _renew_subs 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40417fa640 4 set_mon_vals no callback set 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4044129660 con 0x7f4044039460 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: dump: 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.342 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _renew_subs 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4044120a40 con 0x7f4044039460 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f404413bfb0 con 0x7f4044039460 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4038013470 con 0x7f4044039460 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 --2- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 0x7f401405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f403804ee00 con 0x7f4044039460 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 1 --2- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 0x7f401405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 10 monclient: get_auth_request con 0x7f401403ab20 auth_method 0 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f40427fc640 1 --2- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 0x7f401405afd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4044128690 tx=0x7f402c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f403804dd40 con 0x7f4044039460 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.339+0000 7f401bfff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:59.424 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f404405fcd0 con 0x7f401403ab20 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f401bfff640 1 -- 10.20.193.7:0/1454301652 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f404405fcd0 con 0x7f401403ab20 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 msgr2=0x7f401405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 0x7f401405afd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4044128690 tx=0x7f402c008040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 10 monclient: shutdown 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.425 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 msgr2=0x7f404411ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4038009430 tx=0x7f403800ee10 comp rx=0 tx=0).stop 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 shutdown_connections 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> v2:10.20.193.61:6800/2336688312 conn(0x7f401403ab20 0x7f401405afd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f404413c4f0 0x7f4044126130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f404408ff00 0x7f4044120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 --2- 10.20.193.7:0/1454301652 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4044039460 0x7f404411ffc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 >> 10.20.193.7:0/1454301652 conn(0x7f404408cf40 msgr2=0x7f404408bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 shutdown_connections 2026-02-22T21:00:59.426 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.423+0000 7f4049920640 1 -- 10.20.193.7:0/1454301652 wait complete. 2026-02-22T21:00:59.436 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T21:00:59.436 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:00:59.503 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.499+0000 7fd36f937640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.499+0000 7fd36f937640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.499+0000 7fd36f937640 10 monclient: monmap: 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.503323+0000 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.503323+0000 2026-02-22T21:00:59.504 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.505 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 Processor -- start 2026-02-22T21:00:59.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- start start 2026-02-22T21:00:59.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: init 2026-02-22T21:00:59.516 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fd368085830 0x7fd36808e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-c con 0x7fd368085830 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd36808e980 0x7fd36808ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-a con 0x7fd36808e980 addr v2:10.20.193.7:3300/0 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd36817d6b0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368085c00 con 0x7fd36817d6b0 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fd36808b220 con 0x7fd36808e980 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.517 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fd36808b750 con 0x7fd368085830 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient(hunting): authenticate will time out at 1071.976598s 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fd36808e980 0x7fd36808ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36dead640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fd36817d6b0 0x7fd36819da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57178/0 (socket says 10.20.193.7:57178) 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36dead640 1 -- 10.20.193.7:0/871670480 learned_addr learned my addr 10.20.193.7:0/871670480 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): get_auth_request con 0x7fd36808e980 auth_method 0 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 1 --2- 10.20.193.7:0/871670480 >> v2:10.20.193.61:3300/0 conn(0x7fd368085830 0x7fd36808e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): get_auth_request con 0x7fd368085830 auth_method 0 2026-02-22T21:00:59.518 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36d6ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient(hunting): handle_auth_done global_id 134193 payload 274 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 -- 10.20.193.7:0/871670480 >> v2:10.20.193.61:3300/0 conn(0x7fd368085830 msgr2=0x7fd36808e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 --2- 10.20.193.7:0/871670480 >> v2:10.20.193.61:3300/0 conn(0x7fd368085830 0x7fd36808e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 -- 10.20.193.7:0/871670480 >> v1:10.20.193.7:6789/0 conn(0x7fd36817d6b0 legacy=0x7fd36819da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.519 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 1 -- 10.20.193.7:0/871670480 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431430543 0 0) 0x7fd368085c00 con 0x7fd36817d6b0 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 -- 10.20.193.7:0/871670480 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36805db00 con 0x7fd36808e980 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36ceab640 1 --2- 10.20.193.7:0/871670480 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36808ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3680860c0 tx=0x7fd35c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3133bd5ab2dac16d server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 1 -- 10.20.193.7:0/871670480 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0aa5f0 con 0x7fd36808e980 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: dump: 2026-02-22T21:00:59.520 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.521 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 5 monclient: authenticate success, global_id 134193 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 1 -- 10.20.193.7:0/871670480 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0af070 con 0x7fd36808e980 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 1 -- 10.20.193.7:0/871670480 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0aa9b0 con 0x7fd36808e980 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd357fff640 10 monclient: dump: 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.522 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.523 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 4 set_mon_vals no callback set 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: shutdown 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- 10.20.193.7:0/871670480 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 msgr2=0x7fd36808ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 --2- 10.20.193.7:0/871670480 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36808ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3680860c0 tx=0x7fd35c01c490 comp rx=0 tx=0).stop 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- 10.20.193.7:0/871670480 shutdown_connections 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 --2- 10.20.193.7:0/871670480 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36808ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 --2- 10.20.193.7:0/871670480 >> v2:10.20.193.61:3300/0 conn(0x7fd368085830 0x7fd36808e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- 10.20.193.7:0/871670480 >> 10.20.193.7:0/871670480 conn(0x7fd36808ff90 msgr2=0x7fd36808c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- 10.20.193.7:0/871670480 shutdown_connections 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- 10.20.193.7:0/871670480 wait complete. 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.524 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: monmap: 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 Processor -- start 2026-02-22T21:00:59.525 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 1 -- start start 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.503+0000 7fd36f937640 10 monclient: init 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd368085830 0x7fd36807cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-b con 0x7fd368085830 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36807d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-a con 0x7fd36808e980 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd36817d6b0 0x7fd36807d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): picked mon.noname-c con 0x7fd36817d6b0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3681a1be0 con 0x7fd36808e980 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.526 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fd36808af40 con 0x7fd368085830 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fd3681a1d60 con 0x7fd36817d6b0 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient(hunting): authenticate will time out at 1071.980249s 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36807d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36807d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48272/0 (socket says 10.20.193.7:48272) 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 -- 10.20.193.7:0/2653574966 learned_addr learned my addr 10.20.193.7:0/2653574966 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): get_auth_request con 0x7fd36808e980 auth_method 0 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.527 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd36817d6b0 0x7fd36807d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): get_auth_request con 0x7fd36817d6b0 auth_method 0 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd368085830 0x7fd36807cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient(hunting): handle_auth_done global_id 134199 payload 824 2026-02-22T21:00:59.528 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 -- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd36817d6b0 msgr2=0x7fd36807d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fd36817d6b0 0x7fd36807d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 -- 10.20.193.7:0/2653574966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd368085830 msgr2=0x7fd36807cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd368085830 0x7fd36807cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 -- 10.20.193.7:0/2653574966 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368080b10 con 0x7fd36808e980 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 10 monclient: get_auth_request con 0x7fd368085830 auth_method 0 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fd368085830 0x7fd36807cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36ceab640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36807d470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd35c01ca00 tx=0x7fd35c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.529 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0b8020 con 0x7fd36808e980 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: dump: 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.530 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0b4400 con 0x7fd36808e980 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0b47b0 con 0x7fd36808e980 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 5 monclient: authenticate success, global_id 134199 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd3577fe640 4 set_mon_vals no callback set 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _renew_subs 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.531 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd368057a60 con 0x7fd36808e980 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: dump: 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.532 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _renew_subs 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36807e7b0 con 0x7fd36808e980 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd36808e440 con 0x7fd36808e980 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fd35c0b4950 con 0x7fd36808e980 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd33803ab20 0x7fd33805afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fd35c0e9880 con 0x7fd36808e980 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.7:6808/1121527665 conn(0x7fd33805e660 0x7fd33807ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 --> v2:10.20.193.7:6808/1121527665 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd35c0bde50 con 0x7fd33805e660 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7fd35c0e9ce0 con 0x7fd36808e980 2026-02-22T21:00:59.533 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.7:6808/1121527665 conn(0x7fd33805e660 0x7fd33807ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 10 monclient: get_auth_request con 0x7fd33805e660 auth_method 0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd33803ab20 0x7fd33805afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 10 monclient: get_auth_request con 0x7fd33803ab20 auth_method 0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36dead640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.7:6808/1121527665 conn(0x7fd33805e660 0x7fd33807ea70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd36d6ac640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd33803ab20 0x7fd33805afd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd36807e500 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.534 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.507+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== osd.2 v2:10.20.193.7:6808/1121527665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fd35c0bde50 con 0x7fd33805e660 2026-02-22T21:00:59.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 --> v2:10.20.193.7:6808/1121527665 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd368080790 con 0x7fd33805e660 2026-02-22T21:00:59.535 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd355ffb640 1 -- 10.20.193.7:0/2653574966 <== osd.2 v2:10.20.193.7:6808/1121527665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd368080790 con 0x7fd33805e660 2026-02-22T21:00:59.535 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:59.536 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:00:59.536 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:59.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 >> v2:10.20.193.7:6808/1121527665 conn(0x7fd33805e660 msgr2=0x7fd33807ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.7:6808/1121527665 conn(0x7fd33805e660 0x7fd33807ea70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.537 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd33803ab20 msgr2=0x7fd33805afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 --2- 10.20.193.7:0/2653574966 >> v2:10.20.193.61:6800/2336688312 conn(0x7fd33803ab20 0x7fd33805afd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd36807e500 tx=0x7fd358008040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 10 monclient: shutdown 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 msgr2=0x7fd36807d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 --2- 10.20.193.7:0/2653574966 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fd36808e980 0x7fd36807d470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd35c01ca00 tx=0x7fd35c019230 comp rx=0 tx=0).stop 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36dead640 1 -- 10.20.193.7:0/2653574966 reap_dead start 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 shutdown_connections 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 >> 10.20.193.7:0/2653574966 conn(0x7fd36808ff90 msgr2=0x7fd368087940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 shutdown_connections 2026-02-22T21:00:59.538 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.515+0000 7fd36f937640 1 -- 10.20.193.7:0/2653574966 wait complete. 2026-02-22T21:00:59.539 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T21:00:59.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: monmap: 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.606185+0000 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.606185+0000 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.607 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 Processor -- start 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 -- start start 2026-02-22T21:00:59.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: init 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-b con 0x7f246408ff00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f246413c4f0 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:59.616 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f246413c900 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2464039d40 con 0x7f246413c4f0 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246408ea60 con 0x7f246413c900 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f246408ed40 con 0x7f246408ff00 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2469cad640 10 monclient(hunting): authenticate will time out at 1072.079343s 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47328/0 (socket says 10.20.193.7:47328) 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 -- 10.20.193.7:0/3863697235 learned_addr learned my addr 10.20.193.7:0/3863697235 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): get_auth_request con 0x7f246408ff00 auth_method 0 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.617 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f2462ffd640 1 --1- 10.20.193.7:0/3863697235 >> v1:10.20.193.7:6789/0 conn(0x7f246413c4f0 0x7f2464038f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57180/0 (socket says 10.20.193.7:57180) 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient(hunting): handle_auth_done global_id 124430 payload 274 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 -- 10.20.193.7:0/3863697235 >> v1:10.20.193.61:6789/0 conn(0x7f246413c900 legacy=0x7f2464039630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 -- 10.20.193.7:0/3863697235 >> v1:10.20.193.7:6789/0 conn(0x7f246413c4f0 legacy=0x7f2464038f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 monclient: found mon.noname-b 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24627fc640 1 -- 10.20.193.7:0/3863697235 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392341104 0 0) 0x7f2464039d40 con 0x7f246413c4f0 2026-02-22T21:00:59.618 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24637fe640 1 -- 10.20.193.7:0/3863697235 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246408f020 con 0x7f246408ff00 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.603+0000 7f24627fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- 10.20.193.7:0/3863697235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2450009910 tx=0x7f245001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d2c368c8eb45886 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 1 -- 10.20.193.7:0/3863697235 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500aa680 con 0x7f246408ff00 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: dump: 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.619 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 1 -- 10.20.193.7:0/3863697235 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500af070 con 0x7f246408ff00 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 1 -- 10.20.193.7:0/3863697235 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500aaa40 con 0x7f246408ff00 2026-02-22T21:00:59.620 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 5 monclient: authenticate success, global_id 124430 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 4 set_mon_vals no callback set 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24627fc640 10 monclient: dump: 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.621 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: shutdown 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3863697235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 msgr2=0x7f246413bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 --2- 10.20.193.7:0/3863697235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2450009910 tx=0x7f245001c540 comp rx=0 tx=0).stop 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3863697235 shutdown_connections 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 --2- 10.20.193.7:0/3863697235 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f246413bfb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3863697235 >> 10.20.193.7:0/3863697235 conn(0x7f246408cf40 msgr2=0x7f246408d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3863697235 shutdown_connections 2026-02-22T21:00:59.622 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3863697235 wait complete. 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: monmap: 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.623 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 Processor -- start 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- start start 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: init 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-c con 0x7f246408ff00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 0x7f2464128ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.624 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-b con 0x7f246413c4f0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2464129430 0x7f2464116b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): picked mon.noname-a con 0x7f2464129430 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f24641a5050 con 0x7f2464129430 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f24641a4ed0 con 0x7f246413c4f0 2026-02-22T21:00:59.625 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f24641a51d0 con 0x7f246408ff00 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient(hunting): authenticate will time out at 1072.082785s 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47332/0 (socket says 10.20.193.7:47332) 2026-02-22T21:00:59.626 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 -- 10.20.193.7:0/3920980605 learned_addr learned my addr 10.20.193.7:0/3920980605 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): get_auth_request con 0x7f246408ff00 auth_method 0 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2464129430 0x7f2464116b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.627 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): get_auth_request con 0x7f2464129430 auth_method 0 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.628 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient(hunting): handle_auth_done global_id 124433 payload 824 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2462ffd640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 0x7f2464128ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 -- 10.20.193.7:0/3920980605 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 msgr2=0x7f2464128ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 0x7f2464128ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 -- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2464129430 msgr2=0x7f2464116b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2464129430 0x7f2464116b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 monclient: found mon.noname-c 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 -- 10.20.193.7:0/3920980605 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246412c450 con 0x7f246408ff00 2026-02-22T21:00:59.629 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2462ffd640 10 monclient: get_auth_request con 0x7f246413c4f0 auth_method 0 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2462ffd640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 0x7f2464128ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f24637fe640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f245001abf0 tx=0x7f245001ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450004220 con 0x7f246408ff00 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: dump: 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.630 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500043c0 con 0x7f246408ff00 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450003910 con 0x7f246408ff00 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.631 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 10 monclient: dump: 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2461ffb640 4 set_mon_vals no callback set 2026-02-22T21:00:59.632 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 5 monclient: authenticate success, global_id 124433 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _renew_subs 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246412c730 con 0x7f246408ff00 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _renew_subs 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f246412b8c0 con 0x7f246408ff00 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246413bfb0 con 0x7f246408ff00 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f2450003ab0 con 0x7f246408ff00 2026-02-22T21:00:59.633 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.607+0000 7f243ffff640 1 --2- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 0x7f243405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f24500e9430 con 0x7f246408ff00 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f2462ffd640 1 --2- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 0x7f243405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f2462ffd640 10 monclient: get_auth_request con 0x7f243403ab20 auth_method 0 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f2462ffd640 1 --2- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 0x7f243405afd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f246412c660 tx=0x7f2454009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f24500a6040 con 0x7f246408ff00 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f243ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.634 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.611+0000 7f243ffff640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:59.694 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f246412cc30 con 0x7f243403ab20 2026-02-22T21:00:59.695 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f243ffff640 1 -- 10.20.193.7:0/3920980605 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f246412cc30 con 0x7f243403ab20 2026-02-22T21:00:59.695 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 msgr2=0x7f243405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 0x7f243405afd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f246412c660 tx=0x7f2454009040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 10 monclient: shutdown 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 msgr2=0x7f24641289b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.696 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f245001abf0 tx=0x7f245001ad80 comp rx=0 tx=0).stop 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 shutdown_connections 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f2464129430 0x7f2464116b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> v2:10.20.193.61:6800/2336688312 conn(0x7f243403ab20 0x7f243405afd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f246413c4f0 0x7f2464128ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 --2- 10.20.193.7:0/3920980605 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f246408ff00 0x7f24641289b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 >> 10.20.193.7:0/3920980605 conn(0x7f246408cf40 msgr2=0x7f246413b430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 shutdown_connections 2026-02-22T21:00:59.697 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.691+0000 7f2469cad640 1 -- 10.20.193.7:0/3920980605 wait complete. 2026-02-22T21:00:59.705 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T21:00:59.705 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:00:59.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.771+0000 7fe968505640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.771+0000 7fe968505640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.771+0000 7fe968505640 10 monclient: monmap: 2026-02-22T21:00:59.776 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.776 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.775618+0000 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.775618+0000 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.777 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 Processor -- start 2026-02-22T21:00:59.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- start start 2026-02-22T21:00:59.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: init 2026-02-22T21:00:59.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: _add_conns ranks=[1,0,4,2,3] 2026-02-22T21:00:59.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe960085830 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:59.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe96008eb50 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fe96008efb0 0x7fe96019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): picked mon.noname-c con 0x7fe96008efb0 addr v2:10.20.193.61:3300/0 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe960085c00 con 0x7fe96008eb50 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96008b750 con 0x7fe960085830 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fe96008b220 con 0x7fe96008efb0 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient(hunting): authenticate will time out at 1072.248732s 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fe96008eb50 0x7fe96017e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57186/0 (socket says 10.20.193.7:57186) 2026-02-22T21:00:59.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 -- 10.20.193.7:0/4266715511 learned_addr learned my addr 10.20.193.7:0/4266715511 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 1 --2- 10.20.193.7:0/4266715511 >> v2:10.20.193.61:3300/0 conn(0x7fe96008efb0 0x7fe96019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): get_auth_request con 0x7fe96008efb0 auth_method 0 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163763631 0 0) 0x7fe960085c00 con 0x7fe96008eb50 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): _negotiate 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): my global_id is 134208 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe948003620 con 0x7fe96008eb50 2026-02-22T21:00:59.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3369693289 0 0) 0x7fe948003620 con 0x7fe96008eb50 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 >> v2:10.20.193.61:3300/0 conn(0x7fe96008efb0 msgr2=0x7fe96019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 --2- 10.20.193.7:0/4266715511 >> v2:10.20.193.61:3300/0 conn(0x7fe96008efb0 0x7fe96019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 >> v1:10.20.193.61:6789/0 conn(0x7fe960085830 legacy=0x7fe96008e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 monclient: found mon.noname-a-legacy 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96005db00 con 0x7fe96008eb50 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7fe954002e60 con 0x7fe96008eb50 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: dump: 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.793 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 >> v1:10.20.193.7:6789/0 conn(0x7fe96008eb50 legacy=0x7fe96017e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe948003ba0 0x7fe948003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): picked mon.a con 0x7fe948003ba0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): picked mon.c con 0x7fe9480048d0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe948005350 0x7fe948065a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): picked mon.b con 0x7fe948005350 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe96008b220 con 0x7fe948003ba0 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe948066280 con 0x7fe948005350 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe948066480 con 0x7fe9480048d0 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 1 --2- 10.20.193.7:0/4266715511 >> v2:10.20.193.61:3300/0 conn(0x7fe96008efb0 0x7fe96019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): get_auth_request con 0x7fe9480048d0 auth_method 0 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe948003ba0 0x7fe948003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): get_auth_request con 0x7fe948003ba0 auth_method 0 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient(hunting): handle_auth_done global_id 134208 payload 293 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 -- 10.20.193.7:0/4266715511 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe948005350 msgr2=0x7fe948065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe948005350 0x7fe948065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 -- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe948003ba0 msgr2=0x7fe948003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe948003ba0 0x7fe948003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 monclient: found mon.c 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 -- 10.20.193.7:0/4266715511 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe948003620 con 0x7fe9480048d0 2026-02-22T21:00:59.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 5 monclient: authenticate success, global_id 134208 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe96627a640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe948003ba0 0x7fe948003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe966a7b640 1 -- 10.20.193.7:0/4266715511 reap_dead start 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965a79640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 0x7fe948004d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c190 tx=0x7fe95401cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e626925a44344fe server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954007d00 con 0x7fe9480048d0 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: dump: 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.798 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9540a9020 con 0x7fe9480048d0 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 1 -- 10.20.193.7:0/4266715511 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954005c10 con 0x7fe9480048d0 2026-02-22T21:00:59.799 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe965278640 10 monclient: dump: 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.800 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 4 set_mon_vals no callback set 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: shutdown 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 msgr2=0x7fe948004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 0x7fe948004d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c190 tx=0x7fe95401cc40 comp rx=0 tx=0).stop 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- 10.20.193.7:0/4266715511 shutdown_connections 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 --2- 10.20.193.7:0/4266715511 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- 10.20.193.7:0/4266715511 >> 10.20.193.7:0/4266715511 conn(0x7fe96008ff90 msgr2=0x7fe96008c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- 10.20.193.7:0/4266715511 shutdown_connections 2026-02-22T21:00:59.801 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 1 -- 10.20.193.7:0/4266715511 wait complete. 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.775+0000 7fe968505640 10 monclient: monmap: 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.802 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 Processor -- start 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- start start 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: init 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 0x7fe96007f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): picked mon.noname-a con 0x7fe9480048d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe960085450 0x7fe96007f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): picked mon.noname-c con 0x7fe960085450 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe96007fb10 0x7fe96007ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): picked mon.noname-b con 0x7fe96007fb10 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.803 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe96008c5c0 con 0x7fe9480048d0 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fe960140030 con 0x7fe96007fb10 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fe96013feb0 con 0x7fe960085450 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient(hunting): authenticate will time out at 1072.252588s 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 0x7fe96007f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 0x7fe96007f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48300/0 (socket says 10.20.193.7:48300) 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 -- 10.20.193.7:0/2441441680 learned_addr learned my addr 10.20.193.7:0/2441441680 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): get_auth_request con 0x7fe9480048d0 auth_method 0 2026-02-22T21:00:59.804 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 1 --2- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe960085450 0x7fe96007f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): get_auth_request con 0x7fe960085450 auth_method 0 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.805 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient(hunting): handle_auth_done global_id 134211 payload 824 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 -- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe960085450 msgr2=0x7fe96007f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 --2- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fe960085450 0x7fe96007f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 -- 10.20.193.7:0/2441441680 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe96007fb10 msgr2=0x7fe96007ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 --2- 10.20.193.7:0/2441441680 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fe96007fb10 0x7fe96007ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 monclient: found mon.noname-a 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 -- 10.20.193.7:0/2441441680 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe960082ae0 con 0x7fe9480048d0 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe96627a640 1 --2- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 0x7fe96007f090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe950002c30 tx=0x7fe95000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95001a070 con 0x7fe9480048d0 2026-02-22T21:00:59.806 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: dump: 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.807 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500068d0 con 0x7fe9480048d0 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950002c60 con 0x7fe9480048d0 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe964a77640 4 set_mon_vals no callback set 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: dump: 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.808 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 5 monclient: authenticate success, global_id 134211 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _renew_subs 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe960082dc0 con 0x7fe9480048d0 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _renew_subs 2026-02-22T21:00:59.809 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe960081d30 con 0x7fe9480048d0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe960140450 con 0x7fe9480048d0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fe950014070 con 0x7fe9480048d0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe93003aa50 0x7fe93005af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fe95004dd90 con 0x7fe9480048d0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6802/3528802164 conn(0x7fe93005e590 0x7fe93007e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 --> v2:10.20.193.61:6802/3528802164 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe95001ce50 con 0x7fe93005e590 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7fe950050390 con 0x7fe9480048d0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe93003aa50 0x7fe93005af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 10 monclient: get_auth_request con 0x7fe93003aa50 auth_method 0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe966a7b640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6802/3528802164 conn(0x7fe93005e590 0x7fe93007e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.810 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe966a7b640 10 monclient: get_auth_request con 0x7fe93005e590 auth_method 0 2026-02-22T21:00:59.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe965a79640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe93003aa50 0x7fe93005af00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe954002b70 tx=0x7fe954006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe966a7b640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6802/3528802164 conn(0x7fe93005e590 0x7fe93007e9a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.779+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== osd.3 v2:10.20.193.61:6802/3528802164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fe95001ce50 con 0x7fe93005e590 2026-02-22T21:00:59.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 --> v2:10.20.193.61:6802/3528802164 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe96004c510 con 0x7fe93005e590 2026-02-22T21:00:59.811 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe946ffd640 1 -- 10.20.193.7:0/2441441680 <== osd.3 v2:10.20.193.61:6802/3528802164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe96004c510 con 0x7fe93005e590 2026-02-22T21:00:59.812 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:00:59.812 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:00:59.812 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6802/3528802164 conn(0x7fe93005e590 msgr2=0x7fe93007e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6802/3528802164 conn(0x7fe93005e590 0x7fe93007e9a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe93003aa50 msgr2=0x7fe93005af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 --2- 10.20.193.7:0/2441441680 >> v2:10.20.193.61:6800/2336688312 conn(0x7fe93003aa50 0x7fe93005af00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe954002b70 tx=0x7fe954006040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 10 monclient: shutdown 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 msgr2=0x7fe96007f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 --2- 10.20.193.7:0/2441441680 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fe9480048d0 0x7fe96007f090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe950002c30 tx=0x7fe95000eba0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe966a7b640 1 -- 10.20.193.7:0/2441441680 reap_dead start 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 shutdown_connections 2026-02-22T21:00:59.814 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 >> 10.20.193.7:0/2441441680 conn(0x7fe96008ff90 msgr2=0x7fe96008dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 shutdown_connections 2026-02-22T21:00:59.815 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.787+0000 7fe968505640 1 -- 10.20.193.7:0/2441441680 wait complete. 2026-02-22T21:00:59.815 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T21:00:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.871+0000 7f4a9455e640 10 monclient: get_monmap_and_config 2026-02-22T21:00:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.871+0000 7f4a9455e640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.876 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.871+0000 7f4a9455e640 10 monclient: monmap: 2026-02-22T21:00:59.876 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.876 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:00:59.875743+0000 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:00:59.875743+0000 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.877 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 Processor -- start 2026-02-22T21:00:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- start start 2026-02-22T21:00:59.878 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: init 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4a8c08c7a0 addr v1:10.20.193.61:6789/0 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-b con 0x7f4a8c090b70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4a8c090f40 addr v1:10.20.193.7:6789/0 2026-02-22T21:00:59.886 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8c08d840 con 0x7f4a8c090f40 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8c08db20 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c0851e0 con 0x7f4a8c090b70 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient(hunting): authenticate will time out at 1072.348845s 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a92ad4640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f4a8c090f40 0x7f4a8c1a0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57202/0 (socket says 10.20.193.7:57202) 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47368/0 (socket says 10.20.193.7:47368) 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a92ad4640 1 -- 10.20.193.7:0/1210672209 learned_addr learned my addr 10.20.193.7:0/1210672209 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): get_auth_request con 0x7f4a8c090b70 auth_method 0 2026-02-22T21:00:59.887 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_done global_id 124439 payload 274 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 -- 10.20.193.7:0/1210672209 >> v1:10.20.193.61:6789/0 conn(0x7f4a8c08c7a0 legacy=0x7f4a8c090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 -- 10.20.193.7:0/1210672209 >> v1:10.20.193.7:6789/0 conn(0x7f4a8c090f40 legacy=0x7f4a8c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 monclient: found mon.noname-b 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 1 -- 10.20.193.7:0/1210672209 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209721027 0 0) 0x7f4a8c08d840 con 0x7f4a8c090f40 2026-02-22T21:00:59.888 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 -- 10.20.193.7:0/1210672209 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c08ed90 con 0x7f4a8c090b70 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a91ad2640 1 --2- 10.20.193.7:0/1210672209 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009840 tx=0x7f4a8001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=247f150a1480dba0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 1 -- 10.20.193.7:0/1210672209 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a800ab640 con 0x7f4a8c090b70 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: dump: 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.889 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 1 -- 10.20.193.7:0/1210672209 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a800b0070 con 0x7f4a8c090b70 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 1 -- 10.20.193.7:0/1210672209 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a800aba00 con 0x7f4a8c090b70 2026-02-22T21:00:59.890 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 5 monclient: authenticate success, global_id 124439 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: get_monmap_and_config success 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 4 set_mon_vals no callback set 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a912d1640 10 monclient: dump: 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.891 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: shutdown 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- 10.20.193.7:0/1210672209 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 msgr2=0x7f4a8c1806e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 --2- 10.20.193.7:0/1210672209 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009840 tx=0x7f4a8001c460 comp rx=0 tx=0).stop 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- 10.20.193.7:0/1210672209 shutdown_connections 2026-02-22T21:00:59.892 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 --2- 10.20.193.7:0/1210672209 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c090b70 0x7f4a8c1806e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- 10.20.193.7:0/1210672209 >> 10.20.193.7:0/1210672209 conn(0x7f4a8c08e050 msgr2=0x7f4a8c08e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- 10.20.193.7:0/1210672209 shutdown_connections 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 1 -- 10.20.193.7:0/1210672209 wait complete. 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: build_initial_monmap 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.875+0000 7f4a9455e640 10 monclient: monmap: 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.893 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 Processor -- start 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- start start 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: init 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _reopen_session rank -1 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-c con 0x7f4a8c08c7a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4a8c090b70 0x7f4a8c1d9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.894 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-a con 0x7f4a8c090b70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 0x7f4a8c1d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): picked mon.noname-b con 0x7f4a8c090f40 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1a4f00 con 0x7f4a8c090b70 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1a4d80 con 0x7f4a8c090f40 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): start opening mon connection 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c1a5080 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): _renew_subs 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient(hunting): authenticate will time out at 1072.352753s 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47384/0 (socket says 10.20.193.7:47384) 2026-02-22T21:00:59.895 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 -- 10.20.193.7:0/43777904 learned_addr learned my addr 10.20.193.7:0/43777904 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): get_auth_request con 0x7f4a8c08c7a0 auth_method 0 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4a8c090b70 0x7f4a8c1d9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): get_auth_request con 0x7f4a8c090b70 auth_method 0 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.896 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a92ad4640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 0x7f4a8c1d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient(hunting): handle_auth_done global_id 124442 payload 824 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 -- 10.20.193.7:0/43777904 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 msgr2=0x7f4a8c1d9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 0x7f4a8c1d9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 -- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4a8c090b70 msgr2=0x7f4a8c1d9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4a8c090b70 0x7f4a8c1d9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient: _finish_hunting 0 2026-02-22T21:00:59.897 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 monclient: found mon.noname-c 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 -- 10.20.193.7:0/43777904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c1a0ad0 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a92ad4640 10 monclient: get_auth_request con 0x7f4a8c090f40 auth_method 0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a92ad4640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 0x7f4a8c1d9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a922d3640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c520 tx=0x7f4a7c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c017070 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: dump: 2026-02-22T21:00:59.898 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: _finish_auth 0 2026-02-22T21:00:59.899 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c006ad0 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c007030 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 10 monclient: dump: 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:00:59.900 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a90ad0640 4 set_mon_vals no callback set 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 5 monclient: authenticate success, global_id 124442 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _renew_subs 2026-02-22T21:00:59.901 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c19f2d0 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _renew_subs 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1a1230 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c08d840 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f4a7c0071d0 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 --2- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 0x7f4a5c05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f4a7c04ddf0 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 1 --2- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 0x7f4a5c05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 10 monclient: get_auth_request con 0x7f4a5c03ab20 auth_method 0 2026-02-22T21:00:59.902 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.879+0000 7f4a91ad2640 1 --2- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 0x7f4a5c05afd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4a8001c290 tx=0x7f4a80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:00:59.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.883+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f4a7c01a360 con 0x7f4a8c08c7a0 2026-02-22T21:00:59.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.883+0000 7f4a72ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:00:59.903 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.883+0000 7f4a72ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:00:59.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4a8c086e80 con 0x7f4a5c03ab20 2026-02-22T21:00:59.967 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a72ffd640 1 -- 10.20.193.7:0/43777904 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4a8c086e80 con 0x7f4a5c03ab20 2026-02-22T21:00:59.967 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T21:00:59.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 msgr2=0x7f4a5c05afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.968 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 0x7f4a5c05afd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4a8001c290 tx=0x7f4a80009040 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 10 monclient: shutdown 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 msgr2=0x7f4a8c1d9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c520 tx=0x7f4a7c00c9e0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 shutdown_connections 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> v2:10.20.193.61:6800/2336688312 conn(0x7f4a5c03ab20 0x7f4a5c05afd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f4a8c090f40 0x7f4a8c1d9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f4a8c090b70 0x7f4a8c1d9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 --2- 10.20.193.7:0/43777904 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f4a8c08c7a0 0x7f4a8c1d9350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 >> 10.20.193.7:0/43777904 conn(0x7f4a8c08e050 msgr2=0x7f4a8c088bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:00:59.969 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 shutdown_connections 2026-02-22T21:00:59.970 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:00:59.963+0000 7f4a9455e640 1 -- 10.20.193.7:0/43777904 wait complete. 2026-02-22T21:00:59.977 INFO:tasks.ceph:Scrubbing osd.4 2026-02-22T21:00:59.978 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:01:00.060 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: get_monmap_and_config 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: monmap: 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:00.051002+0000 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:00.051002+0000 2026-02-22T21:01:00.061 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 1 Processor -- start 2026-02-22T21:01:00.062 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 1 -- start start 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: init 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fce0413f4b0 addr v1:10.20.193.7:6789/0 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce04180230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.047+0000 7fce094da640 10 monclient(hunting): picked mon.noname-b con 0x7fce0413f880 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fce04180770 0x7fce041a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): picked mon.noname-c con 0x7fce04180770 addr v2:10.20.193.61:3300/0 2026-02-22T21:01:00.063 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0408e8e0 con 0x7fce0413f4b0 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fce04090d00 con 0x7fce04180770 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fce0408eb60 con 0x7fce0413f880 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): authenticate will time out at 1072.524029s 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce04180230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fce0413f4b0 0x7fce04057340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57208/0 (socket says 10.20.193.7:57208) 2026-02-22T21:01:00.064 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 -- 10.20.193.7:0/3442800504 learned_addr learned my addr 10.20.193.7:0/3442800504 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): get_auth_request con 0x7fce0413f880 auth_method 0 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce08cd9640 1 --2- 10.20.193.7:0/3442800504 >> v2:10.20.193.61:3300/0 conn(0x7fce04180770 0x7fce041a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.065 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_done global_id 124445 payload 274 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/3442800504 >> v2:10.20.193.61:3300/0 conn(0x7fce04180770 msgr2=0x7fce041a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- 10.20.193.7:0/3442800504 >> v2:10.20.193.61:3300/0 conn(0x7fce04180770 0x7fce041a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/3442800504 >> v1:10.20.193.7:6789/0 conn(0x7fce0413f4b0 legacy=0x7fce04057340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 monclient: found mon.noname-b 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.066 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/3442800504 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0408fc00 con 0x7fce0413f880 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 1 -- 10.20.193.7:0/3442800504 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587301558 0 0) 0x7fce0408e8e0 con 0x7fce0413f4b0 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- 10.20.193.7:0/3442800504 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce04180230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4004780 tx=0x7fcdf401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75fe23fb28141da server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 1 -- 10.20.193.7:0/3442800504 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab430 con 0x7fce0413f880 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: dump: 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.067 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.068 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 1 -- 10.20.193.7:0/3442800504 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf40b0070 con 0x7fce0413f880 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 1 -- 10.20.193.7:0/3442800504 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab7f0 con 0x7fce0413f880 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce02ffd640 10 monclient: dump: 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.069 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 5 monclient: authenticate success, global_id 124445 2026-02-22T21:01:00.070 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 4 set_mon_vals no callback set 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: shutdown 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- 10.20.193.7:0/3442800504 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 msgr2=0x7fce04180230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- 10.20.193.7:0/3442800504 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce04180230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4004780 tx=0x7fcdf401c410 comp rx=0 tx=0).stop 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- 10.20.193.7:0/3442800504 shutdown_connections 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- 10.20.193.7:0/3442800504 >> v2:10.20.193.61:3300/0 conn(0x7fce04180770 0x7fce041a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- 10.20.193.7:0/3442800504 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce04180230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- 10.20.193.7:0/3442800504 >> 10.20.193.7:0/3442800504 conn(0x7fce04093c80 msgr2=0x7fce04090180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.071 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- 10.20.193.7:0/3442800504 shutdown_connections 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- 10.20.193.7:0/3442800504 wait complete. 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: monmap: 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:00.072 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 Processor -- start 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- start start 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: init 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 0x7fce0410e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.073 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): picked mon.noname-a con 0x7fce0413f4b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce0412af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): picked mon.noname-c con 0x7fce0413f880 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fce04180770 0x7fce0417ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): picked mon.noname-b con 0x7fce04180770 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fce041a3d00 con 0x7fce0413f4b0 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fce041a3b80 con 0x7fce04180770 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fce041a3e80 con 0x7fce0413f880 2026-02-22T21:01:00.074 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce094da640 10 monclient(hunting): authenticate will time out at 1072.527529s 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 0x7fce0410e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce0412af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 0x7fce0410e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48312/0 (socket says 10.20.193.7:48312) 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 -- 10.20.193.7:0/2122696594 learned_addr learned my addr 10.20.193.7:0/2122696594 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce0412af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47416/0 (socket says 10.20.193.7:47416) 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): get_auth_request con 0x7fce0413f4b0 auth_method 0 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.075 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): get_auth_request con 0x7fce0413f880 auth_method 0 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.076 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient(hunting): handle_auth_done global_id 124448 payload 824 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/2122696594 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fce04180770 msgr2=0x7fce0417ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- 10.20.193.7:0/2122696594 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fce04180770 0x7fce0417ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 msgr2=0x7fce0410e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 0x7fce0410e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.077 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 monclient: found mon.noname-c 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 -- 10.20.193.7:0/2122696594 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0410eaa0 con 0x7fce0413f880 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce03fff640 1 --2- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fce0413f4b0 0x7fce0410e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce037fe640 1 --2- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce0412af70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401aac0 tx=0x7fcdf40191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b8020 con 0x7fce0413f880 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.051+0000 7fce00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.078 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: dump: 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.079 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf4003c30 con 0x7fce0413f880 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab430 con 0x7fce0413f880 2026-02-22T21:01:00.080 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: dump: 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.081 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce027fc640 4 set_mon_vals no callback set 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 5 monclient: authenticate success, global_id 124448 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 10 monclient: _renew_subs 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0412b9c0 con 0x7fce0413f880 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 10 monclient: _renew_subs 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0410d5b0 con 0x7fce0413f880 2026-02-22T21:01:00.082 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce04057340 con 0x7fce0413f880 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fcdf40aa070 con 0x7fce0413f880 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcdd403ab20 0x7fcdd405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fcdf40e8890 con 0x7fce0413f880 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6801/461213399 conn(0x7fcdd405e660 0x7fcdd407ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 --> v2:10.20.193.61:6801/461213399 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdf400af30 con 0x7fcdd405e660 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7fcdf40ed2a0 con 0x7fce0413f880 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce03fff640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcdd403ab20 0x7fcdd405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce03fff640 10 monclient: get_auth_request con 0x7fcdd403ab20 auth_method 0 2026-02-22T21:01:00.083 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce08cd9640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6801/461213399 conn(0x7fcdd405e660 0x7fcdd407ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce08cd9640 10 monclient: get_auth_request con 0x7fcdd405e660 auth_method 0 2026-02-22T21:01:00.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce03fff640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcdd403ab20 0x7fcdd405afd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0002770 tx=0x7fcdf0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce08cd9640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6801/461213399 conn(0x7fcdd405e660 0x7fcdd407ea70 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.084 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.055+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== osd.4 v2:10.20.193.61:6801/461213399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7fcdf400af30 con 0x7fcdd405e660 2026-02-22T21:01:00.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 --> v2:10.20.193.61:6801/461213399 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fce0408e670 con 0x7fcdd405e660 2026-02-22T21:01:00.085 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce00ff9640 1 -- 10.20.193.7:0/2122696594 <== osd.4 v2:10.20.193.61:6801/461213399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fce0408e670 con 0x7fcdd405e660 2026-02-22T21:01:00.085 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:01:00.085 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:01:00.086 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:01:00.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6801/461213399 conn(0x7fcdd405e660 msgr2=0x7fcdd407ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6801/461213399 conn(0x7fcdd405e660 0x7fcdd407ea70 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcdd403ab20 msgr2=0x7fcdd405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.088 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 --2- 10.20.193.7:0/2122696594 >> v2:10.20.193.61:6800/2336688312 conn(0x7fcdd403ab20 0x7fcdd405afd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0002770 tx=0x7fcdf0007ec0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 10 monclient: shutdown 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 msgr2=0x7fce0412af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 --2- 10.20.193.7:0/2122696594 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fce0413f880 0x7fce0412af70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401aac0 tx=0x7fcdf40191b0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce08cd9640 1 -- 10.20.193.7:0/2122696594 reap_dead start 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 shutdown_connections 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 >> 10.20.193.7:0/2122696594 conn(0x7fce04093c80 msgr2=0x7fce0408caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 shutdown_connections 2026-02-22T21:01:00.089 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.063+0000 7fce094da640 1 -- 10.20.193.7:0/2122696594 wait complete. 2026-02-22T21:01:00.090 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-22T21:01:00.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.154+0000 7fefe6ea2640 10 monclient: get_monmap_and_config 2026-02-22T21:01:00.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.154+0000 7fefe6ea2640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.160 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.154+0000 7fefe6ea2640 10 monclient: monmap: 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:00.159546+0000 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:00.159546+0000 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:00.161 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 Processor -- start 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- start start 2026-02-22T21:01:00.162 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: init 2026-02-22T21:01:00.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.172 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: _add_conns ranks=[3,2,0,4,1] 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fefe008c7a0 0x7fefe0090460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-a con 0x7fefe008c7a0 addr v2:10.20.193.7:3300/0 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe00909a0 0x7fefe0090d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-b con 0x7fefe00909a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fefe017f6d0 addr v1:10.20.193.7:6789/0 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe008d840 con 0x7fefe017f6d0 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.173 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7fefe00912b0 con 0x7fefe008c7a0 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fefe008db20 con 0x7fefe00909a0 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): authenticate will time out at 1072.632803s 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fefe008c7a0 0x7fefe0090460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe00909a0 0x7fefe0090d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fefe017f6d0 0x7fefe019fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57212/0 (socket says 10.20.193.7:57212) 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 1 -- 10.20.193.7:0/2871578888 learned_addr learned my addr 10.20.193.7:0/2871578888 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:01:00.174 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7fefe008c7a0 0x7fefe0090460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48328/0 (socket says 10.20.193.7:48328) 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): get_auth_request con 0x7fefe008c7a0 auth_method 0 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): get_auth_request con 0x7fefe00909a0 auth_method 0 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.175 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_done global_id 134226 payload 274 2026-02-22T21:01:00.176 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe00909a0 msgr2=0x7fefe0090d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe00909a0 0x7fefe0090d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/2871578888 >> v1:10.20.193.7:6789/0 conn(0x7fefe017f6d0 legacy=0x7fefe019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 monclient: found mon.noname-a 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/2871578888 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe00851e0 con 0x7fefe008c7a0 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe008c7a0 0x7fefe0090460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd0004780 tx=0x7fefd001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5f12f2ee2e340c server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.177 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 1 -- 10.20.193.7:0/2871578888 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ab660 con 0x7fefe008c7a0 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: dump: 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.178 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 1 -- 10.20.193.7:0/2871578888 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd00b0070 con 0x7fefe008c7a0 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 1 -- 10.20.193.7:0/2871578888 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00aba20 con 0x7fefe008c7a0 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 5 monclient: authenticate success, global_id 134226 2026-02-22T21:01:00.179 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 4 set_mon_vals no callback set 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd77fe640 10 monclient: dump: 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.180 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: shutdown 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe008c7a0 msgr2=0x7fefe0090460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe008c7a0 0x7fefe0090460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefd0004780 tx=0x7fefd001c440 comp rx=0 tx=0).stop 2026-02-22T21:01:00.181 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- 10.20.193.7:0/2871578888 shutdown_connections 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe00909a0 0x7fefe0090d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/2871578888 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe008c7a0 0x7fefe0090460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- 10.20.193.7:0/2871578888 >> 10.20.193.7:0/2871578888 conn(0x7fefe008e050 msgr2=0x7fefe008e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- 10.20.193.7:0/2871578888 shutdown_connections 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- 10.20.193.7:0/2871578888 wait complete. 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: monmap: 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:00.182 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 Processor -- start 2026-02-22T21:01:00.183 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- start start 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: init 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-c con 0x7fefe008c7a0 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 0x7fefe0083d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-b con 0x7fefe00909a0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe017f6d0 0x7fefe0084250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.184 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): picked mon.noname-a con 0x7fefe017f6d0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01a3d80 con 0x7fefe017f6d0 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01a3c00 con 0x7fefe00909a0 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fefe01a3f00 con 0x7fefe008c7a0 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe6ea2640 10 monclient(hunting): authenticate will time out at 1072.635703s 2026-02-22T21:01:00.185 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe017f6d0 0x7fefe0084250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47442/0 (socket says 10.20.193.7:47442) 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/1687943800 learned_addr learned my addr 10.20.193.7:0/1687943800 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): get_auth_request con 0x7fefe008c7a0 auth_method 0 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): get_auth_request con 0x7fefe017f6d0 auth_method 0 2026-02-22T21:01:00.186 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe5418640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 0x7fefe0083d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.187 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient(hunting): handle_auth_done global_id 124454 payload 824 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/1687943800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 msgr2=0x7fefe0083d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 0x7fefe0083d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe017f6d0 msgr2=0x7fefe0084250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe017f6d0 0x7fefe0084250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 monclient: found mon.noname-c 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.188 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 -- 10.20.193.7:0/1687943800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe007d4b0 con 0x7fefe008c7a0 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 10 monclient: get_auth_request con 0x7fefe00909a0 auth_method 0 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefd7fff640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 0x7fefe0083d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.158+0000 7fefe4c17640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefd001c9b0 tx=0x7fefd00191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00b9020 con 0x7fefe008c7a0 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: dump: 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.189 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd00ab460 con 0x7fefe008c7a0 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.190 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ab810 con 0x7fefe008c7a0 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: dump: 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.191 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd6ffd640 4 set_mon_vals no callback set 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 5 monclient: authenticate success, global_id 124454 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _renew_subs 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe007bf90 con 0x7fefe008c7a0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _renew_subs 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe005da30 con 0x7fefe008c7a0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fefd00ab9b0 con 0x7fefe008c7a0 2026-02-22T21:01:00.192 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe0090460 con 0x7fefe008c7a0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 --2- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 0x7fefb005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fefd00e9310 con 0x7fefe008c7a0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd7fff640 1 --2- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 0x7fefb005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd7fff640 10 monclient: get_auth_request con 0x7fefb003ab20 auth_method 0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd7fff640 1 --2- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 0x7fefb005afd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fefe007dc80 tx=0x7fefc8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fefd00c3020 con 0x7fefe008c7a0 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.193 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.162+0000 7fefd57fa640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:01:00.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fefe005fc70 con 0x7fefb003ab20 2026-02-22T21:01:00.249 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefd57fa640 1 -- 10.20.193.7:0/1687943800 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fefe005fc70 con 0x7fefb003ab20 2026-02-22T21:01:00.249 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 4 to deep-scrub 2026-02-22T21:01:00.250 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 msgr2=0x7fefb005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 0x7fefb005afd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fefe007dc80 tx=0x7fefc8008040 comp rx=0 tx=0).stop 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 10 monclient: shutdown 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 msgr2=0x7fefe012dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefd001c9b0 tx=0x7fefd00191e0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 shutdown_connections 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fefe017f6d0 0x7fefe0084250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.251 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> v2:10.20.193.61:6800/2336688312 conn(0x7fefb003ab20 0x7fefb005afd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fefe00909a0 0x7fefe0083d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 --2- 10.20.193.7:0/1687943800 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fefe008c7a0 0x7fefe012dab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 >> 10.20.193.7:0/1687943800 conn(0x7fefe008e050 msgr2=0x7fefe008a660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 shutdown_connections 2026-02-22T21:01:00.252 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.246+0000 7fefe6ea2640 1 -- 10.20.193.7:0/1687943800 wait complete. 2026-02-22T21:01:00.259 INFO:tasks.ceph:Scrubbing osd.5 2026-02-22T21:01:00.260 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: get_monmap_and_config 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: monmap: 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:00.325345+0000 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:00.325345+0000 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:00.325 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:00.326 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.326 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 Processor -- start 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 -- start start 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: init 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient: _add_conns ranks=[1,2,3,4,0] 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8b1413c430 addr v1:10.20.193.61:6789/0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-b con 0x7f8b14160500 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 0x7f8b141a1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-a con 0x7f8b14180e20 addr v2:10.20.193.7:3300/0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b140900e0 con 0x7f8b1413c430 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1408ecc0 con 0x7f8b14180e20 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1408efa0 con 0x7f8b14160500 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1c1d2640 10 monclient(hunting): authenticate will time out at 1072.798700s 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 0x7f8b141a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47448/0 (socket says 10.20.193.7:47448) 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 -- 10.20.193.7:0/3943479385 learned_addr learned my addr 10.20.193.7:0/3943479385 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): get_auth_request con 0x7f8b14160500 auth_method 0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): get_auth_request con 0x7f8b14180e20 auth_method 0 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.327 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient(hunting): handle_auth_done global_id 124457 payload 274 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 -- 10.20.193.7:0/3943479385 >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 msgr2=0x7f8b141a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 --2- 10.20.193.7:0/3943479385 >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 0x7f8b141a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 -- 10.20.193.7:0/3943479385 >> v1:10.20.193.61:6789/0 conn(0x7f8b1413c430 legacy=0x7f8b1413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 monclient: found mon.noname-b 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b19746640 1 -- 10.20.193.7:0/3943479385 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1408f280 con 0x7f8b14160500 2026-02-22T21:01:00.328 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.322+0000 7f8b1a748640 1 --2- 10.20.193.7:0/3943479385 >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 0x7f8b141a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 1 --2- 10.20.193.7:0/3943479385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b080090a0 tx=0x7f8b0801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba11315f153eae82 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 1 -- 10.20.193.7:0/3943479385 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b080aa650 con 0x7f8b14160500 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: dump: 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 1 -- 10.20.193.7:0/3943479385 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b080af070 con 0x7f8b14160500 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 1 -- 10.20.193.7:0/3943479385 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b080aaa10 con 0x7f8b14160500 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 5 monclient: authenticate success, global_id 124457 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 4 set_mon_vals no callback set 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b18f45640 10 monclient: dump: 2026-02-22T21:01:00.330 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: shutdown 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/3943479385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 msgr2=0x7f8b141808e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/3943479385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b080090a0 tx=0x7f8b0801c4d0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/3943479385 shutdown_connections 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/3943479385 >> v2:10.20.193.7:3300/0 conn(0x7f8b14180e20 0x7f8b141a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/3943479385 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b14160500 0x7f8b141808e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/3943479385 >> 10.20.193.7:0/3943479385 conn(0x7f8b140943a0 msgr2=0x7f8b14090360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/3943479385 shutdown_connections 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/3943479385 wait complete. 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: monmap: 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 Processor -- start 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- start start 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: init 2026-02-22T21:01:00.331 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b1413c430 0x7f8b1408cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-c con 0x7f8b1413c430 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8b14160500 0x7f8b14160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-b con 0x7f8b14160500 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8b14180e20 0x7f8b141612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): picked mon.noname-a con 0x7f8b14180e20 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8b141a40e0 con 0x7f8b14180e20 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f8b141a3f60 con 0x7f8b14160500 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f8b141a4260 con 0x7f8b1413c430 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient(hunting): authenticate will time out at 1072.801467s 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b1413c430 0x7f8b1408cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8b14180e20 0x7f8b141612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b1413c430 0x7f8b1408cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47462/0 (socket says 10.20.193.7:47462) 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 1 -- 10.20.193.7:0/2209512244 learned_addr learned my addr 10.20.193.7:0/2209512244 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): get_auth_request con 0x7f8b1413c430 auth_method 0 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): get_auth_request con 0x7f8b14180e20 auth_method 0 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.332 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 1 --2- 10.20.193.7:0/2209512244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8b14160500 0x7f8b14160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 10 monclient(hunting): get_auth_request con 0x7f8b14160500 auth_method 0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient(hunting): handle_auth_done global_id 134238 payload 824 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 -- 10.20.193.7:0/2209512244 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b1413c430 msgr2=0x7f8b1408cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 --2- 10.20.193.7:0/2209512244 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f8b1413c430 0x7f8b1408cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 -- 10.20.193.7:0/2209512244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8b14160500 msgr2=0x7f8b14160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 --2- 10.20.193.7:0/2209512244 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f8b14160500 0x7f8b14160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 monclient: found mon.noname-a 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 -- 10.20.193.7:0/2209512244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b14163440 con 0x7f8b14180e20 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1a748640 1 --2- 10.20.193.7:0/2209512244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8b14180e20 0x7f8b141612d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009d80 tx=0x7f8b1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10018020 con 0x7f8b14180e20 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: dump: 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b10014480 con 0x7f8b14180e20 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 5 monclient: authenticate success, global_id 134238 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _renew_subs 2026-02-22T21:01:00.333 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b14161810 con 0x7f8b14180e20 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10014870 con 0x7f8b14180e20 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: dump: 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b03fff640 4 set_mon_vals no callback set 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _renew_subs 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1408a5b0 con 0x7f8b14180e20 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.334 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b1413c800 con 0x7f8b14180e20 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f8b10014a10 con 0x7f8b14180e20 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ae403ab20 0x7f8ae405afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f8b10005e00 con 0x7f8b14180e20 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6809/837853154 conn(0x7f8ae405e660 0x7f8ae407ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 --> v2:10.20.193.61:6809/837853154 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b1001de50 con 0x7f8ae405e660 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=314) ==== 24+0+0 (secure 0 0 0) 0x7f8b10050180 con 0x7f8b14180e20 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b027fc640 10 monclient: handle_get_version_reply finishing 1 version 314 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ae403ab20 0x7f8ae405afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 10 monclient: get_auth_request con 0x7f8ae403ab20 auth_method 0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6809/837853154 conn(0x7f8ae405e660 0x7f8ae407ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 10 monclient: get_auth_request con 0x7f8ae405e660 auth_method 0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19f47640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ae403ab20 0x7f8ae405afd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8b04002770 tx=0x7f8b04007f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.326+0000 7f8b19746640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6809/837853154 conn(0x7f8ae405e660 0x7f8ae407ea70 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.335 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.330+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== osd.5 v2:10.20.193.61:6809/837853154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (crc 0 0 0) 0x7f8b1001de50 con 0x7f8ae405e660 2026-02-22T21:01:00.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 --> v2:10.20.193.61:6809/837853154 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8b1408d540 con 0x7f8ae405e660 2026-02-22T21:01:00.339 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b027fc640 1 -- 10.20.193.7:0/2209512244 <== osd.5 v2:10.20.193.61:6809/837853154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8b1408d540 con 0x7f8ae405e660 2026-02-22T21:01:00.340 INFO:teuthology.orchestra.run.trial007.stdout:{ 2026-02-22T21:01:00.340 INFO:teuthology.orchestra.run.trial007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:01:00.340 INFO:teuthology.orchestra.run.trial007.stdout:} 2026-02-22T21:01:00.341 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6809/837853154 conn(0x7f8ae405e660 msgr2=0x7f8ae407ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6809/837853154 conn(0x7f8ae405e660 0x7f8ae407ea70 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ae403ab20 msgr2=0x7f8ae405afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/2209512244 >> v2:10.20.193.61:6800/2336688312 conn(0x7f8ae403ab20 0x7f8ae405afd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8b04002770 tx=0x7f8b04007f60 comp rx=0 tx=0).stop 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 10 monclient: shutdown 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8b14180e20 msgr2=0x7f8b141612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 --2- 10.20.193.7:0/2209512244 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f8b14180e20 0x7f8b141612d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009d80 tx=0x7f8b1000c490 comp rx=0 tx=0).stop 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1a748640 1 -- 10.20.193.7:0/2209512244 reap_dead start 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 shutdown_connections 2026-02-22T21:01:00.342 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 >> 10.20.193.7:0/2209512244 conn(0x7f8b140943a0 msgr2=0x7f8b140895a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 shutdown_connections 2026-02-22T21:01:00.343 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.334+0000 7f8b1c1d2640 1 -- 10.20.193.7:0/2209512244 wait complete. 2026-02-22T21:01:00.349 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-22T21:01:00.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: get_monmap_and_config 2026-02-22T21:01:00.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.429 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: monmap: 2026-02-22T21:01:00.429 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.429 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:00.418156+0000 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:00.418156+0000 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:00.430 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 Processor -- start 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 -- start start 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: init 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient: _add_conns ranks=[3,1,0,4,2] 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f25e405d1c0 0x7f25e405d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-a con 0x7f25e405d1c0 addr v2:10.20.193.7:3300/0 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f25e408e3b0 addr v1:10.20.193.61:6789/0 2026-02-22T21:01:00.431 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f25e408ef00 addr v1:10.20.193.7:6789/0 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e413fbd0 con 0x7f25e408ef00 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e408b770 con 0x7f25e408e3b0 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 1 -- --> v2:10.20.193.7:3300/0 -- mon_getmap magic: 0 -- 0x7f25e408a6d0 con 0x7f25e405d1c0 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e8d48640 10 monclient(hunting): authenticate will time out at 1072.891083s 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 1 --2- >> v2:10.20.193.7:3300/0 conn(0x7f25e405d1c0 0x7f25e405d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2d76640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f25e408ef00 0x7f25e41a1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:57228/0 (socket says 10.20.193.7:57228) 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2d76640 1 -- 10.20.193.7:0/1552968029 learned_addr learned my addr 10.20.193.7:0/1552968029 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): get_auth_request con 0x7f25e405d1c0 auth_method 0 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.432 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient(hunting): handle_auth_done global_id 134241 payload 274 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 1 -- 10.20.193.7:0/1552968029 >> v1:10.20.193.61:6789/0 conn(0x7f25e408e3b0 legacy=0x7f25e408e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 1 -- 10.20.193.7:0/1552968029 >> v1:10.20.193.7:6789/0 conn(0x7f25e408ef00 legacy=0x7f25e41a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 1 monclient: found mon.noname-a 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.433 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.414+0000 7f25e2575640 1 -- 10.20.193.7:0/1552968029 --> v2:10.20.193.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e408ba50 con 0x7f25e405d1c0 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2575640 1 --2- 10.20.193.7:0/1552968029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e405d1c0 0x7f25e405d590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25d8004780 tx=0x7f25d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d43452e420951 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 1 -- 10.20.193.7:0/1552968029 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80b0070 con 0x7f25e405d1c0 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: dump: 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.434 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 1 -- 10.20.193.7:0/1552968029 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d80ab600 con 0x7f25e405d1c0 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 5 monclient: authenticate success, global_id 134241 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 1 -- 10.20.193.7:0/1552968029 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80ab9b0 con 0x7f25e405d1c0 2026-02-22T21:01:00.435 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1573640 10 monclient: dump: 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.436 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 4 set_mon_vals no callback set 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: shutdown 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/1552968029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e405d1c0 msgr2=0x7f25e405d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 --2- 10.20.193.7:0/1552968029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e405d1c0 0x7f25e405d590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25d8004780 tx=0x7f25d801c440 comp rx=0 tx=0).stop 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/1552968029 shutdown_connections 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 --2- 10.20.193.7:0/1552968029 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e405d1c0 0x7f25e405d590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/1552968029 >> 10.20.193.7:0/1552968029 conn(0x7f25e408faa0 msgr2=0x7f25e408bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/1552968029 shutdown_connections 2026-02-22T21:01:00.437 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/1552968029 wait complete. 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: monmap: 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:00.438 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 Processor -- start 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- start start 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: init 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 0x7f25e4150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-b con 0x7f25e405d1c0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.439 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-a con 0x7f25e408e3b0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 0x7f25e41274b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): picked mon.noname-c con 0x7f25e408ef00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41a56f0 con 0x7f25e408e3b0 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41a5570 con 0x7f25e405d1c0 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f25e41a5870 con 0x7f25e408ef00 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.440 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient(hunting): authenticate will time out at 1072.894447s 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 0x7f25e41274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:48384/0 (socket says 10.20.193.7:48384) 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 0x7f25e41274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47470/0 (socket says 10.20.193.7:47470) 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 -- 10.20.193.7:0/333988225 learned_addr learned my addr 10.20.193.7:0/333988225 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): get_auth_request con 0x7f25e408e3b0 auth_method 0 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.441 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): get_auth_request con 0x7f25e408ef00 auth_method 0 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient(hunting): handle_auth_done global_id 134247 payload 824 2026-02-22T21:01:00.442 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2575640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 0x7f25e4150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 -- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 msgr2=0x7f25e41274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 0x7f25e41274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 -- 10.20.193.7:0/333988225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 msgr2=0x7f25e4150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 0x7f25e4150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 monclient: found mon.noname-a 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 -- 10.20.193.7:0/333988225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e412b230 con 0x7f25e408e3b0 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2575640 10 monclient: get_auth_request con 0x7f25e405d1c0 auth_method 0 2026-02-22T21:01:00.443 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e2575640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 0x7f25e4150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e1d74640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00c520 tx=0x7f25cc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc017070 con 0x7f25e408e3b0 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: dump: 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.444 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc006ad0 con 0x7f25e408e3b0 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc007030 con 0x7f25e408e3b0 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:00.445 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 10 monclient: dump: 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.446 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e0d72640 4 set_mon_vals no callback set 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 5 monclient: authenticate success, global_id 134247 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _renew_subs 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e413e9f0 con 0x7f25e408e3b0 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _renew_subs 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e4128ed0 con 0x7f25e408e3b0 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:00.447 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e405d590 con 0x7f25e408e3b0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f25cc0071d0 con 0x7f25e408e3b0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 --2- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 0x7f25b005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.418+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f25cc04de30 con 0x7f25e408e3b0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25e2575640 1 --2- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 0x7f25b005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25e2575640 10 monclient: get_auth_request con 0x7f25b003ab20 auth_method 0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25e2575640 1 --2- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 0x7f25b005afd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25d8006e10 tx=0x7f25d80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f25cc009d40 con 0x7f25e408e3b0 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.448 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.422+0000 7f25caffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:01:00.509 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f25e405fc70 con 0x7f25b003ab20 2026-02-22T21:01:00.510 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25caffd640 1 -- 10.20.193.7:0/333988225 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25e405fc70 con 0x7f25b003ab20 2026-02-22T21:01:00.510 INFO:teuthology.orchestra.run.trial007.stderr:instructed osd(s) 5 to deep-scrub 2026-02-22T21:01:00.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 msgr2=0x7f25b005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 0x7f25b005afd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f25d8006e10 tx=0x7f25d80a6000 comp rx=0 tx=0).stop 2026-02-22T21:01:00.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 10 monclient: shutdown 2026-02-22T21:01:00.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.511 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 msgr2=0x7f25e4150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00c520 tx=0x7f25cc00c9e0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 shutdown_connections 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f25e408ef00 0x7f25e41274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f25e408e3b0 0x7f25e4150c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> v2:10.20.193.61:6800/2336688312 conn(0x7f25b003ab20 0x7f25b005afd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 --2- 10.20.193.7:0/333988225 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f25e405d1c0 0x7f25e4150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 >> 10.20.193.7:0/333988225 conn(0x7f25e408faa0 msgr2=0x7f25e413ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 shutdown_connections 2026-02-22T21:01:00.512 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.506+0000 7f25e8d48640 1 -- 10.20.193.7:0/333988225 wait complete. 2026-02-22T21:01:00.520 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:01:00.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: get_monmap_and_config 2026-02-22T21:01:00.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.584 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: monmap: 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:00.581794+0000 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:00.581794+0000 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:00.585 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 Processor -- start 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 -- start start 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: init 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2026-02-22T21:01:00.586 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f355013f290 addr v1:10.20.193.61:6789/0 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-c con 0x7f355013fd70 addr v2:10.20.193.61:3300/0 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-b con 0x7f3550180d00 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355008fd70 con 0x7f355013f290 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f355008e1f0 con 0x7f355013fd70 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.587 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f355008ec90 con 0x7f3550180d00 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3557eda640 10 monclient(hunting): authenticate will time out at 1073.054722s 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47482/0 (socket says 10.20.193.7:47482) 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 -- 10.20.193.7:0/2630479572 learned_addr learned my addr 10.20.193.7:0/2630479572 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): get_auth_request con 0x7f3550180d00 auth_method 0 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.588 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient(hunting): handle_auth_done global_id 124466 payload 274 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 -- 10.20.193.7:0/2630479572 >> v2:10.20.193.61:3300/0 conn(0x7f355013fd70 msgr2=0x7f35501807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 --2- 10.20.193.7:0/2630479572 >> v2:10.20.193.61:3300/0 conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 -- 10.20.193.7:0/2630479572 >> v1:10.20.193.61:6789/0 conn(0x7f355013f290 legacy=0x7f355013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 monclient: found mon.noname-b 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.589 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.578+0000 7f3556450640 1 -- 10.20.193.7:0/2630479572 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3550092bc0 con 0x7f3550180d00 2026-02-22T21:01:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 1 --2- 10.20.193.7:0/2630479572 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f354c009580 tx=0x7f354c01c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e7e4bdd3192959 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.597 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 1 -- 10.20.193.7:0/2630479572 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a6710 con 0x7f3550180d00 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: dump: 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.598 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 1 -- 10.20.193.7:0/2630479572 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c0a68b0 con 0x7f3550180d00 2026-02-22T21:01:00.599 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 1 -- 10.20.193.7:0/2630479572 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a6ca0 con 0x7f3550180d00 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 5 monclient: authenticate success, global_id 124466 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 4 set_mon_vals no callback set 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3554c4d640 10 monclient: dump: 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.600 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: shutdown 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2630479572 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 msgr2=0x7f35501a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.601 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- 10.20.193.7:0/2630479572 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f354c009580 tx=0x7f354c01c680 comp rx=0 tx=0).stop 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2630479572 shutdown_connections 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- 10.20.193.7:0/2630479572 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f3550180d00 0x7f35501a10e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- 10.20.193.7:0/2630479572 >> v2:10.20.193.61:3300/0 conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2630479572 >> 10.20.193.7:0/2630479572 conn(0x7f3550093df0 msgr2=0x7f35500902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2630479572 shutdown_connections 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2630479572 wait complete. 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: build_initial_monmap 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: monmap: 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:00.602 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 Processor -- start 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- start start 2026-02-22T21:01:00.603 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: init 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-c con 0x7f355013f290 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-a con 0x7f355013fd70 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3550180d00 0x7f3550128d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): picked mon.noname-b con 0x7f3550180d00 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.604 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35501a4050 con 0x7f355013fd70 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f3550090da0 con 0x7f3550180d00 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f35501a41d0 con 0x7f355013f290 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient(hunting): authenticate will time out at 1073.058879s 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:47494/0 (socket says 10.20.193.7:47494) 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 -- 10.20.193.7:0/2136491047 learned_addr learned my addr 10.20.193.7:0/2136491047 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): get_auth_request con 0x7f355013f290 auth_method 0 2026-02-22T21:01:00.605 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): get_auth_request con 0x7f355013fd70 auth_method 0 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.606 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3550180d00 0x7f3550128d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f355544e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 10 monclient(hunting): get_auth_request con 0x7f3550180d00 auth_method 0 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3556450640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:00.607 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient(hunting): handle_auth_done global_id 124469 payload 824 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 -- 10.20.193.7:0/2136491047 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3550180d00 msgr2=0x7f3550128d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3550180d00 0x7f3550128d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 -- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f355013fd70 msgr2=0x7f35501807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient: _finish_hunting 0 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 monclient: found mon.noname-c 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.608 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 -- 10.20.193.7:0/2136491047 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355010d460 con 0x7f355013f290 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3555c4f640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f354000c520 tx=0x7f354000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540017070 con 0x7f355013f290 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: dump: 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.609 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: _finish_auth 0 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: _check_auth_tickets 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3540006ad0 con 0x7f355013f290 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540007030 con 0x7f355013f290 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 5 monclient: authenticate success, global_id 124469 2026-02-22T21:01:00.610 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _renew_subs 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355010c970 con 0x7f355013f290 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353ffff640 4 set_mon_vals no callback set 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f353e7fc640 10 monclient: dump: 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:00.611 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _renew_subs 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f355010c240 con 0x7f355013f290 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.612 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.582+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355010d230 con 0x7f355013f290 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f35400071d0 con 0x7f355013f290 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 1 --2- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 0x7f352005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f354004de30 con 0x7f355013f290 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f355544e640 1 --2- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 0x7f352005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f355544e640 10 monclient: get_auth_request con 0x7f352003ab20 auth_method 0 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f355544e640 1 --2- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 0x7f352005afd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f355008ddf0 tx=0x7f3544009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f354001a360 con 0x7f355013f290 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:00.613 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.586+0000 7f353e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:01:00.672 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.666+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f355005fb70 con 0x7f352003ab20 2026-02-22T21:01:00.673 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f353e7fc640 1 -- 10.20.193.7:0/2136491047 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34039 (secure 0 0 0) 0x7f355005fb70 con 0x7f352003ab20 2026-02-22T21:01:00.673 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 msgr2=0x7f352005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 0x7f352005afd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f355008ddf0 tx=0x7f3544009210 comp rx=0 tx=0).stop 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 10 monclient: shutdown 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 msgr2=0x7f355010b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f354000c520 tx=0x7f354000c9e0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.675 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 shutdown_connections 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> v2:10.20.193.61:6800/2336688312 conn(0x7f352003ab20 0x7f352005afd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f3550180d00 0x7f3550128d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f355013fd70 0x7f35501807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 --2- 10.20.193.7:0/2136491047 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f355013f290 0x7f355010b080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 >> 10.20.193.7:0/2136491047 conn(0x7f3550093df0 msgr2=0x7f355013e230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 shutdown_connections 2026-02-22T21:01:00.676 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:00.670+0000 7f3557eda640 1 -- 10.20.193.7:0/2136491047 wait complete. 2026-02-22T21:01:00.683 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":580,"stamp":"2026-02-22T21:00:59.971697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":176328,"kb_used_data":14568,"kb_used_omap":1202,"kb_used_meta":160461,"kb_avail":566054712,"statfs":{"total":579820584960,"available":579640025088,"internally_reserved":0,"allocated":14917632,"data_stored":7619104,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":1231485,"internal_metadata":164312451},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.085083"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":611,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832699+0000","last_change":"2026-02-22T20:52:13.632475+0000","last_active":"2026-02-22T21:00:53.832699+0000","last_peered":"2026-02-22T21:00:53.832699+0000","last_clean":"2026-02-22T21:00:53.832699+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T21:00:53.832699+0000","last_undegraded":"2026-02-22T21:00:53.832699+0000","last_fullsized":"2026-02-22T21:00:53.832699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:51.388041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":606,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832805+0000","last_change":"2026-02-22T20:52:13.212950+0000","last_active":"2026-02-22T21:00:53.832805+0000","last_peered":"2026-02-22T21:00:53.832805+0000","last_clean":"2026-02-22T21:00:53.832805+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T21:00:53.832805+0000","last_undegraded":"2026-02-22T21:00:53.832805+0000","last_fullsized":"2026-02-22T21:00:53.832805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:52.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":611,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832691+0000","last_change":"2026-02-22T20:52:13.632397+0000","last_active":"2026-02-22T21:00:53.832691+0000","last_peered":"2026-02-22T21:00:53.832691+0000","last_clean":"2026-02-22T21:00:53.832691+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T21:00:53.832691+0000","last_undegraded":"2026-02-22T21:00:53.832691+0000","last_fullsized":"2026-02-22T21:00:53.832691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:00.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":606,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832800+0000","last_change":"2026-02-22T20:52:13.212995+0000","last_active":"2026-02-22T21:00:53.832800+0000","last_peered":"2026-02-22T21:00:53.832800+0000","last_clean":"2026-02-22T21:00:53.832800+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T21:00:53.832800+0000","last_undegraded":"2026-02-22T21:00:53.832800+0000","last_fullsized":"2026-02-22T21:00:53.832800+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:01:12.850268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":597,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:55.074267+0000","last_change":"2026-02-22T20:52:13.204088+0000","last_active":"2026-02-22T21:00:55.074267+0000","last_peered":"2026-02-22T21:00:55.074267+0000","last_clean":"2026-02-22T21:00:55.074267+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T21:00:55.074267+0000","last_undegraded":"2026-02-22T21:00:55.074267+0000","last_fullsized":"2026-02-22T21:00:55.074267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:53:08.355348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":608,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:55.073645+0000","last_change":"2026-02-22T20:52:13.213012+0000","last_active":"2026-02-22T21:00:55.073645+0000","last_peered":"2026-02-22T21:00:55.073645+0000","last_clean":"2026-02-22T21:00:55.073645+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T21:00:55.073645+0000","last_undegraded":"2026-02-22T21:00:55.073645+0000","last_fullsized":"2026-02-22T21:00:55.073645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:02:30.386173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":611,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832736+0000","last_change":"2026-02-22T20:52:13.632588+0000","last_active":"2026-02-22T21:00:53.832736+0000","last_peered":"2026-02-22T21:00:53.832736+0000","last_clean":"2026-02-22T21:00:53.832736+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T21:00:53.832736+0000","last_undegraded":"2026-02-22T21:00:53.832736+0000","last_fullsized":"2026-02-22T21:00:53.832736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:14:40.847957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":596,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:55.074277+0000","last_change":"2026-02-22T20:52:13.204192+0000","last_active":"2026-02-22T21:00:55.074277+0000","last_peered":"2026-02-22T21:00:55.074277+0000","last_clean":"2026-02-22T21:00:55.074277+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T21:00:55.074277+0000","last_undegraded":"2026-02-22T21:00:55.074277+0000","last_fullsized":"2026-02-22T21:00:55.074277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:10.200663+0000","last_clean_scrub_stamp":"2026-02-22T20:52:10.200663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:03:13.839912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":746,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:53.832727+0000","last_change":"2026-02-22T20:52:09.633578+0000","last_active":"2026-02-22T21:00:53.832727+0000","last_peered":"2026-02-22T21:00:53.832727+0000","last_clean":"2026-02-22T21:00:53.832727+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T21:00:53.832727+0000","last_undegraded":"2026-02-22T21:00:53.832727+0000","last_fullsized":"2026-02-22T21:00:53.832727+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T20:52:08.193988+0000","last_clean_scrub_stamp":"2026-02-22T20:52:08.193988+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:54.240835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640365,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29372,"kb_used_data":2412,"kb_used_omap":196,"kb_used_meta":26747,"kb_avail":94342468,"statfs":{"total":96636764160,"available":96606687232,"internally_reserved":0,"allocated":2469888,"data_stored":1073074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201559,"internal_metadata":27389097},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640364,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":203,"kb_used_meta":26740,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1073055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208068,"internal_metadata":27382588},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640365,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29424,"kb_used_data":2464,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94342416,"statfs":{"total":96636764160,"available":96606633984,"internally_reserved":0,"allocated":2523136,"data_stored":1663423,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":211973,"internal_metadata":27378683},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640364,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1073055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640364,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29372,"kb_used_data":2412,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94342468,"statfs":{"total":96636764160,"available":96606687232,"internally_reserved":0,"allocated":2469888,"data_stored":1073074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209371,"internal_metadata":27381285},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640364,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29424,"kb_used_data":2464,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94342416,"statfs":{"total":96636764160,"available":96606633984,"internally_reserved":0,"allocated":2523136,"data_stored":1663423,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":189841,"internal_metadata":27400815},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:01:00.689 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.690 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.690 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.690 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.690 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.690 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.691 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.691 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T20:52:10.200663+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=10, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.691 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T20:52:08.193988+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=20, tm_min=52, tm_sec=8, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=0, tm_sec=57, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:01:00.691 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Waking up [active, now 2026-02-22_21:01:01] 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Running 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Optimize plan auto_2026-02-22_21:01:01 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Mode upmap, max misplaced 0.050000 2026-02-22T21:01:01.945 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:unknown 0.000000 degraded 0.000000 inactive 0.000000 misplaced 0 2026-02-22T21:01:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:do_upmap 2026-02-22T21:01:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:pools ['.mgr', 'rbd'] 2026-02-22T21:01:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:prepared 0/10 upmap changes 2026-02-22T21:01:01.946 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Sleeping for 60 2026-02-22T21:01:01.950 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:01:01.951 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:01:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:scanning for idle connections.. 2026-02-22T21:01:01.954 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:mgr_util:cleaning up connections: [] 2026-02-22T21:01:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: refresh_pools 2026-02-22T21:01:01.964 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:TrashPurgeScheduleHandler: load_schedules 2026-02-22T21:01:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T21:01:01.965 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TrashPurgeScheduleHandler: no schedules 2026-02-22T21:01:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: refresh_images 2026-02-22T21:01:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:MirrorSnapshotScheduleHandler: load_schedules 2026-02-22T21:01:01.967 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:load_schedules: rbd, start_after= 2026-02-22T21:01:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:MirrorSnapshotScheduleHandler: no schedules 2026-02-22T21:01:01.968 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:_maybe_adjust 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:pool: { 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: ".mgr": { 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "mgr": {} 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T21:01:01.970 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:07.953655+0000", 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 1, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool", 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T21:01:01.971 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "14", 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T21:01:01.972 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": { 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_max": 32, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_min": 1 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T21:01:01.973 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 1, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": ".mgr", 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 0.33000001311302185, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.0, 2026-02-22T21:01:01.974 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 6.059999942779541, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 6.059999942779541, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T21:01:01.975 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": { 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "application_metadata": { 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "rbd": {} 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "auid": 0, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_evict_age": 0, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_min_flush_age": 0, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_mode": "none", 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_dirty_ratio_micro": 400000, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "cache_target_full_ratio_micro": 800000, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "create_time": "2026-02-22T20:52:10.131782+0000", 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "crush_rule": 0, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "erasure_code_profile": "", 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "expected_num_objects": 0, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "fast_read": false, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags": 8193, 2026-02-22T21:01:01.976 INFO:tasks.ceph.mgr.x.trial061.stderr: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "grade_table": [], 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_count": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_grade_decay_rate": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_params": { 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": "none" 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_period": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "hit_set_search_last_n": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "is_stretch_pool": false, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_change": "17", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend": "0", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_preluminous": "0", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_force_op_resend_prenautilus": "0", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_pg_merge_meta": { 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_clean": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "last_epoch_started": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "ready_epoch": 0, 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_pgid": "0.0", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "source_version": "0'0", 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_version": "0'0" 2026-02-22T21:01:01.977 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_read_recency_for_promote": 0, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_size": 1, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "min_write_recency_for_promote": 0, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "nonprimary_shards": "{}", 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "object_hash": 2, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "options": {}, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_barrier": 0, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_count": 0, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "peering_crush_bucket_target": 0, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_autoscale_mode": "off", 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num": 8, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_pending": 8, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_num_target": 8, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num": 8, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pg_placement_num_target": 8, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool": 2, 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_name": "rbd", 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "pool_snaps": [], 2026-02-22T21:01:01.978 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_bytes": 0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "quota_max_objects": 0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_balance": { 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity": 1.0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "average_primary_affinity_weighted": 1.0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "optimal_score": 1.0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "primary_affinity_weighted": 1.0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_acting": 2.25, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "raw_score_stable": 2.25, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_acting": 2.25, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_stable": 2.25, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "score_type": "Fair distribution" 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: }, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "read_tier": -1, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "removed_snaps": "[]", 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "size": 2, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_epoch": 17, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_mode": "selfmanaged", 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "snap_seq": 2, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "stripe_width": 0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_bytes": 0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "target_max_objects": 0, 2026-02-22T21:01:01.979 INFO:tasks.ceph.mgr.x.trial061.stderr: "tier_of": -1, 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "tiers": [], 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "type": 1, 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "use_gmt_hitset": true, 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: "write_tier": -1 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr: } 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:} 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:root_ids [-1, -1] pools [1, 2] with 6 osds, pg_target 600 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool '.mgr' root_id -1 using 1.9779911747685185e-07 of space, bias 1.0, pg target 5.9339735243055555e-05 quantized to 1 (current 1) 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:effective_target_ratio 0.0 0.0 0 579820584960 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:INFO:root:Pool 'rbd' root_id -1 using 1.4128508391203704e-08 of space, bias 1.0, pg target 4.238552517361111e-06 quantized to 32 (current 8) 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:WARNING:root:pool rbd won't scale because recommended PG_NUM target value varies from current PG_NUM value by more than '3.000000' scaling threshold 2026-02-22T21:01:01.980 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:01:01.981 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:01:06.973 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:01:06.974 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:01:11.974 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:01:11.974 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:01:16.974 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:PerfHandler: tick 2026-02-22T21:01:16.974 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:TaskHandler: tick 2026-02-22T21:01:20.692 DEBUG:teuthology.orchestra.run.trial007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:01:20.771 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: get_monmap_and_config 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: build_initial_monmap 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: monmap: 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:20.761953+0000 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:20.761953+0000 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.772 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 Processor -- start 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 -- start start 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: init 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:20.773 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient: _add_conns ranks=[4,0,1,3,2] 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7f85c413f290 0x7f85c413f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-c con 0x7f85c413f290 addr v2:10.20.193.61:3300/0 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f85c413fba0 addr v1:10.20.193.7:6789/0 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f85c413c680 addr v1:10.20.193.61:6789/0 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c408fd70 con 0x7f85c413fba0 2026-02-22T21:01:20.774 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 -- --> v1:10.20.193.61:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c4092bc0 con 0x7f85c413c680 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7f85c408e1f0 con 0x7f85c413f290 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 10 monclient(hunting): authenticate will time out at 1093.234844s 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7f85c413fba0 0x7f85c413bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:46512/0 (socket says 10.20.193.7:46512) 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 1 -- 10.20.193.7:0/2922911700 learned_addr learned my addr 10.20.193.7:0/2922911700 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:01:20.775 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2922911700 >> v2:10.20.193.61:3300/0 conn(0x7f85c413f290 0x7f85c413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request con 0x7f85c413f290 auth_method 0 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.776 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v1:10.20.193.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926084919 0 0) 0x7f85ac002920 con 0x7f85c413fba0 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): _negotiate 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): my global_id is 134253 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 --> v1:10.20.193.7:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85b0003620 con 0x7f85c413fba0 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v1:10.20.193.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3788720247 0 0) 0x7f85b0003620 con 0x7f85c413fba0 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 >> v2:10.20.193.61:3300/0 conn(0x7f85c413f290 msgr2=0x7f85c413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 --2- 10.20.193.7:0/2922911700 >> v2:10.20.193.61:3300/0 conn(0x7f85c413f290 0x7f85c413f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 >> v1:10.20.193.61:6789/0 conn(0x7f85c413c680 legacy=0x7f85c41a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.777 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _finish_hunting 0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 monclient: found mon.noname-a-legacy 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.7:6789/0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 --> v1:10.20.193.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c408e6d0 con 0x7f85c413fba0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _finish_auth 0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _check_auth_tickets 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v1:10.20.193.7:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4111350454 0 0) 0x7f85ac003030 con 0x7f85c413fba0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: dump: 2026-02-22T21:01:20.778 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] but i'm connected to v1:10.20.193.7:6789/0, reconnecting 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:20.779 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 >> v1:10.20.193.7:6789/0 conn(0x7f85c413fba0 legacy=0x7f85c413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85b0003c10 0x7f85b0004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): picked mon.c con 0x7f85b0003c10 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b00048d0 0x7f85b0004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): picked mon.b con 0x7f85b00048d0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 0x7f85b0065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): picked mon.a con 0x7f85b0005460 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85c408e1f0 con 0x7f85b0005460 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f85b0066390 con 0x7f85b00048d0 2026-02-22T21:01:20.780 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85b0066590 con 0x7f85b0003c10 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2922911700 >> v2:10.20.193.61:3300/0 conn(0x7f85c413f290 0x7f85c413f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 0x7f85b0065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): get_auth_request con 0x7f85b0005460 auth_method 0 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85b0003c10 0x7f85b0004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.781 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request con 0x7f85b0003c10 auth_method 0 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b00048d0 0x7f85b0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 10 monclient(hunting): get_auth_request con 0x7f85b00048d0 auth_method 0 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.782 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient(hunting): handle_auth_done global_id 134253 payload 293 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 -- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85b0003c10 msgr2=0x7f85b0004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85b0003c10 0x7f85b0004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 -- 10.20.193.7:0/2922911700 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b00048d0 msgr2=0x7f85b0004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b00048d0 0x7f85b0004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient: _finish_hunting 0 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 monclient: found mon.a 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 1 -- 10.20.193.7:0/2922911700 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b0003620 con 0x7f85b0005460 2026-02-22T21:01:20.783 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient: _finish_auth 0 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 10 monclient: _check_auth_tickets 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 5 monclient: authenticate success, global_id 134253 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.758+0000 7f85c93bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 -- 10.20.193.7:0/2922911700 reap_dead start 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 0x7f85b0065ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c160 tx=0x7f85b401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494cae9fed87ac09 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4003700 con 0x7f85b0005460 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: dump: 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.784 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b40a5930 con 0x7f85b0005460 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 1 -- 10.20.193.7:0/2922911700 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b40a5d20 con 0x7f85b0005460 2026-02-22T21:01:20.785 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c1ffb640 10 monclient: dump: 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.786 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 4 set_mon_vals no callback set 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: shutdown 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 msgr2=0x7f85b0065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 0x7f85b0065ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c160 tx=0x7f85b401cbd0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2922911700 shutdown_connections 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2922911700 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85b0005460 0x7f85b0065ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2922911700 >> 10.20.193.7:0/2922911700 conn(0x7f85c4093df0 msgr2=0x7f85c40902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2922911700 shutdown_connections 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2922911700 wait complete. 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: build_initial_monmap 2026-02-22T21:01:20.787 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: monmap: 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 Processor -- start 2026-02-22T21:01:20.788 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- start start 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: init 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b0005460 0x7f85c413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-b con 0x7f85b0005460 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-c con 0x7f85c4150c70 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): picked mon.noname-a con 0x7f85c4129e50 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85c413f7e0 con 0x7f85c4129e50 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.789 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7f85c413f660 con 0x7f85b0005460 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7f85c413f960 con 0x7f85c4150c70 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient(hunting): authenticate will time out at 1093.238914s 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3300/0 says I am v2:10.20.193.7:49874/0 (socket says 10.20.193.7:49874) 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41566/0 (socket says 10.20.193.7:41566) 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 -- 10.20.193.7:0/2823772772 learned_addr learned my addr 10.20.193.7:0/2823772772 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): get_auth_request con 0x7f85c4129e50 auth_method 0 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.790 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): get_auth_request con 0x7f85c4150c70 auth_method 0 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b0005460 0x7f85c413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request con 0x7f85b0005460 auth_method 0 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.791 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient(hunting): handle_auth_done global_id 134256 payload 824 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 -- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 msgr2=0x7f85c413b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 -- 10.20.193.7:0/2823772772 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b0005460 msgr2=0x7f85c413b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b0005460 0x7f85c413b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient: _finish_hunting 0 2026-02-22T21:01:20.792 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 monclient: found mon.noname-a 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.7:3300/0 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 -- 10.20.193.7:0/2823772772 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c4056e50 con 0x7f85c4129e50 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c27fc640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c37fe640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a030 tx=0x7f85b0005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b40bc070 con 0x7f85c4129e50 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: dump: 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.793 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: _finish_auth 0 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: _check_auth_tickets 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b40030e0 con 0x7f85c4129e50 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b40b3070 con 0x7f85c4129e50 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-22T21:01:20.794 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c17fa640 4 set_mon_vals no callback set 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85a37fe640 10 monclient: dump: 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 5 monclient: authenticate success, global_id 134256 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _renew_subs 2026-02-22T21:01:20.795 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c413d340 con 0x7f85c4129e50 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _renew_subs 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.762+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c412d7e0 con 0x7f85c4129e50 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c93bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c93bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c93bc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.7:3300/0 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c413bb30 con 0x7f85c4129e50 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7f85b4003c70 con 0x7f85c4129e50 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85a37fe640 1 --2- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 0x7f859005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7f85b40e7ee0 con 0x7f85c4129e50 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 0x7f859005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c2ffd640 10 monclient: get_auth_request con 0x7f859003ab20 auth_method 0 2026-02-22T21:01:20.796 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.766+0000 7f85c2ffd640 1 --2- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 0x7f859005afd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f85b8004780 tx=0x7f85b8009290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.770+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mon.0 v2:10.20.193.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7f85c413d340 con 0x7f85c4129e50 2026-02-22T21:01:20.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.770+0000 7f85a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.797 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.770+0000 7f85a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:01:20.853 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 --> v2:10.20.193.61:6800/2336688312 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85c413bf50 con 0x7f859003ab20 2026-02-22T21:01:20.854 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85a37fe640 1 -- 10.20.193.7:0/2823772772 <== mgr.4102 v2:10.20.193.61:6800/2336688312 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34059 (secure 0 0 0) 0x7f85c413bf50 con 0x7f859003ab20 2026-02-22T21:01:20.854 INFO:teuthology.orchestra.run.trial007.stdout: 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:dumped all 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 msgr2=0x7f859005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 0x7f859005afd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f85b8004780 tx=0x7f85b8009290 comp rx=0 tx=0).stop 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 10 monclient: shutdown 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 msgr2=0x7f85c412a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a030 tx=0x7f85b0005900 comp rx=0 tx=0).stop 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 shutdown_connections 2026-02-22T21:01:20.856 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7f85c4129e50 0x7f85c412a2d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7f85c4150c70 0x7f85c413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> v2:10.20.193.61:6800/2336688312 conn(0x7f859003ab20 0x7f859005afd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 --2- 10.20.193.7:0/2823772772 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7f85b0005460 0x7f85c413b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 >> 10.20.193.7:0/2823772772 conn(0x7f85c4093df0 msgr2=0x7f85c4055a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 shutdown_connections 2026-02-22T21:01:20.857 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.850+0000 7f85c93bc640 1 -- 10.20.193.7:0/2823772772 wait complete. 2026-02-22T21:01:20.864 INFO:teuthology.orchestra.run.trial007.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2026-02-22T21:01:19.973372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":176328,"kb_used_data":14568,"kb_used_omap":1202,"kb_used_meta":160461,"kb_avail":566054712,"statfs":{"total":579820584960,"available":579640025088,"internally_reserved":0,"allocated":14917632,"data_stored":7619104,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":1231485,"internal_metadata":164312451},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001006"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":619,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:03.397084+0000","last_change":"2026-02-22T21:01:03.397084+0000","last_active":"2026-02-22T21:01:03.397084+0000","last_peered":"2026-02-22T21:01:03.397084+0000","last_clean":"2026-02-22T21:01:03.397084+0000","last_became_active":"2026-02-22T20:52:11.331031+0000","last_became_peered":"2026-02-22T20:52:11.331031+0000","last_unstale":"2026-02-22T21:01:03.397084+0000","last_undegraded":"2026-02-22T21:01:03.397084+0000","last_fullsized":"2026-02-22T21:01:03.397084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:01:03.397023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:01:03.397023+0000","last_clean_scrub_stamp":"2026-02-22T21:01:03.397023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:16:05.038993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049925700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":614,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:00.598889+0000","last_change":"2026-02-22T21:01:00.598889+0000","last_active":"2026-02-22T21:01:00.598889+0000","last_peered":"2026-02-22T21:01:00.598889+0000","last_clean":"2026-02-22T21:01:00.598889+0000","last_became_active":"2026-02-22T20:52:11.208107+0000","last_became_peered":"2026-02-22T20:52:11.208107+0000","last_unstale":"2026-02-22T21:01:00.598889+0000","last_undegraded":"2026-02-22T21:01:00.598889+0000","last_fullsized":"2026-02-22T21:01:00.598889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:01:00.598833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:01:00.598833+0000","last_clean_scrub_stamp":"2026-02-22T21:01:00.598833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:09:41.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034125399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":619,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:02.393242+0000","last_change":"2026-02-22T21:01:02.393242+0000","last_active":"2026-02-22T21:01:02.393242+0000","last_peered":"2026-02-22T21:01:02.393242+0000","last_clean":"2026-02-22T21:01:02.393242+0000","last_became_active":"2026-02-22T20:52:11.330898+0000","last_became_peered":"2026-02-22T20:52:11.330898+0000","last_unstale":"2026-02-22T21:01:02.393242+0000","last_undegraded":"2026-02-22T21:01:02.393242+0000","last_fullsized":"2026-02-22T21:01:02.393242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:01:02.393186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:01:02.393186+0000","last_clean_scrub_stamp":"2026-02-22T21:01:02.393186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:13:21.513346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045400300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":614,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:00:59.590307+0000","last_change":"2026-02-22T21:00:59.590307+0000","last_active":"2026-02-22T21:00:59.590307+0000","last_peered":"2026-02-22T21:00:59.590307+0000","last_clean":"2026-02-22T21:00:59.590307+0000","last_became_active":"2026-02-22T20:52:11.339584+0000","last_became_peered":"2026-02-22T20:52:11.339584+0000","last_unstale":"2026-02-22T21:00:59.590307+0000","last_undegraded":"2026-02-22T21:00:59.590307+0000","last_fullsized":"2026-02-22T21:00:59.590307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:00:59.590257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:00:59.590257+0000","last_clean_scrub_stamp":"2026-02-22T21:00:59.590257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:34:08.758878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386148,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"314'3","reported_seq":606,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:01.208340+0000","last_change":"2026-02-22T21:01:01.208340+0000","last_active":"2026-02-22T21:01:01.208340+0000","last_peered":"2026-02-22T21:01:01.208340+0000","last_clean":"2026-02-22T21:01:01.208340+0000","last_became_active":"2026-02-22T20:52:11.200321+0000","last_became_peered":"2026-02-22T20:52:11.200321+0000","last_unstale":"2026-02-22T21:01:01.208340+0000","last_undegraded":"2026-02-22T21:01:01.208340+0000","last_fullsized":"2026-02-22T21:01:01.208340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'3","last_scrub_stamp":"2026-02-22T21:01:01.208262+0000","last_deep_scrub":"314'3","last_deep_scrub_stamp":"2026-02-22T21:01:01.208262+0000","last_clean_scrub_stamp":"2026-02-22T21:01:01.208262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:29:29.568498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00034762600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":616,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:00.580034+0000","last_change":"2026-02-22T21:01:00.580034+0000","last_active":"2026-02-22T21:01:00.580034+0000","last_peered":"2026-02-22T21:01:00.580034+0000","last_clean":"2026-02-22T21:01:00.580034+0000","last_became_active":"2026-02-22T20:52:11.208111+0000","last_became_peered":"2026-02-22T20:52:11.208111+0000","last_unstale":"2026-02-22T21:01:00.580034+0000","last_undegraded":"2026-02-22T21:01:00.580034+0000","last_fullsized":"2026-02-22T21:01:00.580034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:01:00.579956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:01:00.579956+0000","last_clean_scrub_stamp":"2026-02-22T21:01:00.579956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:00.994757+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.000364488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":619,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:01.387897+0000","last_change":"2026-02-22T21:01:01.387897+0000","last_active":"2026-02-22T21:01:01.387897+0000","last_peered":"2026-02-22T21:01:01.387897+0000","last_clean":"2026-02-22T21:01:01.387897+0000","last_became_active":"2026-02-22T20:52:11.199258+0000","last_became_peered":"2026-02-22T20:52:11.199258+0000","last_unstale":"2026-02-22T21:01:01.387897+0000","last_undegraded":"2026-02-22T21:01:01.387897+0000","last_fullsized":"2026-02-22T21:01:01.387897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:01:01.387844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:01:01.387844+0000","last_clean_scrub_stamp":"2026-02-22T21:01:01.387844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:41:00.086767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058545699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"314'2","reported_seq":605,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:02.246845+0000","last_change":"2026-02-22T21:01:02.246845+0000","last_active":"2026-02-22T21:01:02.246845+0000","last_peered":"2026-02-22T21:01:02.246845+0000","last_clean":"2026-02-22T21:01:02.246845+0000","last_became_active":"2026-02-22T20:52:11.200371+0000","last_became_peered":"2026-02-22T20:52:11.200371+0000","last_unstale":"2026-02-22T21:01:02.246845+0000","last_undegraded":"2026-02-22T21:01:02.246845+0000","last_fullsized":"2026-02-22T21:01:02.246845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'2","last_scrub_stamp":"2026-02-22T21:01:02.246753+0000","last_deep_scrub":"314'2","last_deep_scrub_stamp":"2026-02-22T21:01:02.246753+0000","last_clean_scrub_stamp":"2026-02-22T21:01:02.246753+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:50:24.300553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040841899999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"314'114","reported_seq":756,"reported_epoch":314,"state":"active+clean","last_fresh":"2026-02-22T21:01:00.405169+0000","last_change":"2026-02-22T21:01:00.405169+0000","last_active":"2026-02-22T21:01:00.405169+0000","last_peered":"2026-02-22T21:01:00.405169+0000","last_clean":"2026-02-22T21:01:00.405169+0000","last_became_active":"2026-02-22T20:52:09.632511+0000","last_became_peered":"2026-02-22T20:52:09.632511+0000","last_unstale":"2026-02-22T21:01:00.405169+0000","last_undegraded":"2026-02-22T21:01:00.405169+0000","last_fullsized":"2026-02-22T21:01:00.405169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"314'114","last_scrub_stamp":"2026-02-22T21:01:00.405123+0000","last_deep_scrub":"314'114","last_deep_scrub_stamp":"2026-02-22T21:01:00.405123+0000","last_clean_scrub_stamp":"2026-02-22T21:01:00.405123+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:10.468999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":73070,"data_compressed_allocated":90112,"data_compressed_original":1163264,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640369,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29372,"kb_used_data":2412,"kb_used_omap":196,"kb_used_meta":26747,"kb_avail":94342468,"statfs":{"total":96636764160,"available":96606687232,"internally_reserved":0,"allocated":2469888,"data_stored":1073074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201559,"internal_metadata":27389097},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640368,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":203,"kb_used_meta":26740,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1073055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208068,"internal_metadata":27382588},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640369,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29424,"kb_used_data":2464,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94342416,"statfs":{"total":96636764160,"available":96606633984,"internally_reserved":0,"allocated":2523136,"data_stored":1663423,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":211973,"internal_metadata":27378683},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640368,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1073055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640368,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29372,"kb_used_data":2412,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94342468,"statfs":{"total":96636764160,"available":96606687232,"internally_reserved":0,"allocated":2469888,"data_stored":1073074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209371,"internal_metadata":27381285},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640368,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29424,"kb_used_data":2464,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94342416,"statfs":{"total":96636764160,"available":96606633984,"internally_reserved":0,"allocated":2523136,"data_stored":1663423,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":189841,"internal_metadata":27400815},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":36535,"data_compressed_allocated":45056,"data_compressed_original":581632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:01:20.866 DEBUG:teuthology.orchestra.run.trial007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T21:01:20.926 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: get_monmap_and_config 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: build_initial_monmap 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: monmap: 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T21:01:20.926739+0000 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T21:01:20.926739+0000 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:0: v1:10.20.193.7:6789/0 mon.noname-a-legacy 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:1: v1:10.20.193.61:6789/0 mon.noname-c-legacy 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-b 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:3: v2:10.20.193.7:3300/0 mon.noname-a 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr:4: v2:10.20.193.61:3300/0 mon.noname-c 2026-02-22T21:01:20.927 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 Processor -- start 2026-02-22T21:01:20.928 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 -- start start 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: init 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient: _add_conns ranks=[2,4,0,3,1] 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b008ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-b con 0x7fc1b008e870 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 --2- >> v2:10.20.193.61:3300/0 conn(0x7fc1b013bee0 0x7fc1b013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-c con 0x7fc1b013bee0 addr v2:10.20.193.61:3300/0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1b013c7f0 addr v1:10.20.193.7:6789/0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 -- --> v1:10.20.193.7:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b00869a0 con 0x7fc1b013c7f0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 -- --> v2:10.20.193.61:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b0087c20 con 0x7fc1b013bee0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b008cad0 con 0x7fc1b008e870 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.922+0000 7fc1b85c1640 10 monclient(hunting): authenticate will time out at 1093.399902s 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b008ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 1 --1- >> v1:10.20.193.7:6789/0 conn(0x7fc1b013c7f0 0x7fc1b019d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.7:6789/0 says I am v1:10.20.193.7:46514/0 (socket says 10.20.193.7:46514) 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 1 -- 10.20.193.7:0/2010359713 learned_addr learned my addr 10.20.193.7:0/2010359713 (peer_addr_for_me v1:10.20.193.7:0/0) 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): get_auth_request con 0x7fc1b008e870 auth_method 0 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.929 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 1 --2- 10.20.193.7:0/2010359713 >> v2:10.20.193.61:3300/0 conn(0x7fc1b013bee0 0x7fc1b013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 10 monclient(hunting): get_auth_request con 0x7fc1b013bee0 auth_method 0 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_done global_id 124475 payload 274 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/2010359713 >> v2:10.20.193.61:3300/0 conn(0x7fc1b013bee0 msgr2=0x7fc1b013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- 10.20.193.7:0/2010359713 >> v2:10.20.193.61:3300/0 conn(0x7fc1b013bee0 0x7fc1b013c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/2010359713 >> v1:10.20.193.7:6789/0 conn(0x7fc1b013c7f0 legacy=0x7fc1b019d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient: _finish_hunting 0 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 monclient: found mon.noname-b 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.7:3301/0 2026-02-22T21:01:20.930 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/2010359713 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b008b550 con 0x7fc1b008e870 2026-02-22T21:01:20.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- 10.20.193.7:0/2010359713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b008ec40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0004780 tx=0x7fc1a001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef07c9b014792432 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 1 -- 10.20.193.7:0/2010359713 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00b0070 con 0x7fc1b008e870 2026-02-22T21:01:20.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-22T21:01:20.933 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: dump: 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: _finish_auth 0 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: _check_auth_tickets 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 1 -- 10.20.193.7:0/2010359713 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00ab600 con 0x7fc1b008e870 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 1 -- 10.20.193.7:0/2010359713 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00ab9d0 con 0x7fc1b008e870 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5334640 10 monclient: dump: 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.934 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 5 monclient: authenticate success, global_id 124475 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: get_monmap_and_config success 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 4 set_mon_vals no callback set 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: shutdown 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/2010359713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 msgr2=0x7fc1b008ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/2010359713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b008ec40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0004780 tx=0x7fc1a001c3e0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/2010359713 shutdown_connections 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/2010359713 >> v2:10.20.193.61:3300/0 conn(0x7fc1b013bee0 0x7fc1b013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/2010359713 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b008ec40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/2010359713 >> 10.20.193.7:0/2010359713 conn(0x7fc1b008faa0 msgr2=0x7fc1b008bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/2010359713 shutdown_connections 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/2010359713 wait complete. 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: build_initial_monmap 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: monmap: 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:epoch 0 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 0.000000 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:created 0.000000 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 0 (unknown) 2026-02-22T21:01:20.935 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.noname-a 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.noname-b 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.noname-c 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 Processor -- start 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- start start 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: init 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _reopen_session rank -1 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-c con 0x7fc1b008e870 addr [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc1b013bee0 0x7fc1b014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-b con 0x7fc1b013bee0 addr [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 --2- >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 0x7fc1b01267c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): picked mon.noname-a con 0x7fc1b013c7f0 addr [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- --> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b008f180 con 0x7fc1b013c7f0 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- --> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b008bb50 con 0x7fc1b013bee0 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): start opening mon connection 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b008f300 con 0x7fc1b008e870 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): _renew_subs 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient(hunting): authenticate will time out at 1093.403289s 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.936 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.7:3301/0 says I am v2:10.20.193.7:41586/0 (socket says 10.20.193.7:41586) 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/1293637399 learned_addr learned my addr 10.20.193.7:0/1293637399 (peer_addr_for_me v2:10.20.193.7:0/0) 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): get_auth_request con 0x7fc1b008e870 auth_method 0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 0x7fc1b01267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 10 monclient(hunting): get_auth_request con 0x7fc1b013c7f0 auth_method 0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 10 monclient(hunting): _init_auth method 2 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 10 monclient(hunting): _init_auth creating new auth 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient(hunting): handle_auth_done global_id 124478 payload 824 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b5b35640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc1b013bee0 0x7fc1b014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/1293637399 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc1b013bee0 msgr2=0x7fc1b014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc1b013bee0 0x7fc1b014c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 msgr2=0x7fc1b01267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 0x7fc1b01267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient: _finish_hunting 0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 monclient: found mon.noname-c 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.7:3301/0 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 -- 10.20.193.7:0/1293637399 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b0128230 con 0x7fc1b008e870 2026-02-22T21:01:20.937 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6b37640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 0x7fc1b01267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b6336640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1a001c420 tx=0x7fc1a00191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00b0040 con 0x7fc1b008e870 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: dump: 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: _finish_auth 0 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: _check_auth_tickets 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00b9070 con 0x7fc1b008e870 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: handle_config config(0 keys) 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00ab9b0 con 0x7fc1b008e870 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b4b33640 4 set_mon_vals no callback set 2026-02-22T21:01:20.938 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc196ffd640 10 monclient: dump: 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:epoch 1 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:fsid ec79d088-5ee7-4a8c-8cac-a194b076cc72 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:last_changed 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:created 2026-02-22T20:51:48.190293+0000 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:min_mon_release 20 (tentacle) 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:election_strategy: 1 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:0: [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] mon.a 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:1: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.b 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2: [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] mon.c 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 5 monclient: authenticate success, global_id 124478 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _renew_subs 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b0129cf0 con 0x7fc1b008e870 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _renew_subs 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.926+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b0139b50 con 0x7fc1b008e870 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b85c1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b85c1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b85c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b008ec40 con 0x7fc1b008e870 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 4 ==== mgrmap(e 5) ==== 48730+0+0 (secure 0 0 0) 0x7fc1a00b3070 con 0x7fc1b008e870 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc196ffd640 1 --2- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 0x7fc18005afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-22T21:01:20.939 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 5 ==== osd_map(314..314 src has 64..314) ==== 3503+0+0 (secure 0 0 0) 0x7fc1a00e81b0 con 0x7fc1b008e870 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b5b35640 1 --2- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 0x7fc18005afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b5b35640 10 monclient: get_auth_request con 0x7fc18003ab20 auth_method 0 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.930+0000 7fc1b5b35640 1 --2- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 0x7fc18005afd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc1b005c950 tx=0x7fc1a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.934+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199690 (secure 0 0 0) 0x7fc1a0016150 con 0x7fc1b008e870 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.934+0000 7fc196ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-22T21:01:20.940 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:20.934+0000 7fc196ffd640 10 monclient: _finish_command 1 = system:0 2026-02-22T21:01:21.017 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.014+0000 7fc1b85c1640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T21:01:21.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.014+0000 7fc1b85c1640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T21:01:21.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.014+0000 7fc1b85c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.7:3301/0 2026-02-22T21:01:21.018 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.014+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 --> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc1b0129ec0 con 0x7fc1b008e870 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1a0009440 con 0x7fc1b008e870 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc196ffd640 10 monclient: handle_config config(1 keys) 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b4b33640 4 set_mon_vals no callback set 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b4b33640 10 set_mon_vals mon_health_to_clog = false 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc196ffd640 1 -- 10.20.193.7:0/1293637399 <== mon.2 v2:10.20.193.7:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (secure 0 0 0) 0x7fc1a00c3200 con 0x7fc1b008e870 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc196ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-22T21:01:21.021 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc196ffd640 10 monclient: _finish_command 2 = system:0 2026-02-22T21:01:21.022 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option warn_recent_interval = 1209600 2026-02-22T21:01:21.023 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 msgr2=0x7fc18005afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 0x7fc18005afd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc1b005c950 tx=0x7fc1a4008040 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 10 monclient: shutdown 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 msgr2=0x7fc1b014c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1a001c420 tx=0x7fc1a00191e0 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 shutdown_connections 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3300/0,v1:10.20.193.7:6789/0] conn(0x7fc1b013c7f0 0x7fc1b01267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> v2:10.20.193.61:6800/2336688312 conn(0x7fc18003ab20 0x7fc18005afd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] conn(0x7fc1b013bee0 0x7fc1b014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 --2- 10.20.193.7:0/1293637399 >> [v2:10.20.193.7:3301/0,v1:10.20.193.7:6790/0] conn(0x7fc1b008e870 0x7fc1b014c2d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-22T21:01:21.024 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 >> 10.20.193.7:0/1293637399 conn(0x7fc1b008faa0 msgr2=0x7fc1b0057500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-22T21:01:21.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 shutdown_connections 2026-02-22T21:01:21.025 INFO:teuthology.orchestra.run.trial007.stderr:2026-02-22T21:01:21.018+0000 7fc1b85c1640 1 -- 10.20.193.7:0/1293637399 wait complete. 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: max_completed_events = 50 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enable_monitoring = True 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option max_concurrent_clones = 4 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: url = https://telemetry.ceph.com/report 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option retain_interval = 31536000 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 5 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_target_pg_per_osd = 100 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: scrape_frequency = 86400 2026-02-22T21:01:21.033 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: device_url = https://telemetry.ceph.com/device 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_delay = 0 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = True 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: native option mon_max_pg_per_osd = 10000 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: pool_name = device_health_metrics 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: enabled = False 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option periodic_async_work = False 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: allow_pg_recovery_event = False 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sleep_interval = 60 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: retention_period = 15552000 2026-02-22T21:01:21.034 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: last_opt_revision = 1 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option snapshot_clone_no_wait = True 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option threshold = 3.0 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mark_out_threshold = 2419200 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard = False 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_purging = False 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.035 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: warn_threshold = 7257600 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: leaderboard_description = None 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: self_heal = True 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: description = None 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option pause_cloning = False 2026-02-22T21:01:21.036 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sleep_interval = 600 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: contact = None 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:resume() no need to resume, run_event is already set. 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:volumes.fs.async_job:processing 0 volume entries 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: organization = None 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_level = 2026-02-22T21:01:21.037 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: proxy = None 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_file = False 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: interval = 24 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_basic = True 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_ident = False 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option sqlite3_killpoint = 0 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_crash = True 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster = False 2026-02-22T21:01:21.038 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_device = True 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: channel_perf = False 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_level = 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_file = False 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: sqlite3_killpoint = 0 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster = False 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: log_to_cluster_level = info 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root:Not sending report until user re-opts-in 2026-02-22T21:01:21.039 INFO:tasks.ceph.mgr.x.trial061.stderr:DEBUG:root: mgr option log_to_cluster_level = info 2026-02-22T21:01:21.040 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T21:01:21.040 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T21:01:21.040 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T21:01:21.040 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.126 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T21:01:21.126 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T21:01:21.126 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.219 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T21:01:21.219 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T21:01:21.219 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.299 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T21:01:21.299 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T21:01:21.299 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.385 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T21:01:21.386 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-22T21:01:21.386 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.474 INFO:tasks.ceph.osd.4:Stopped 2026-02-22T21:01:21.475 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-22T21:01:21.475 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.566 INFO:tasks.ceph.osd.5:Stopped 2026-02-22T21:01:21.566 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T21:01:21.566 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T21:01:21.566 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.583 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T21:01:21.583 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T21:01:21.583 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T21:01:21.583 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.597 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T21:01:21.597 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T21:01:21.598 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.653 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T21:01:21.653 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T21:01:21.653 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:01:21.667 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T21:01:21.668 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T21:01:21.668 DEBUG:teuthology.orchestra.run.trial007:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'slow request' | grep -E -v 'overall HEALTH_' | head -n 1 2026-02-22T21:01:21.705 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T21:01:21.705 DEBUG:teuthology.orchestra.run.trial007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T21:01:21.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T21:01:21.760 DEBUG:teuthology.orchestra.run.trial007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T21:01:21.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial007.front.sepia.ceph.com 2026-02-22T21:01:21.820 DEBUG:teuthology.orchestra.run.trial007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T21:01:21.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T21:01:21.878 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T21:01:21.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T21:01:21.895 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-22T21:01:21.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T21:01:21.952 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-22T21:01:22.009 INFO:tasks.ceph:Archiving mon data... 2026-02-22T21:01:22.012 DEBUG:teuthology.misc:Transferring archived files from trial007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/data/mon.a.tgz 2026-02-22T21:01:22.013 DEBUG:teuthology.orchestra.run.trial007:> mktemp 2026-02-22T21:01:22.018 INFO:teuthology.orchestra.run.trial007.stdout:/tmp/tmp.nD3BLv2mIr 2026-02-22T21:01:22.019 DEBUG:teuthology.orchestra.run.trial007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nD3BLv2mIr 2026-02-22T21:01:22.118 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod 0666 /tmp/tmp.nD3BLv2mIr 2026-02-22T21:01:22.174 DEBUG:teuthology.orchestra.remote:trial007:/tmp/tmp.nD3BLv2mIr is 429KB 2026-02-22T21:01:22.233 DEBUG:teuthology.orchestra.run.trial007:> rm -fr /tmp/tmp.nD3BLv2mIr 2026-02-22T21:01:22.238 DEBUG:teuthology.misc:Transferring archived files from trial007:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/data/mon.c.tgz 2026-02-22T21:01:22.238 DEBUG:teuthology.orchestra.run.trial007:> mktemp 2026-02-22T21:01:22.287 INFO:teuthology.orchestra.run.trial007.stdout:/tmp/tmp.ucUgc3lgpn 2026-02-22T21:01:22.287 DEBUG:teuthology.orchestra.run.trial007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ucUgc3lgpn 2026-02-22T21:01:22.386 DEBUG:teuthology.orchestra.run.trial007:> sudo chmod 0666 /tmp/tmp.ucUgc3lgpn 2026-02-22T21:01:22.442 DEBUG:teuthology.orchestra.remote:trial007:/tmp/tmp.ucUgc3lgpn is 430KB 2026-02-22T21:01:22.501 DEBUG:teuthology.orchestra.run.trial007:> rm -fr /tmp/tmp.ucUgc3lgpn 2026-02-22T21:01:22.506 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/data/mon.b.tgz 2026-02-22T21:01:22.506 DEBUG:teuthology.orchestra.run.trial061:> mktemp 2026-02-22T21:01:22.511 INFO:teuthology.orchestra.run.trial061.stdout:/tmp/tmp.86shyJr4zQ 2026-02-22T21:01:22.512 DEBUG:teuthology.orchestra.run.trial061:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.86shyJr4zQ 2026-02-22T21:01:22.615 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0666 /tmp/tmp.86shyJr4zQ 2026-02-22T21:01:22.672 DEBUG:teuthology.orchestra.remote:trial061:/tmp/tmp.86shyJr4zQ is 430KB 2026-02-22T21:01:22.763 DEBUG:teuthology.orchestra.run.trial061:> rm -fr /tmp/tmp.86shyJr4zQ 2026-02-22T21:01:22.768 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T21:01:22.768 DEBUG:teuthology.orchestra.run.trial007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T21:01:22.770 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T21:01:22.823 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T21:01:22.866 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T21:01:22.866 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T21:01:22.868 DEBUG:teuthology.misc:Transferring archived files from trial007:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial007/crash 2026-02-22T21:01:22.869 DEBUG:teuthology.orchestra.run.trial007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T21:01:22.878 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial061/crash 2026-02-22T21:01:22.880 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T21:01:22.913 INFO:tasks.ceph:Compressing logs... 2026-02-22T21:01:22.914 DEBUG:teuthology.orchestra.run.trial007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:01:22.924 DEBUG:teuthology.orchestra.run.trial061:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:01:22.931 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20313.log 2026-02-22T21:01:22.932 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15712.log 2026-02-22T21:01:22.932 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23730.log 2026-02-22T21:01:22.932 INFO:teuthology.orchestra.run.trial007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20313.log.gz 2026-02-22T21:01:22.932 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18596.log 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.15712.log: /var/log/ceph/ceph-client.admin.23730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23652.log 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23730.log.gz 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20823.log 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.15712.log.gz 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18596.log.gz 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24657.log 2026-02-22T21:01:22.933 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21867.log 2026-02-22T21:01:22.934 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20823.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.23652.log.gz 2026-02-22T21:01:22.934 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21205.log 2026-02-22T21:01:22.934 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24657.log.gz 2026-02-22T21:01:22.934 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.20823.log.gz 2026-02-22T21:01:22.934 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21023.log 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22103.log 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.21867.log.gz 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21205.log: /var/log/ceph/ceph-client.admin.21023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20341.log 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22103.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.21205.log.gz 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21023.log.gz 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18909.log 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22103.log.gz 2026-02-22T21:01:22.935 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21893.log 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20341.log: /var/log/ceph/ceph-client.admin.18909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22961.log 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18909.log.gz 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24371.log 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.20341.log.gz 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22961.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.20395.log -- replaced with /var/log/ceph/ceph-client.admin.21893.log.gz 2026-02-22T21:01:22.936 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23117.log 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24371.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.22961.log.gz 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22354.log 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23117.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.20395.log.gz 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23808.log 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24371.log.gz 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22354.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.23117.log.gz 2026-02-22T21:01:22.937 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19464.log 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22354.log.gz 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21640.log 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23808.log: /var/log/ceph/ceph-client.admin.19464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19046.log 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19464.log.gz 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18392.log 2026-02-22T21:01:22.938 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21640.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.23808.log.gz 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr:gzip/var/log/ceph/ceph-client.admin.19046.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24527.log 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18392.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21640.log.gz 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19876.log 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19046.log.gz 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.18392.log.gz 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23492.log 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24527.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.24527.log.gz 2026-02-22T21:01:22.939 INFO:teuthology.orchestra.run.trial007.stderr: /var/log/ceph/ceph-client.admin.21127.log 2026-02-22T21:01:22.940 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19876.log: /var/log/ceph/ceph-client.admin.23492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22754.log 2026-02-22T21:01:22.940 INFO:teuthology.orchestra.run.trial007.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.19876.log.gz 2026-02-22T21:01:22.940 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18753.log 2026-02-22T21:01:22.940 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.23492.log.gz 2026-02-22T21:01:22.940 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21127.log: /var/log/ceph/ceph-client.admin.22754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19902.log 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18753.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21127.log.gz 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20506.log 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22754.log.gz 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19902.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18753.log.gz 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21309.log 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24397.log 2026-02-22T21:01:22.941 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.19902.log.gz 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19718.log 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.20506.log.gz 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19202.log 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21309.log.gz 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24397.log: /var/log/ceph/ceph-client.admin.19718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21562.log 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24397.log.gz 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19718.log.gz 2026-02-22T21:01:22.942 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18593.log 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19202.log: /var/log/ceph/ceph-client.admin.21562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21430.log 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18593.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.21562.log.gz 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.19202.log.gz 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18906.log 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.18593.log.gz 2026-02-22T21:01:22.943 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24735.log 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21508.log 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21430.log.gz 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18906.log.gz 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21693.log 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22025.log 2026-02-22T21:01:22.944 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21508.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24735.log.gz 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21999.log 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21508.log.gz 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24189.log 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.21693.log.gz 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23860.log 2026-02-22T21:01:22.945 INFO:teuthology.orchestra.run.trial007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22025.log.gz 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19228.log 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.21999.log.gz 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22834.log 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.24189.log.gz 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18552.log 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.23860.log.gz 2026-02-22T21:01:22.946 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24683.log 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19228.log.gz 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.22834.log.gz 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20006.log 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20740.log 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24683.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18552.log.gz 2026-02-22T21:01:22.947 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20889.log 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24683.log.gz 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20740.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.20006.log.gz 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20584.log 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20034.log 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20740.log.gz 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23169.log 2026-02-22T21:01:22.948 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20889.log.gz 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20584.log.gz 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20207.log 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20034.log.gz 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21921.log 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23169.log: /var/log/ceph/ceph-client.admin.20207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22051.log 2026-02-22T21:01:22.949 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20207.log.gz 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.23169.log.gz 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr:gzip/var/log/ceph/ceph-client.admin.21921.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.20636.log 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23197.log 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22051.log.gz 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21921.log.gz 2026-02-22T21:01:22.950 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20849.log 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15736.log 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20636.log.gz 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.23197.log.gz 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20129.log 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.15736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20103.log 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20849.log.gz 2026-02-22T21:01:22.951 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24423.log 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20129.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15736.log.gz 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15934.log 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23091.log 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20129.log.gz 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.20103.log.gz 2026-02-22T21:01:22.952 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.15934.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.24423.log.gz --verbose 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr: -- /var/log/ceph/ceph-client.admin.21049.log 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.23091.log: -- /var/log/ceph/ceph-client.admin.24163.log 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.15934.log.gz 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21049.log.gz 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.23091.log.gz 2026-02-22T21:01:22.953 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18500.log 2026-02-22T21:01:22.954 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23574.log 2026-02-22T21:01:22.954 INFO:teuthology.orchestra.run.trial007.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.24163.log.gz 2026-02-22T21:01:22.954 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21338.log 2026-02-22T21:01:22.954 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18500.log.gz 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18907.log 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21153.log 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18907.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.23574.log.gz 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21283.log 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.21338.log.gz 2026-02-22T21:01:22.955 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18907.log.gz 2026-02-22T21:01:22.956 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19568.log 2026-02-22T21:01:22.956 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20181.log 2026-02-22T21:01:22.956 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21153.log.gz 2026-02-22T21:01:22.956 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.21283.log.gz 2026-02-22T21:01:22.956 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24709.log 2026-02-22T21:01:22.957 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24006.log 2026-02-22T21:01:22.957 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19568.log.gz 2026-02-22T21:01:22.957 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24709.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20181.log.gz 2026-02-22T21:01:22.957 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22933.log 2026-02-22T21:01:22.957 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19688.log 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24709.log.gz 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21101.log 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24006.log.gz 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19688.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.22933.log.gz 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24345.log 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19438.log 2026-02-22T21:01:22.958 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21101.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19688.log.gz 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19490.log 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21101.log.gz 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24345.log.gz 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18597.log 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.19438.log.gz 2026-02-22T21:01:22.959 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19770.log 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24215.log 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18597.log: /var/log/ceph/ceph-client.admin.19770.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.19490.log.gz 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21179.log 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.19770.log.gz 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18597.log.gz 2026-02-22T21:01:22.960 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21841.log 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24215.log: /var/log/ceph/ceph-client.admin.21179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24241.log 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21841.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21179.log.gz 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23889.log 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.24215.log.gz 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.21841.log.gz 2026-02-22T21:01:22.961 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22077.log 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24241.log: /var/log/ceph/ceph-client.admin.23889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20287.log 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23889.log.gz 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24241.log.gz 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24553.log 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18832.log 2026-02-22T21:01:22.962 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20369.log 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19972.log 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18595.log 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.22077.log.gz 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20369.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.20287.log.gz 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24553.log.gz 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19516.log 2026-02-22T21:01:22.963 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18595.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.20369.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19744.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22991.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.18832.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21617.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19972.log: /var/log/ceph/ceph-client.admin.22991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19390.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22991.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20916.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19972.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19516.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18595.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24475.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.19516.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20919.log 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.19744.log.gz 2026-02-22T21:01:22.964 INFO:teuthology.orchestra.run.trial007.stderr:gzip/var/log/ceph/ceph-client.admin.24475.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.20769.log 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23143.log 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24475.log.gz 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.20919.log.gz 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19139.log 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19390.log: /var/log/ceph/ceph-client.admin.20916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21867.log 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20916.log.gz 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19534.log 2026-02-22T21:01:22.965 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21617.log.gz 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21867.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19390.log.gz 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23029.log 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.19139.log.gz 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21039.log 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.20769.log.gz 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23834.log 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19061.log 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23143.log: /var/log/ceph/ceph-client.admin.23834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20478.log 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.23143.log.gz 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23249.log 89.8% 2026-02-22T21:01:22.966 INFO:teuthology.orchestra.run.trial007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23834.log.gz 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20478.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19061.log.gz 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22380.log 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20407.log 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.19534.log.gz 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21867.log.gz 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21955.log 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21039.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.23029.log.gz 2026-02-22T21:01:22.967 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22574.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21868.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21955.log: /var/log/ceph/ceph-client.admin.22574.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21039.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20407.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.22574.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18780.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21955.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21868.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19973.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23249.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20478.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19384.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.23249.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5/var/log/ceph/ceph-client.admin.22380.log: --verbose -- /var/log/ceph/ceph-client.admin.21789.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23678.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.19384.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21789.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22380.log.gz 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22268.log 2026-02-22T21:01:22.968 INFO:teuthology.orchestra.run.trial007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.21789.log.gz 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23756.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18594.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.23678.log.gz 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23756.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.22268.log.gz 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18752.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18780.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.21868.log.gz 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20770.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22095.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.18780.log.gz 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18995.log 2026-02-22T21:01:22.969 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19973.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20770.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22270.log 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.22095.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19708.log 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18995.log: /var/log/ceph/ceph-client.admin.22270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19049.log 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18594.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23756.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20795.log 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18752.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18594.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21075.log 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18752.log.gz 2026-02-22T21:01:22.970 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24267.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23954.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.21075.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.20795.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18750.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.22270.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22096.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18605.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18995.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.19049.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19085.log 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.19708.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18605.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.22096.log.gz 2026-02-22T21:01:22.971 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21652.log 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18605.log.gz 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21214.log 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19085.log.gz 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20409.log 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21354.log 2026-02-22T21:01:22.972 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21214.log: /var/log/ceph/ceph-client.admin.20409.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.21652.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19062.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24267.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18908.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.23954.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19062.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18750.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20235.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19062.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22702.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18908.log: /var/log/ceph/ceph-client.admin.20235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23626.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.20235.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18908.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20997.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22702.log.gz 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20610.log 2026-02-22T21:01:22.973 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23626.log: /var/log/ceph/ceph-client.admin.20997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24501.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.21214.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20590.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22482.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.20409.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22183.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20590.log: /var/log/ceph/ceph-client.admin.22482.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21354.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22044.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20590.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.22482.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20825.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21040.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.22183.log.gz 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19709.log 2026-02-22T21:01:22.974 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.22044.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.20997.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23626.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21973.log 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: 88.5%/var/log/ceph/ceph-client.admin.24501.log: -- replaced with /var/log/ceph/ceph-client.admin.20610.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21614.log 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21973.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.24501.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21257.log 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22650.log/var/log/ceph/ceph-client.admin.21614.log: 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21257.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21973.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15777.log 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21614.log.gz 89.2% 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21257.log.gz 2026-02-22T21:01:22.975 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22650.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19262.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20825.log.gz 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22130.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21040.log.gz 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19262.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.19709.log.gz 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19656.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18866.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.22130.log.gz 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.19262.log.gz 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21127.log 2026-02-22T21:01:22.976 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.22650.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.15777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18425.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15777.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23396.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18425.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24605.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21956.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.19656.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22754.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.18866.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20954.log 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.21127.log.gz 2026-02-22T21:01:22.977 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22754.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21956.log.gz 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20226.log 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23704.log 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23396.log: /var/log/ceph/ceph-client.admin.24605.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20688.log 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24605.log.gz 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.23396.log.gz 2026-02-22T21:01:22.978 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23463.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21667.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23463.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.23704.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial007.stderr:gzip 89.7% -- replaced with /var/log/ceph/ceph-client.admin.20688.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial007.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.23463.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18744.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20954.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.22754.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20733.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20226.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18744.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.20954.log.gz 2026-02-22T21:01:22.979 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22756.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22009.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18744.log.gz 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20733.log.gz 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20591.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22239.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22900.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22239.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.21667.log.gz 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19332.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19060.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22900.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22239.log.gz 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19850.log 2026-02-22T21:01:22.980 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22900.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.19332.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22304.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22009.log: /var/log/ceph/ceph-client.admin.20591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19886.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.22756.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.22009.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.20591.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22483.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22481.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.22304.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22627.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22987.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23329.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19850.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19060.log.gz 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22987.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T21:01:22.981 INFO:teuthology.orchestra.run.trial007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19850.log.gz 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.22987.log.gz 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.23329.log: -- /var/log/ceph/ceph-client.admin.24579.log 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22483.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.19886.log.gz 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19391.log 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22627.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22481.log.gz 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21922.log 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.22483.log.gz 2026-02-22T21:01:22.982 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19391.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21922.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22627.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19391.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22008.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23039.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.23329.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19928.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21719.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24579.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.23039.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23782.log 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21922.log.gz 2026-02-22T21:01:22.983 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20006.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.22008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18658.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18745.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18658.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22008.log.gz 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20189.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18658.log.gz 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19824.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21719.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.19928.log.gz 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24449.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.21719.log.gz 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23223.log 2026-02-22T21:01:22.984 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19824.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23782.log.gz 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22676.log 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19824.log.gz 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24449.log.gz 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19980.log 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20317.log 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20006.log.gz 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20189.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.18745.log.gz --verbose 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr: -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19621.log 2026-02-22T21:01:22.985 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20317.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22938.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20189.log.gz 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20317.log.gz 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19313.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19621.log: /var/log/ceph/ceph-client.admin.22938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21266.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22676.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23223.log.gz 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20945.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21482.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.22676.log.gz 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23301.log 2026-02-22T21:01:22.986 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19980.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22624.log 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21482.log: /var/log/ceph/ceph-client.admin.23301.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.20945.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18751.log 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.23301.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21482.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19621.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19313.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.22938.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21921.log 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18657.log 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21266.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19313.log.gz 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18570.log 2026-02-22T21:01:22.987 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21213.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18657.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21266.log.gz 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial061.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.21921.log.gz 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21530.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22182.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20971.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18890.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18751.log: 88.5%/var/log/ceph/ceph-client.admin.20971.log: -- replaced with /var/log/ceph/ceph-client.admin.22624.log.gz 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24084.log 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.20971.log.gz 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.18751.log.gz 2026-02-22T21:01:22.988 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22172.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24084.log: /var/log/ceph/ceph-client.admin.22172.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.18890.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19655.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.18657.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21213.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15732.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21530.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.18570.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21092.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.22182.log.gz 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22937.log 2026-02-22T21:01:22.989 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19655.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.15732.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21389.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22937.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21092.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20281.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22445.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24084.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22172.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18749.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20558.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22780.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18749.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24759.log 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.18749.log.gz 2026-02-22T21:01:22.990 INFO:teuthology.orchestra.run.trial007.stderr:gzip/var/log/ceph/ceph-client.admin.20558.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.19254.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20662.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.20558.log.gz 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19254.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24759.log.gz 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21231.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21389.log: /var/log/ceph/ceph-client.admin.20281.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.22937.log.gz -5 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr: --verbose -- /var/log/ceph/ceph-client.admin.18961.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18691.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.21389.log.gz 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20281.log.gz 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22572.log 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.22445.log.gz 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18691.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.18961.log.gz --verbose 2026-02-22T21:01:22.991 INFO:teuthology.orchestra.run.trial061.stderr: -- /var/log/ceph/ceph-client.admin.19921.log 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18604.log 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.18691.log.gz 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19058.log 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19254.log.gz 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.20662.log.gz 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23355.log 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18996.log 2026-02-22T21:01:22.992 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19921.log: /var/log/ceph/ceph-client.admin.18604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15953.log 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22129.log 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.21231.log.gz 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18526.log 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.19058.log.gz 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22728.log 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22129.log.gz 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18526.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.23355.log.gz 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24110.log 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22728.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18526.log.gz 2026-02-22T21:01:22.993 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22572.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18996.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.18604.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21479.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.19921.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22719.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15953.log: /var/log/ceph/ceph-client.admin.21479.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.18996.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23027.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15953.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.21479.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20860.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22356.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22719.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20714.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22728.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18598.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24110.log: /var/log/ceph/ceph-client.admin.20714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22296.log 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24110.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.20714.log.gz 2026-02-22T21:01:22.994 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21456.log 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18598.log: /var/log/ceph/ceph-client.admin.22296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20261.log 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21456.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22296.log.gz 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.18598.log.gz 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11984.log 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial007.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.21456.log.gz 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19654.log 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21791.log 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20860.log.gz 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.23027.log.gz 2026-02-22T21:01:22.995 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19568.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18911.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph.tmp-client.admin.11984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23065.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial007.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11984.log.gz 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.20261.log.gz 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20532.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22216.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.22356.log.gz 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21477.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19654.log.gz 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19568.log.gz 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19314.log 2026-02-22T21:01:22.996 INFO:teuthology.orchestra.run.trial061.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21791.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20408.log 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21477.log: /var/log/ceph/ceph-client.admin.19314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19482.log 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19314.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.22216.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18911.log: /var/log/ceph/ceph-client.admin.23065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21588.log 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23065.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20532.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18911.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21534.log 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20532.log.gz 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19620.log 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22806.log 90.0% 2026-02-22T21:01:22.997 INFO:teuthology.orchestra.run.trial007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21588.log.gz 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19620.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.21534.log.gz 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21403.log 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19392.log 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21477.log.gz 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19482.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20408.log.gz 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20553.log 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.19482.log.gz 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15756.log 2026-02-22T21:01:22.998 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19392.log: /var/log/ceph/ceph-client.admin.20553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19175.log 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22042.log 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15756.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.19392.log.gz 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20553.log.gz/var/log/ceph/ceph-client.admin.19175.log: 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22806.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19620.log.gz 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23518.log 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-osd.0.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21403.log.gz 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.22806.log.gz 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19796.log 2026-02-22T21:01:22.999 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18754.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23518.log: /var/log/ceph/ceph-client.admin.19796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20155.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18754.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.19796.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.23518.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23544.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18754.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21815.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18831.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.15756.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21005.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.19175.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21179.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22042.log.gz 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21618.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22663.log 2026-02-22T21:01:23.000 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21618.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.18831.log.gz 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21005.log.gz 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19048.log 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.21618.log.gz 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21564.log 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.21179.log.gz 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24631.log 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.20155.log.gz 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24058.log 2026-02-22T21:01:23.001 INFO:teuthology.orchestra.run.trial007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.23544.log.gz 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18454.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.21815.log.gz 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24293.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24631.log.gz 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19594.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24058.log.gz 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21947.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19833.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20135.log 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.22663.log.gz 2026-02-22T21:01:23.002 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21564.log.gz 2026-02-22T21:01:23.003 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19833.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19048.log.gz 2026-02-22T21:01:23.003 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20318.log 2026-02-22T21:01:23.003 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21093.log 2026-02-22T21:01:23.003 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19833.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20316.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21093.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.20318.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22390.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.20135.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20316.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21093.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19226.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19140.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24293.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.18454.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19410.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.21947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18474.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.19594.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19410.log: gzip 89.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.21947.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: -- /var/log/ceph/ceph-client.admin.24032.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.18474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19542.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19410.log.gz 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr:gzip/var/log/ceph/ceph-client.admin.24032.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23980.log 2026-02-22T21:01:23.004 INFO:teuthology.orchestra.run.trial007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.18474.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19358.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24032.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19542.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19086.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22390.log: /var/log/ceph/ceph-client.admin.19226.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.20316.log.gz /var/log/ceph/ceph-client.admin.22131.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18693.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19226.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22390.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.22131.log: -- /var/log/ceph/ceph-client.admin.21565.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18693.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19140.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21301.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20769.log 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr: 90.4%/var/log/ceph/ceph-client.admin.21565.log: -- replaced with /var/log/ceph/ceph-client.admin.18693.log.gz 2026-02-22T21:01:23.005 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.22131.log.gz 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21704.log 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.21565.log.gz 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.21301.log.gz 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20498.log 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21128.log 2026-02-22T21:01:23.006 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20769.log.gz 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19358.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.23980.log.gz 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20060.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19358.log.gz 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24319.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19086.log.gz 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.20060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24137.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19306.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20060.log.gz 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.24137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19954.log 2026-02-22T21:01:23.007 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24319.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20642.log 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20498.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21704.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19567.log 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20642.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.21128.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19798.log 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22992.log 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19798.log: 89.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20498.log.gz -- replaced with /var/log/ceph/ceph-client.admin.20642.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19567.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21006.log 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19798.log.gz 2026-02-22T21:01:23.008 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22846.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19306.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24137.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22322.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19306.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19646.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23013.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19954.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23600.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19646.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.22322.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19280.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19261.log 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22992.log.gz 2026-02-22T21:01:23.009 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22847.log 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22846.log: /var/log/ceph/ceph-client.admin.19261.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.21006.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22845.log 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.19261.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.22846.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20643.log 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.22847.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19832.log 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.23600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22860.log 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.23013.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.19280.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.23600.log.gz 2026-02-22T21:01:23.010 INFO:teuthology.orchestra.run.trial007.stderr:/var/log/ceph/ceph-client.admin.22860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19280.log.gz 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21388.log 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21653.log 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22860.log.gz 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.22845.log.gz 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20643.log.gz 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21566.log 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22901.log 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19832.log.gz 2026-02-22T21:01:23.011 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21388.log.gz 2026-02-22T21:01:23.012 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20137.log 2026-02-22T21:01:23.012 INFO:teuthology.orchestra.run.trial061.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.21653.log.gz 2026-02-22T21:01:23.012 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21738.log 2026-02-22T21:01:23.012 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.21566.log.gz 2026-02-22T21:01:23.012 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19173.log 2026-02-22T21:01:23.013 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22901.log.gz 2026-02-22T21:01:23.013 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19919.log 2026-02-22T21:01:23.013 INFO:teuthology.orchestra.run.trial061.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.20137.log.gz 2026-02-22T21:01:23.013 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18692.log 2026-02-22T21:01:23.013 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19919.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21738.log.gz 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22664.log 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21957.log 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.19919.log.gz 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19173.log.gz 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22664.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18692.log.gz 2026-02-22T21:01:23.014 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19480.log 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22664.log.gz 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21300.log 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19480.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21300.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.21957.log.gz 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22269.log 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19480.log.gz 2026-02-22T21:01:23.015 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21739.log 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.22269.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21300.log.gz 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20861.log 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20589.log 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22269.log.gz 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.21739.log.gz 2026-02-22T21:01:23.016 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19446.log 2026-02-22T21:01:23.017 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T21:01:23.017 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21126.log 2026-02-22T21:01:23.017 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20861.log.gz 2026-02-22T21:01:23.017 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20734.log 2026-02-22T21:01:23.017 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21126.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.19446.log.gz 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22900.log 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20734.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.20589.log.gz 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19885.log 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21126.log.gz 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22900.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.18571.log 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr: -- replaced with /var/log/ceph/ceph-client.admin.20734.log.gz 2026-02-22T21:01:23.018 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19084.log 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20771.log 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19084.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22900.log.gz 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.18571.log.gz 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20225.log 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19885.log.gz 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19084.log.gz 2026-02-22T21:01:23.019 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20771.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T21:01:23.020 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21267.log 2026-02-22T21:01:23.020 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19533.log 2026-02-22T21:01:23.020 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20771.log.gz 2026-02-22T21:01:23.020 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21041.log 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19533.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20225.log.gz 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19174.log 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21267.log.gz 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.19533.log.gz 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20500.log 2026-02-22T21:01:23.021 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22444.log 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20500.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.21041.log.gz 88.0% 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr: -- replaced with /var/log/ceph/ceph-client.admin.19174.log.gz 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21444.log 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22444.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.20500.log.gz 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19745.log 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21444.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-22T21:01:23.022 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22444.log.gz 2026-02-22T21:01:23.023 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19745.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.21444.log.gz 2026-02-22T21:01:23.023 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20280.log 2026-02-22T21:01:23.023 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20007.log 2026-02-22T21:01:23.023 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19745.log.gz 2026-02-22T21:01:23.023 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21705.log 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20059.log 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20280.log.gz 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20862.log 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20007.log.gz 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20678.log 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.21705.log.gz 2026-02-22T21:01:23.024 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.20059.log.gz 2026-02-22T21:01:23.025 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19746.log 2026-02-22T21:01:23.025 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20372.log 2026-02-22T21:01:23.025 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20862.log.gz 2026-02-22T21:01:23.025 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20554.log 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.20678.log.gz 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.19746.log.gz 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21302.log 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20372.log.gz 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22809.log 2026-02-22T21:01:23.026 INFO:teuthology.orchestra.run.trial061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20554.log.gz 2026-02-22T21:01:23.027 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22218.log 2026-02-22T21:01:23.027 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19799.log 2026-02-22T21:01:23.027 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22218.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.21302.log.gz 2026-02-22T21:01:23.027 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22043.log 2026-02-22T21:01:23.028 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19799.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.22218.log.gz 2026-02-22T21:01:23.028 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22303.log 2026-02-22T21:01:23.028 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22809.log.gz 2026-02-22T21:01:23.028 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20008.log 2026-02-22T21:01:23.028 INFO:teuthology.orchestra.run.trial061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19799.log.gz 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20952.log 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22043.log.gz 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20136.log 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21478.log 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.22303.log.gz 2026-02-22T21:01:23.029 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20008.log.gz 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22536.log 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15803.log 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20136.log.gz 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.20952.log.gz 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23028.log 2026-02-22T21:01:23.030 INFO:teuthology.orchestra.run.trial061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.21478.log.gz 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19747.log 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15803.log.gz 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22665.log 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22536.log.gz 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.23028.log.gz 2026-02-22T21:01:23.031 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18997.log 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22129.log 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22665.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.19747.log.gz 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21387.log 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20462.log 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.18997.log.gz 2026-02-22T21:01:23.032 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.22665.log.gz 2026-02-22T21:01:23.033 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21869.log 2026-02-22T21:01:23.033 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19620.log 2026-02-22T21:01:23.033 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22129.log.gz 2026-02-22T21:01:23.033 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19481.log 2026-02-22T21:01:23.033 INFO:teuthology.orchestra.run.trial061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21387.log.gz 2026-02-22T21:01:23.034 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20680.log 2026-02-22T21:01:23.034 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20462.log.gz 2026-02-22T21:01:23.034 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19481.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.21869.log.gz 2026-02-22T21:01:23.034 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20824.log 2026-02-22T21:01:23.034 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21443.log 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19620.log.gz -- replaced with /var/log/ceph/ceph-client.admin.19481.log.gz 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20824.log: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20463.log 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20680.log.gz 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22755.log 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20824.log.gz 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22392.log 2026-02-22T21:01:23.035 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20463.log.gz 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22755.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21443.log.gz 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19920.log 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.22755.log.gz 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20371.log 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22573.log 2026-02-22T21:01:23.036 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20371.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19920.log.gz 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.22392.log.gz 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21215.log 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22537.log 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22573.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.20371.log.gz 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18779.log 2026-02-22T21:01:23.037 INFO:teuthology.orchestra.run.trial061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22573.log.gz 2026-02-22T21:01:23.038 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.21215.log.gz 2026-02-22T21:01:23.038 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21792.log 2026-02-22T21:01:23.038 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21180.log 2026-02-22T21:01:23.038 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.22537.log.gz 2026-02-22T21:01:23.038 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20679.log 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21180.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.21792.log.gz 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21531.log 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.18779.log.gz 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.21180.log.gz 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22391.log 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21531.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20679.log.gz 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18606.log 2026-02-22T21:01:23.039 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20499.log 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.21531.log.gz 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20190.log 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.22391.log.gz 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18778.log 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.18606.log.gz 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.20499.log.gz 2026-02-22T21:01:23.040 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18865.log 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18778.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20190.log.gz 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18867.log 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21651.log 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.18778.log.gz 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21353.log 2026-02-22T21:01:23.041 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.18865.log.gz 2026-02-22T21:01:23.042 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22305.log 2026-02-22T21:01:23.042 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.18867.log.gz 2026-02-22T21:01:23.042 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19086.log 2026-02-22T21:01:23.042 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21353.log: /var/log/ceph/ceph-client.admin.22305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20915.log 2026-02-22T21:01:23.042 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19086.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21651.log.gz 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19227.log 90.5% 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22305.log.gz 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.19086.log.gz 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15905.log 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21353.log.gz 2026-02-22T21:01:23.043 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20060.log/var/log/ceph/ceph-client.admin.19227.log: 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22936.log 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15905.log: /var/log/ceph/ceph-client.admin.20060.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.19227.log.gz 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22718.log 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.20915.log.gz 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.15905.log.gz 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20060.log.gz 2026-02-22T21:01:23.044 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19834.log 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20953.log 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22718.log: /var/log/ceph/ceph-client.admin.19834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19260.log 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20953.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.22936.log.gz 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.19834.log.gz 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22357.log 2026-02-22T21:01:23.045 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18960.log 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.20953.log.gz 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19260.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22718.log.gz 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19569.log 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22357.log.gz 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.18960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20227.log 2026-02-22T21:01:23.046 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19260.log.gz 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22810.log 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.19569.log.gz 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22628.log 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20227.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.18960.log.gz 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19447.log 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21740.log 2026-02-22T21:01:23.047 INFO:teuthology.orchestra.run.trial061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.22810.log.gz 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20227.log.gz 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.19447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22217.log 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22628.log.gz 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15929.log 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.19447.log.gz 2026-02-22T21:01:23.048 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22217.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.21740.log.gz 2026-02-22T21:01:23.049 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.15929.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.22217.log.gz 2026-02-22T21:01:23.049 INFO:teuthology.orchestra.run.trial061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.15929.log.gz 2026-02-22T21:01:23.118 INFO:teuthology.orchestra.run.trial007.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-22T21:01:23.144 INFO:teuthology.orchestra.run.trial061.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-22T21:01:23.202 INFO:teuthology.orchestra.run.trial007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T21:01:24.214 INFO:teuthology.orchestra.run.trial061.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-22T21:01:24.221 INFO:teuthology.orchestra.run.trial007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T21:01:24.267 INFO:teuthology.orchestra.run.trial007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T21:01:24.275 INFO:teuthology.orchestra.run.trial061.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T21:01:24.285 INFO:teuthology.orchestra.run.trial061.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-22T21:01:24.286 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T21:01:24.286 INFO:teuthology.orchestra.run.trial061.stderr:real 0m1.330s 2026-02-22T21:01:24.287 INFO:teuthology.orchestra.run.trial061.stderr:user 0m4.092s 2026-02-22T21:01:24.287 INFO:teuthology.orchestra.run.trial061.stderr:sys 0m0.266s 2026-02-22T21:01:24.346 INFO:teuthology.orchestra.run.trial007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T21:01:24.347 INFO:teuthology.orchestra.run.trial007.stderr: 2026-02-22T21:01:24.347 INFO:teuthology.orchestra.run.trial007.stderr:real 0m1.422s 2026-02-22T21:01:24.348 INFO:teuthology.orchestra.run.trial007.stderr:user 0m4.273s 2026-02-22T21:01:24.348 INFO:teuthology.orchestra.run.trial007.stderr:sys 0m0.251s 2026-02-22T21:01:24.348 INFO:tasks.ceph:Archiving logs... 2026-02-22T21:01:24.348 DEBUG:teuthology.misc:Transferring archived files from trial007:/var/log/ceph to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial007/log 2026-02-22T21:01:24.350 DEBUG:teuthology.orchestra.run.trial007:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T21:01:24.885 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/log/ceph to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial061/log 2026-02-22T21:01:24.886 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T21:01:25.381 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T21:01:25.394 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T21:01:25.394 DEBUG:teuthology.orchestra.run.trial007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T21:01:25.396 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T21:01:25.516 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T21:01:25.527 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T21:01:25.528 DEBUG:teuthology.orchestra.run.trial007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:01:25.529 DEBUG:teuthology.orchestra.run.trial061:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout:============================================================================== 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout:+baron.cgee.net 216.239.35.4 2 u 22 64 377 42.826 -2.629 1.027 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout:-23.186.168.133 132.163.97.4 2 u 13 64 373 69.728 -1.837 6.520 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout:*as393746.mci.tr 42.20.202.230 2 u 17 64 377 29.813 +0.677 0.451 2026-02-22T21:01:25.583 INFO:teuthology.orchestra.run.trial007.stdout:+tock.srs1.ntfo. 206.55.64.77 3 u 14 64 377 69.105 -1.244 0.847 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout:============================================================================== 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout:-ntp.maxhost.io 132.163.97.4 2 u 85 64 376 69.739 -1.301 6.726 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout:+173.249.203.227 228.188.15.147 2 u 13 64 377 62.043 -2.634 4.560 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout:+108.61.215.221 102.129.185.135 3 u 13 64 377 18.875 -0.496 5.132 2026-02-22T21:01:25.585 INFO:teuthology.orchestra.run.trial061.stdout:*99-28-14-242.li ...... 1 u 25 64 377 26.169 -1.408 4.857 2026-02-22T21:01:25.586 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T21:01:25.596 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T21:01:25.596 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T21:01:25.612 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T21:01:25.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T21:01:25.635 INFO:teuthology.task.internal:Duration was 768.210964 seconds 2026-02-22T21:01:25.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T21:01:25.647 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T21:01:25.647 DEBUG:teuthology.orchestra.run.trial007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T21:01:25.649 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T21:01:25.672 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T21:01:25.672 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial007.front.sepia.ceph.com 2026-02-22T21:01:25.673 DEBUG:teuthology.orchestra.run.trial007:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T21:01:25.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial061.front.sepia.ceph.com 2026-02-22T21:01:25.717 DEBUG:teuthology.orchestra.run.trial061:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T21:01:25.723 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T21:01:25.723 DEBUG:teuthology.orchestra.run.trial007:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:01:25.764 DEBUG:teuthology.orchestra.run.trial061:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:01:26.198 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T21:01:26.198 DEBUG:teuthology.orchestra.run.trial007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:01:26.199 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:01:26.207 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:01:26.208 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:01:26.208 INFO:teuthology.orchestra.run.trial007.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T21:01:26.208 INFO:teuthology.orchestra.run.trial007.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:01:26.208 INFO:teuthology.orchestra.run.trial007.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T21:01:26.210 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:01:26.211 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:01:26.211 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T21:01:26.211 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:01:26.212 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T21:01:26.275 INFO:teuthology.orchestra.run.trial007.stderr: 81.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T21:01:26.281 INFO:teuthology.orchestra.run.trial061.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T21:01:26.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T21:01:26.299 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T21:01:26.300 DEBUG:teuthology.orchestra.run.trial007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T21:01:26.328 DEBUG:teuthology.orchestra.run.trial061:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T21:01:26.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T21:01:26.353 DEBUG:teuthology.orchestra.run.trial007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:01:26.373 DEBUG:teuthology.orchestra.run.trial061:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:01:26.379 INFO:teuthology.orchestra.run.trial007.stdout:kernel.core_pattern = core 2026-02-22T21:01:26.386 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = core 2026-02-22T21:01:26.395 DEBUG:teuthology.orchestra.run.trial007:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:01:26.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:01:26.435 DEBUG:teuthology.orchestra.run.trial061:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:01:26.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:01:26.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T21:01:26.458 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T21:01:26.459 DEBUG:teuthology.misc:Transferring archived files from trial007:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial007 2026-02-22T21:01:26.459 DEBUG:teuthology.orchestra.run.trial007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T21:01:26.525 DEBUG:teuthology.misc:Transferring archived files from trial061:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64598/remote/trial061 2026-02-22T21:01:26.526 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T21:01:26.563 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T21:01:26.563 DEBUG:teuthology.orchestra.run.trial007:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T21:01:26.565 DEBUG:teuthology.orchestra.run.trial061:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T21:01:26.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T21:01:26.611 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T21:01:26.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T21:01:26.629 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T21:01:26.629 DEBUG:teuthology.orchestra.run.trial007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T21:01:26.632 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T21:01:26.635 INFO:teuthology.orchestra.run.trial007.stdout: 1179687 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 21:01 /home/ubuntu/cephtest 2026-02-22T21:01:26.638 INFO:teuthology.orchestra.run.trial061.stdout: 1179687 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 21:01 /home/ubuntu/cephtest 2026-02-22T21:01:26.640 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T21:01:26.658 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T21:01:26.694 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{v2/{compr$/{yes$/{snappy}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} duration: 768.2109639644623 flavor: default owner: scheduled_nmordech@soko04.front.sepia.ceph.com success: true 2026-02-22T21:01:26.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:01:26.815 INFO:teuthology.run:pass